2024-09-10T21:55:29.405 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T21:55:29.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T21:55:29.526 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899713' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported dry_run: true install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6EBZOV0tsfnXZ40vtiietA3MW2NgceNhRoD/lwm0JuGDpzFPzMdhu/28BOBSqlAwgGtZ6BUHbyW/2Z30vO3KU= smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEmOAgmvgccL6XDdkLUQG8GwAnmdIbUj5gfVR/0U2ht/zKBx2abF9nR2r+ZlaCf72sCBsFdahH4dWovI71L4Ul4= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGovC4dzV5tx71w7PdjVyXIvEIdmIbzPRNXDyoD8TiDpVcQEN4BDk0g/rLRqsuH1JGVbBWEPV4W7L16IDpZU98o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T21:55:29.526 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-10T21:55:29.527 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-10T21:55:29.527 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T21:55:29.528 INFO:teuthology.task.internal:Checking packages... 2024-09-10T21:55:29.548 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-10T21:55:29.548 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T21:55:29.548 INFO:teuthology.packaging:ref: None 2024-09-10T21:55:29.548 INFO:teuthology.packaging:tag: None 2024-09-10T21:55:29.548 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-10T21:55:29.548 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T21:55:29.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-10T21:55:29.701 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-10T21:55:29.703 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T21:55:29.709 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T21:55:29.709 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T21:55:29.737 INFO:teuthology.task.internal:Saving configuration 2024-09-10T21:55:29.757 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T21:55:29.769 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T21:55:29.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:50:15.166531', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6EBZOV0tsfnXZ40vtiietA3MW2NgceNhRoD/lwm0JuGDpzFPzMdhu/28BOBSqlAwgGtZ6BUHbyW/2Z30vO3KU='} 2024-09-10T21:55:29.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:50:15.162053', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEmOAgmvgccL6XDdkLUQG8GwAnmdIbUj5gfVR/0U2ht/zKBx2abF9nR2r+ZlaCf72sCBsFdahH4dWovI71L4Ul4='} 2024-09-10T21:55:29.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 21:50:15.164096', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGovC4dzV5tx71w7PdjVyXIvEIdmIbzPRNXDyoD8TiDpVcQEN4BDk0g/rLRqsuH1JGVbBWEPV4W7L16IDpZU98o='} 2024-09-10T21:55:29.867 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T21:55:29.873 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-10T21:55:29.873 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-10T21:55:29.873 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-10T21:55:29.873 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T21:55:29.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb23e84fbe0>, signals=[15]) 2024-09-10T21:55:29.987 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T21:55:29.997 INFO:teuthology.task.internal:Opening connections... 2024-09-10T21:55:29.998 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T21:55:29.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:55:30.081 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T21:55:30.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:55:30.162 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T21:55:30.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:55:30.247 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T21:55:30.255 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-09-10T21:55:30.274 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-09-10T21:55:30.274 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T21:55:30.332 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-09-10T21:55:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T21:55:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T21:55:30.333 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T21:55:30.333 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-09-10T21:55:30.362 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-09-10T21:55:30.380 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-09-10T21:55:30.380 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="CentOS Stream" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="9" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:ID="centos" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="rhel fedora" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="9" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el9" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:LOGO="fedora-logo-icon" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://centos.org/" 2024-09-10T21:55:30.438 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T21:55:30.439 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T21:55:30.439 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T21:55:30.439 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-09-10T21:55:30.470 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-10T21:55:30.488 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-10T21:55:30.489 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-10T21:55:30.547 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2024-09-10T21:55:30.547 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="9" 2024-09-10T21:55:30.547 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2024-09-10T21:55:30.547 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2024-09-10T21:55:30.547 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="9" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el9" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:LOGO="fedora-logo-icon" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T21:55:30.548 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T21:55:30.549 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-10T21:55:30.578 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T21:55:30.591 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T21:55:30.601 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T21:55:30.601 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-09-10T21:55:30.604 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-09-10T21:55:30.606 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-10T21:55:30.623 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T21:55:30.634 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T21:55:30.634 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-09-10T21:55:30.661 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-09-10T21:55:30.663 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-10T21:55:30.699 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T21:55:30.810 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T21:55:30.826 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-10T21:55:30.827 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-10T21:55:30.827 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-10T21:55:30.827 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T21:55:30.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:55:30.844 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-10T21:55:30.903 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-503.el9.x86_64 2024-09-10T21:55:30.903 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-503.el9.x86_64 2024-09-10T21:55:30.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-09-10T21:55:33.227 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-10T21:55:48.218 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 20 MB 00:13 2024-09-10T21:55:52.585 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-10T21:55:54.010 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 114 kB/s | 19 kB 00:00 2024-09-10T21:55:55.339 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-10T21:56:01.029 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-10T21:56:03.152 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-10T21:56:03.152 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-10T21:56:03.252 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-10T21:56:03.263 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-10T21:56:03.264 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T21:56:03.265 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-10T21:56:03.265 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-10T21:56:03.265 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-09-10T21:56:03.265 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T21:56:03.266 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 79 M 2024-09-10T21:56:03.266 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 126 M 2024-09-10T21:56:03.266 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-10T21:56:03.480 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 201 kB/s | 23 kB 00:00 2024-09-10T21:56:06.589 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-10T21:56:07.938 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 7.6 MB/s | 35 MB 00:04 2024-09-10T21:56:11.705 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 3.5 MB/s | 29 MB 00:08 2024-09-10T21:56:11.705 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-10T21:56:11.705 INFO:teuthology.orchestra.run.smithi005.stdout:Total 9.3 MB/s | 79 MB 00:08 2024-09-10T21:56:12.414 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-10T21:56:12.794 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-10T21:56:12.795 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-10T21:56:13.786 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-10T21:56:13.787 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-10T21:56:16.386 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-10T21:56:17.058 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-10T21:56:17.155 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T21:56:19.935 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T21:56:20.058 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T21:56:25.180 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T21:56:25.226 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:56:30.357 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:57:09.397 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:57:09.438 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:57:09.804 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:57:09.804 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-10T21:57:09.804 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-10T21:57:09.805 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-10T21:57:10.619 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T21:57:10.620 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-10T21:57:10.978 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T21:57:11.067 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T21:57:11.068 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T21:57:11.068 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-10T21:57:11.068 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T21:57:11.068 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T21:57:11.068 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-10T21:57:11.068 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T21:57:11.069 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-10T21:57:11.127 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-10T21:57:11.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-10T21:57:11.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 82.el9 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T21:57:11.164 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8274670 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T21:57:11.165 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T21:57:11.166 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T21:57:11.166 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-09-10T21:57:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T21:57:11.166 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T21:57:11.166 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T21:57:11.167 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-505.el9.x86_64 2024-09-10T21:57:11.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T21:57:11.794 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-09-10T21:57:13.122 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T21:57:13.153 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-09-10T21:57:13.155 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-10T21:57:13.170 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.id9MNe9dVe 2024-09-10T21:57:13.170 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.id9MNe9dVe 2024-09-10T21:57:13.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.id9MNe9dVe 2024-09-10T21:57:13.392 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.id9MNe9dVe is 6KB 2024-09-10T21:57:13.441 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.id9MNe9dVe 2024-09-10T21:57:13.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T21:57:13.518 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T21:57:13.518 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T21:57:13.518 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T21:57:13.518 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-10T21:57:13.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-10T21:57:13.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-09-10T21:57:43.662 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T21:57:43.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-10T21:57:43.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:58:02.045 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-09-10T21:58:11.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-10T21:58:11.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:59:11.075 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T21:59:23.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-10T21:59:23.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T21:59:23.417 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-10T21:59:23.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-10T21:59:23.782 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-10T21:59:23.782 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-10T21:59:23.799 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-505.el9.x86_64 2024-09-10T21:59:23.800 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-10T21:59:23.800 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T21:59:23.800 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T21:59:24.801 DEBUG:teuthology.parallel:result is None 2024-09-10T21:59:24.801 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T21:59:24.809 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T21:59:24.809 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T21:59:24.811 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T21:59:24.814 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T21:59:24.833 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T21:59:24.839 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T21:59:24.847 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T21:59:24.847 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T21:59:24.871 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T21:59:24.873 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T21:59:24.987 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T21:59:24.993 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T21:59:24.993 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T21:59:25.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:59:25.011 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T21:59:25.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:59:25.027 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T21:59:25.030 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T21:59:25.053 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T21:59:25.085 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:59:25.105 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:59:25.120 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:59:25.131 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:59:25.141 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:59:25.151 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T21:59:25.153 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T21:59:25.160 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T21:59:25.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T21:59:25.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T21:59:25.166 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T21:59:25.193 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T21:59:25.203 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T21:59:25.203 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T21:59:25.232 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T21:59:25.235 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T21:59:25.251 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:59:25.343 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:59:25.384 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:59:25.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:59:25.512 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T21:59:25.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T21:59:25.580 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:59:25.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:59:25.683 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:59:25.772 DEBUG:teuthology.orchestra.run.smithi052:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:59:25.812 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T21:59:25.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T21:59:25.880 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:59:25.933 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T21:59:25.985 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:59:26.034 DEBUG:teuthology.orchestra.run.smithi189:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T21:59:26.073 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T21:59:26.073 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T21:59:26.140 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-09-10T21:59:26.142 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-09-10T21:59:26.145 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-10T21:59:26.183 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:59:26.193 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:59:26.221 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T21:59:26.621 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T21:59:26.628 INFO:teuthology.task.internal:Starting timer... 2024-09-10T21:59:26.629 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T21:59:26.742 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T21:59:26.750 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-10T21:59:26.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-09-10T21:59:26.827 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-09-10T21:59:26.829 DEBUG:teuthology.orchestra.run.smithi052:> sudo service auditd rotate 2024-09-10T21:59:26.876 INFO:teuthology.orchestra.run.smithi052.stdout:Rotating logs: 2024-09-10T21:59:26.878 DEBUG:teuthology.orchestra.run.smithi189:> sudo service auditd rotate 2024-09-10T21:59:26.944 INFO:teuthology.orchestra.run.smithi189.stdout:Rotating logs: 2024-09-10T21:59:26.946 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T21:59:26.946 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-09-10T21:59:26.971 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-09-10T21:59:26.971 DEBUG:teuthology.orchestra.run.smithi052:> /usr/sbin/getenforce 2024-09-10T21:59:26.991 INFO:teuthology.orchestra.run.smithi052.stdout:Permissive 2024-09-10T21:59:26.991 DEBUG:teuthology.orchestra.run.smithi189:> /usr/sbin/getenforce 2024-09-10T21:59:27.012 INFO:teuthology.orchestra.run.smithi189.stdout:Permissive 2024-09-10T21:59:27.013 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi052.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi189.front.sepia.ceph.com': 'permissive'} 2024-09-10T21:59:27.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:59:27.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:59:27.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:59:27.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:59:27.072 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T21:59:27.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T21:59:27.099 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T21:59:27.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-09-10T21:59:27.138 DEBUG:teuthology.orchestra.run.smithi052:> sudo /usr/sbin/setenforce permissive 2024-09-10T21:59:27.168 DEBUG:teuthology.orchestra.run.smithi189:> sudo /usr/sbin/setenforce permissive 2024-09-10T21:59:27.198 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T21:59:27.206 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T21:59:27.218 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T21:59:27.219 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi052.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T22:03:30.892 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-10T22:03:30.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-10T22:03:30.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:03:30.977 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-10T22:03:31.008 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-10T22:03:31.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T22:03:31.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:03:31.090 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-09-10T22:03:31.168 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-09-10T22:03:31.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T22:03:31.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T22:03:31.254 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-10T22:03:31.333 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T22:03:31.334 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T22:03:31.344 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T22:03:31.344 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:03:31.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:03:31.347 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:03:31.347 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:03:31.349 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T22:03:31.349 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:03:31.376 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:03:31.376 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:03:31.391 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:03:31.391 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:03:31.408 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T22:03:31.415 INFO:teuthology.orchestra.run.smithi052.stderr:sudo: ntpd: command not found 2024-09-10T22:03:31.417 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-09-10T22:03:31.424 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T22:03:31.427 INFO:teuthology.orchestra.run.smithi052.stdout:506 Cannot talk to daemon 2024-09-10T22:03:31.428 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-09-10T22:03:31.441 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:03:31.443 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:03:31.450 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: ntpd: command not found 2024-09-10T22:03:31.455 INFO:teuthology.orchestra.run.smithi052.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:03:31.457 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:03:31.462 INFO:teuthology.orchestra.run.smithi189.stdout:506 Cannot talk to daemon 2024-09-10T22:03:31.477 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T22:03:31.491 INFO:teuthology.orchestra.run.smithi189.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T22:03:31.512 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:03:31.515 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:03:31.515 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-10T22:03:31.516 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.516 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.516 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.516 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.516 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:03:31.519 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:03:31.519 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-10T22:03:31.519 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.519 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.519 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.519 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.545 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:03:31.549 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:03:31.549 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-10T22:03:31.549 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.549 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.549 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.549 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:03:31.550 INFO:teuthology.run_tasks:Running task install... 2024-09-10T22:03:31.558 DEBUG:teuthology.task.install:project ceph 2024-09-10T22:03:31.558 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-10T22:03:31.558 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-10T22:03:31.558 INFO:teuthology.task.install:Using flavor: default 2024-09-10T22:03:31.563 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T22:03:31.563 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T22:03:31.563 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:03:31.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:03:31.566 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:03:31.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:03:31.567 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-10T22:03:31.567 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:03:31.721 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:03:31.721 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:03:31.735 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:03:31.735 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:03:31.746 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-10T22:03:31.746 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-10T22:03:31.842 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:03:31.842 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:03:31.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:03:31.853 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:03:31.853 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:03:31.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:03:31.862 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T22:03:31.863 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:03:31.863 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T22:03:31.869 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T22:03:31.870 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:03:31.879 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T22:03:31.880 DEBUG:teuthology.orchestra.run.smithi052:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:03:31.891 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T22:03:31.891 DEBUG:teuthology.orchestra.run.smithi189:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T22:03:31.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:03:31.947 DEBUG:teuthology.orchestra.run.smithi052:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:03:31.958 DEBUG:teuthology.orchestra.run.smithi189:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T22:03:32.015 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:03:32.024 DEBUG:teuthology.orchestra.run.smithi052:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:03:32.035 DEBUG:teuthology.orchestra.run.smithi189:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T22:03:32.080 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-09-10T22:03:32.082 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-09-10T22:03:32.089 INFO:teuthology.orchestra.run.smithi052.stdout:check_obsoletes = 1 2024-09-10T22:03:32.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum clean all 2024-09-10T22:03:32.100 INFO:teuthology.orchestra.run.smithi189.stdout:check_obsoletes = 1 2024-09-10T22:03:32.101 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum clean all 2024-09-10T22:03:32.321 INFO:teuthology.orchestra.run.smithi052.stdout:45 files removed 2024-09-10T22:03:32.329 INFO:teuthology.orchestra.run.smithi189.stdout:45 files removed 2024-09-10T22:03:32.334 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-09-10T22:03:32.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T22:03:32.357 DEBUG:teuthology.orchestra.run.smithi189:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T22:03:32.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T22:03:32.900 INFO:teuthology.orchestra.run.smithi189.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-10T22:03:32.917 INFO:teuthology.orchestra.run.smithi052.stdout:ceph packages for x86_64 295 kB/s | 84 kB 00:00 2024-09-10T22:03:32.945 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 298 kB/s | 84 kB 00:00 2024-09-10T22:03:33.184 INFO:teuthology.orchestra.run.smithi189.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-10T22:03:33.201 INFO:teuthology.orchestra.run.smithi052.stdout:ceph noarch packages 101 kB/s | 24 kB 00:00 2024-09-10T22:03:33.237 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-10T22:03:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:ceph source packages 8.7 kB/s | 1.9 kB 00:00 2024-09-10T22:03:33.469 INFO:teuthology.orchestra.run.smithi052.stdout:ceph source packages 8.4 kB/s | 1.9 kB 00:00 2024-09-10T22:03:33.521 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-10T22:03:33.885 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - BaseOS 22 MB/s | 8.2 MB 00:00 2024-09-10T22:03:34.005 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-10T22:03:35.806 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-10T22:03:36.058 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-09-10T22:03:36.061 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-10T22:03:37.744 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - AppStream 36 MB/s | 20 MB 00:00 2024-09-10T22:03:42.896 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.5 MB 00:02 2024-09-10T22:03:42.970 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.5 MB 00:01 2024-09-10T22:03:44.446 INFO:teuthology.orchestra.run.smithi189.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-10T22:03:44.846 INFO:teuthology.orchestra.run.smithi052.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-10T22:03:45.631 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.5 MB 00:05 2024-09-10T22:03:45.917 INFO:teuthology.orchestra.run.smithi189.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-10T22:03:46.375 INFO:teuthology.orchestra.run.smithi052.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-10T22:03:47.515 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-10T22:03:49.136 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-10T22:03:51.372 INFO:teuthology.orchestra.run.smithi189.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T22:03:52.065 INFO:teuthology.orchestra.run.smithi052.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T22:03:53.651 INFO:teuthology.orchestra.run.smithi189.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:03:53.652 INFO:teuthology.orchestra.run.smithi189.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:03:53.665 INFO:teuthology.orchestra.run.smithi189.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T22:03:53.666 INFO:teuthology.orchestra.run.smithi189.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T22:03:53.668 INFO:teuthology.orchestra.run.smithi189.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T22:03:53.669 INFO:teuthology.orchestra.run.smithi189.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T22:03:53.671 INFO:teuthology.orchestra.run.smithi189.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T22:03:53.673 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T22:03:53.674 INFO:teuthology.orchestra.run.smithi189.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T22:03:53.740 INFO:teuthology.orchestra.run.smithi189.stdout:Dependencies resolved. 2024-09-10T22:03:53.765 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-09-10T22:03:53.765 INFO:teuthology.orchestra.run.smithi189.stdout: Package Arch Version Repository Size 2024-09-10T22:03:53.765 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-09-10T22:03:53.765 INFO:teuthology.orchestra.run.smithi189.stdout:Installing: 2024-09-10T22:03:53.765 INFO:teuthology.orchestra.run.smithi189.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:03:53.766 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T22:03:53.767 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrading: 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T22:03:53.768 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout:Installing dependencies: 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:03:53.769 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:03:53.770 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:03:53.771 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:03:53.772 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:03:53.773 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:03:53.774 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:03:53.775 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:03:53.776 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout:Installing weak dependencies: 2024-09-10T22:03:53.777 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:03:53.778 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:03:53.778 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction Summary 2024-09-10T22:03:53.778 INFO:teuthology.orchestra.run.smithi189.stdout:======================================================================================= 2024-09-10T22:03:53.778 INFO:teuthology.orchestra.run.smithi189.stdout:Install 149 Packages 2024-09-10T22:03:53.778 INFO:teuthology.orchestra.run.smithi189.stdout:Upgrade 8 Packages 2024-09-10T22:03:53.778 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:03:53.779 INFO:teuthology.orchestra.run.smithi189.stdout:Total download size: 240 M 2024-09-10T22:03:53.779 INFO:teuthology.orchestra.run.smithi189.stdout:Downloading Packages: 2024-09-10T22:03:54.082 INFO:teuthology.orchestra.run.smithi189.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-10T22:03:54.315 INFO:teuthology.orchestra.run.smithi189.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-10T22:03:54.432 INFO:teuthology.orchestra.run.smithi189.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-10T22:03:54.434 INFO:teuthology.orchestra.run.smithi052.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:03:54.435 INFO:teuthology.orchestra.run.smithi052.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:03:54.447 INFO:teuthology.orchestra.run.smithi052.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T22:03:54.447 INFO:teuthology.orchestra.run.smithi052.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T22:03:54.448 INFO:teuthology.orchestra.run.smithi052.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T22:03:54.449 INFO:teuthology.orchestra.run.smithi052.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T22:03:54.451 INFO:teuthology.orchestra.run.smithi052.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T22:03:54.453 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T22:03:54.454 INFO:teuthology.orchestra.run.smithi052.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T22:03:54.457 INFO:teuthology.orchestra.run.smithi189.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.0 MB/s | 145 kB 00:00 2024-09-10T22:03:54.521 INFO:teuthology.orchestra.run.smithi052.stdout:Dependencies resolved. 2024-09-10T22:03:54.547 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: Package Arch Version Repository Size 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout:Installing: 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:03:54.548 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:03:54.549 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:03:54.550 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrading: 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout:Installing dependencies: 2024-09-10T22:03:54.551 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:03:54.552 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:03:54.553 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:03:54.554 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:03:54.555 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:03:54.556 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:03:54.557 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:03:54.558 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:03:54.559 INFO:teuthology.orchestra.run.smithi052.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout:Installing weak dependencies: 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction Summary 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout:======================================================================================= 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout:Install 149 Packages 2024-09-10T22:03:54.560 INFO:teuthology.orchestra.run.smithi052.stdout:Upgrade 8 Packages 2024-09-10T22:03:54.561 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:03:54.561 INFO:teuthology.orchestra.run.smithi052.stdout:Total download size: 240 M 2024-09-10T22:03:54.561 INFO:teuthology.orchestra.run.smithi052.stdout:Downloading Packages: 2024-09-10T22:03:54.599 INFO:teuthology.orchestra.run.smithi189.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 14 MB/s | 2.4 MB 00:00 2024-09-10T22:03:54.641 INFO:teuthology.orchestra.run.smithi189.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-09-10T22:03:54.934 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-10T22:03:55.000 INFO:teuthology.orchestra.run.smithi189.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 4.8 MB 00:00 2024-09-10T22:03:55.091 INFO:teuthology.orchestra.run.smithi052.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 32 kB/s | 6.6 kB 00:00 2024-09-10T22:03:55.234 INFO:teuthology.orchestra.run.smithi189.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-10T22:03:55.292 INFO:teuthology.orchestra.run.smithi189.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 432 kB/s | 25 kB 00:00 2024-09-10T22:03:55.350 INFO:teuthology.orchestra.run.smithi052.stdout:(2/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-10T22:03:55.391 INFO:teuthology.orchestra.run.smithi052.stdout:(3/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.9 MB/s | 900 kB 00:00 2024-09-10T22:03:55.442 INFO:teuthology.orchestra.run.smithi052.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.5 MB/s | 145 kB 00:00 2024-09-10T22:03:55.751 INFO:teuthology.orchestra.run.smithi189.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 15 MB/s | 11 MB 00:00 2024-09-10T22:03:55.792 INFO:teuthology.orchestra.run.smithi052.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 5.9 MB/s | 2.4 MB 00:00 2024-09-10T22:03:55.926 INFO:teuthology.orchestra.run.smithi189.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 17 MB 00:01 2024-09-10T22:03:55.951 INFO:teuthology.orchestra.run.smithi189.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.1 MB/s | 225 kB 00:00 2024-09-10T22:03:55.977 INFO:teuthology.orchestra.run.smithi189.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 540 kB/s | 27 kB 00:00 2024-09-10T22:03:56.002 INFO:teuthology.orchestra.run.smithi189.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 632 kB/s | 32 kB 00:00 2024-09-10T22:03:56.025 INFO:teuthology.orchestra.run.smithi052.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-09-10T22:03:56.035 INFO:teuthology.orchestra.run.smithi189.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 755 kB 00:00 2024-09-10T22:03:56.061 INFO:teuthology.orchestra.run.smithi189.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.7 MB/s | 162 kB 00:00 2024-09-10T22:03:56.094 INFO:teuthology.orchestra.run.smithi189.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.1 MB/s | 127 kB 00:00 2024-09-10T22:03:56.136 INFO:teuthology.orchestra.run.smithi189.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 6.6 MB/s | 507 kB 00:00 2024-09-10T22:03:56.159 INFO:teuthology.orchestra.run.smithi052.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 4.8 MB 00:00 2024-09-10T22:03:56.220 INFO:teuthology.orchestra.run.smithi189.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 541 kB/s | 45 kB 00:00 2024-09-10T22:03:56.312 INFO:teuthology.orchestra.run.smithi189.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.5 MB/s | 143 kB 00:00 2024-09-10T22:03:56.412 INFO:teuthology.orchestra.run.smithi189.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.6 MB/s | 161 kB 00:00 2024-09-10T22:03:56.554 INFO:teuthology.orchestra.run.smithi189.stdout:(22/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-10T22:03:56.579 INFO:teuthology.orchestra.run.smithi189.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 1.9 MB/s | 321 kB 00:00 2024-09-10T22:03:56.638 INFO:teuthology.orchestra.run.smithi189.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 3.6 MB/s | 306 kB 00:00 2024-09-10T22:03:56.655 INFO:teuthology.orchestra.run.smithi189.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.3 MB/s | 99 kB 00:00 2024-09-10T22:03:56.722 INFO:teuthology.orchestra.run.smithi189.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.0 MB/s | 85 kB 00:00 2024-09-10T22:03:56.814 INFO:teuthology.orchestra.run.smithi189.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 171 kB 00:00 2024-09-10T22:03:56.906 INFO:teuthology.orchestra.run.smithi189.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 373 kB/s | 34 kB 00:00 2024-09-10T22:03:56.973 INFO:teuthology.orchestra.run.smithi189.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.3 MB/s | 154 kB 00:00 2024-09-10T22:03:57.039 INFO:teuthology.orchestra.run.smithi189.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 8.3 MB/s | 3.2 MB 00:00 2024-09-10T22:03:57.059 INFO:teuthology.orchestra.run.smithi052.stdout:(8/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 17 MB 00:01 2024-09-10T22:03:57.151 INFO:teuthology.orchestra.run.smithi052.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 274 kB/s | 25 kB 00:00 2024-09-10T22:03:57.347 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:03:57.347 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T22:03:57.361 INFO:teuthology.orchestra.run.smithi005.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T22:03:57.362 INFO:teuthology.orchestra.run.smithi005.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T22:03:57.363 INFO:teuthology.orchestra.run.smithi005.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T22:03:57.364 INFO:teuthology.orchestra.run.smithi005.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T22:03:57.366 INFO:teuthology.orchestra.run.smithi005.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T22:03:57.369 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T22:03:57.370 INFO:teuthology.orchestra.run.smithi005.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T22:03:57.438 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-10T22:03:57.456 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-09-10T22:03:57.456 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-10T22:03:57.457 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-10T22:03:57.458 INFO:teuthology.orchestra.run.smithi005.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T22:03:57.459 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-10T22:03:57.460 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T22:03:57.461 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T22:03:57.462 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T22:03:57.463 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T22:03:57.464 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T22:03:57.465 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T22:03:57.466 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T22:03:57.467 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:03:57.468 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-10T22:03:57.469 INFO:teuthology.orchestra.run.smithi005.stdout:======================================================================================= 2024-09-10T22:03:57.469 INFO:teuthology.orchestra.run.smithi005.stdout:Install 149 Packages 2024-09-10T22:03:57.469 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 8 Packages 2024-09-10T22:03:57.469 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:03:57.469 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 240 M 2024-09-10T22:03:57.469 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-10T22:03:57.927 INFO:teuthology.orchestra.run.smithi052.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 6.2 MB/s | 11 MB 00:01 2024-09-10T22:03:57.940 INFO:teuthology.orchestra.run.smithi189.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 8.2 MB/s | 7.4 MB 00:00 2024-09-10T22:03:57.993 INFO:teuthology.orchestra.run.smithi052.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.3 MB/s | 225 kB 00:00 2024-09-10T22:03:58.035 INFO:teuthology.orchestra.run.smithi052.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 648 kB/s | 27 kB 00:00 2024-09-10T22:03:58.082 INFO:teuthology.orchestra.run.smithi189.stdout:(32/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 13 MB/s | 14 MB 00:01 2024-09-10T22:03:58.086 INFO:teuthology.orchestra.run.smithi052.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 635 kB/s | 32 kB 00:00 2024-09-10T22:03:58.107 INFO:teuthology.orchestra.run.smithi189.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.7 MB/s | 291 kB 00:00 2024-09-10T22:03:58.124 INFO:teuthology.orchestra.run.smithi189.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 1.2 MB/s | 49 kB 00:00 2024-09-10T22:03:58.126 INFO:teuthology.orchestra.run.smithi005.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 42 kB/s | 6.6 kB 00:00 2024-09-10T22:03:58.166 INFO:teuthology.orchestra.run.smithi189.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 280 kB/s | 16 kB 00:00 2024-09-10T22:03:58.186 INFO:teuthology.orchestra.run.smithi052.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 755 kB 00:00 2024-09-10T22:03:58.191 INFO:teuthology.orchestra.run.smithi189.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.2 MB/s | 285 kB 00:00 2024-09-10T22:03:58.261 INFO:teuthology.orchestra.run.smithi052.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.1 MB/s | 162 kB 00:00 2024-09-10T22:03:58.283 INFO:teuthology.orchestra.run.smithi189.stdout:(37/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 199 kB/s | 18 kB 00:00 2024-09-10T22:03:58.308 INFO:teuthology.orchestra.run.smithi189.stdout:(38/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 5.4 MB/s | 783 kB 00:00 2024-09-10T22:03:58.328 INFO:teuthology.orchestra.run.smithi052.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-10T22:03:58.453 INFO:teuthology.orchestra.run.smithi052.stdout:(17/157): libradosstriper1-19.3.0-4854.g8f219c4 4.0 MB/s | 507 kB 00:00 2024-09-10T22:03:58.702 INFO:teuthology.orchestra.run.smithi005.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 1.5 MB/s | 900 kB 00:00 2024-09-10T22:03:58.793 INFO:teuthology.orchestra.run.smithi005.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.5 MB/s | 145 kB 00:00 2024-09-10T22:03:58.950 INFO:teuthology.orchestra.run.smithi189.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 14 MB/s | 50 MB 00:03 2024-09-10T22:03:58.954 INFO:teuthology.orchestra.run.smithi052.stdout:(18/157): ceph-common-19.3.0-4854.g8f219c47.el9 5.3 MB/s | 22 MB 00:04 2024-09-10T22:03:59.037 INFO:teuthology.orchestra.run.smithi052.stdout:(19/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 9.5 MB/s | 5.5 MB 00:00 2024-09-10T22:03:59.088 INFO:teuthology.orchestra.run.smithi052.stdout:(20/157): python3-ceph-argparse-19.3.0-4854.g8f 338 kB/s | 45 kB 00:00 2024-09-10T22:03:59.121 INFO:teuthology.orchestra.run.smithi052.stdout:(21/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-10T22:03:59.146 INFO:teuthology.orchestra.run.smithi052.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.7 MB/s | 161 kB 00:00 2024-09-10T22:03:59.152 INFO:teuthology.orchestra.run.smithi005.stdout:(4/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 6.6 MB/s | 2.4 MB 00:00 2024-09-10T22:03:59.171 INFO:teuthology.orchestra.run.smithi052.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-10T22:03:59.197 INFO:teuthology.orchestra.run.smithi052.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.9 MB/s | 306 kB 00:00 2024-09-10T22:03:59.222 INFO:teuthology.orchestra.run.smithi052.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T22:03:59.247 INFO:teuthology.orchestra.run.smithi052.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T22:03:59.292 INFO:teuthology.orchestra.run.smithi189.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 79 kB/s | 80 kB 00:01 2024-09-10T22:03:59.298 INFO:teuthology.orchestra.run.smithi052.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.3 MB/s | 171 kB 00:00 2024-09-10T22:03:59.327 INFO:teuthology.orchestra.run.smithi005.stdout:(5/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 4.1 MB/s | 5.5 MB 00:01 2024-09-10T22:03:59.357 INFO:teuthology.orchestra.run.smithi052.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 587 kB/s | 34 kB 00:00 2024-09-10T22:03:59.369 INFO:teuthology.orchestra.run.smithi005.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 7.0 MB/s | 1.5 MB 00:00 2024-09-10T22:03:59.415 INFO:teuthology.orchestra.run.smithi052.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 2.6 MB/s | 154 kB 00:00 2024-09-10T22:03:59.532 INFO:teuthology.orchestra.run.smithi052.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 10 MB/s | 3.2 MB 00:00 2024-09-10T22:03:59.767 INFO:teuthology.orchestra.run.smithi189.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 234 kB/s | 191 kB 00:00 2024-09-10T22:03:59.978 INFO:teuthology.orchestra.run.smithi005.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 7.4 MB/s | 4.8 MB 00:00 2024-09-10T22:04:00.143 INFO:teuthology.orchestra.run.smithi189.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 437 kB/s | 801 kB 00:01 2024-09-10T22:04:00.168 INFO:teuthology.orchestra.run.smithi189.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 289 kB/s | 253 kB 00:00 2024-09-10T22:04:00.491 INFO:teuthology.orchestra.run.smithi052.stdout:(31/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 15 MB/s | 50 MB 00:03 2024-09-10T22:04:00.599 INFO:teuthology.orchestra.run.smithi052.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 6.9 MB/s | 7.4 MB 00:01 2024-09-10T22:04:00.625 INFO:teuthology.orchestra.run.smithi052.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 2.1 MB/s | 291 kB 00:00 2024-09-10T22:04:00.650 INFO:teuthology.orchestra.run.smithi052.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 988 kB/s | 49 kB 00:00 2024-09-10T22:04:00.675 INFO:teuthology.orchestra.run.smithi052.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 329 kB/s | 16 kB 00:00 2024-09-10T22:04:00.709 INFO:teuthology.orchestra.run.smithi052.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.8 MB/s | 285 kB 00:00 2024-09-10T22:04:00.728 INFO:teuthology.orchestra.run.smithi005.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 7.9 MB/s | 22 MB 00:02 2024-09-10T22:04:00.775 INFO:teuthology.orchestra.run.smithi052.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 7.6 MB/s | 783 kB 00:00 2024-09-10T22:04:00.779 INFO:teuthology.orchestra.run.smithi005.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 500 kB/s | 25 kB 00:00 2024-09-10T22:04:00.802 INFO:teuthology.orchestra.run.smithi189.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-10T22:04:00.809 INFO:teuthology.orchestra.run.smithi052.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 182 kB/s | 18 kB 00:00 2024-09-10T22:04:00.827 INFO:teuthology.orchestra.run.smithi189.stdout:(45/157): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-09-10T22:04:00.860 INFO:teuthology.orchestra.run.smithi189.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 195 kB/s | 135 kB 00:00 2024-09-10T22:04:00.904 INFO:teuthology.orchestra.run.smithi005.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 12 MB/s | 11 MB 00:00 2024-09-10T22:04:01.079 INFO:teuthology.orchestra.run.smithi005.stdout:(11/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 17 MB 00:01 2024-09-10T22:04:01.085 INFO:teuthology.orchestra.run.smithi052.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 8.5 MB/s | 14 MB 00:01 2024-09-10T22:04:01.104 INFO:teuthology.orchestra.run.smithi005.stdout:(12/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 1.1 MB/s | 225 kB 00:00 2024-09-10T22:04:01.189 INFO:teuthology.orchestra.run.smithi005.stdout:(13/157): cephfs-shell-19.3.0-4854.g8f219c47.el 248 kB/s | 27 kB 00:00 2024-09-10T22:04:01.213 INFO:teuthology.orchestra.run.smithi005.stdout:(14/157): libcephfs-devel-19.3.0-4854.g8f219c47 293 kB/s | 32 kB 00:00 2024-09-10T22:04:01.255 INFO:teuthology.orchestra.run.smithi005.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 11 MB/s | 755 kB 00:00 2024-09-10T22:04:01.280 INFO:teuthology.orchestra.run.smithi005.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-10T22:04:01.306 INFO:teuthology.orchestra.run.smithi005.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-10T22:04:01.339 INFO:teuthology.orchestra.run.smithi005.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 8.5 MB/s | 507 kB 00:00 2024-09-10T22:04:01.398 INFO:teuthology.orchestra.run.smithi005.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 776 kB/s | 45 kB 00:00 2024-09-10T22:04:01.465 INFO:teuthology.orchestra.run.smithi005.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.1 MB/s | 143 kB 00:00 2024-09-10T22:04:01.519 INFO:teuthology.orchestra.run.smithi189.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 174 kB/s | 125 kB 00:00 2024-09-10T22:04:01.569 INFO:teuthology.orchestra.run.smithi189.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 289 kB/s | 215 kB 00:00 2024-09-10T22:04:01.581 INFO:teuthology.orchestra.run.smithi005.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 5.5 MB 00:00 2024-09-10T22:04:01.607 INFO:teuthology.orchestra.run.smithi005.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.1 MB/s | 161 kB 00:00 2024-09-10T22:04:01.626 INFO:teuthology.orchestra.run.smithi052.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 94 kB/s | 80 kB 00:00 2024-09-10T22:04:01.632 INFO:teuthology.orchestra.run.smithi005.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-10T22:04:01.657 INFO:teuthology.orchestra.run.smithi005.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.9 MB/s | 306 kB 00:00 2024-09-10T22:04:01.683 INFO:teuthology.orchestra.run.smithi005.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.9 MB/s | 99 kB 00:00 2024-09-10T22:04:01.708 INFO:teuthology.orchestra.run.smithi005.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-10T22:04:01.750 INFO:teuthology.orchestra.run.smithi005.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 4.0 MB/s | 171 kB 00:00 2024-09-10T22:04:01.803 INFO:teuthology.orchestra.run.smithi189.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 732 kB/s | 689 kB 00:00 2024-09-10T22:04:01.809 INFO:teuthology.orchestra.run.smithi005.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4854.g 588 kB/s | 34 kB 00:00 2024-09-10T22:04:01.876 INFO:teuthology.orchestra.run.smithi005.stdout:(29/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 17 MB/s | 3.2 MB 00:00 2024-09-10T22:04:01.901 INFO:teuthology.orchestra.run.smithi005.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.6 MB/s | 154 kB 00:00 2024-09-10T22:04:01.902 INFO:teuthology.orchestra.run.smithi052.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 234 kB/s | 191 kB 00:00 2024-09-10T22:04:02.077 INFO:teuthology.orchestra.run.smithi052.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 632 kB/s | 801 kB 00:01 2024-09-10T22:04:02.278 INFO:teuthology.orchestra.run.smithi189.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 151 kB/s | 107 kB 00:00 2024-09-10T22:04:02.353 INFO:teuthology.orchestra.run.smithi189.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 40 kB/s | 22 kB 00:00 2024-09-10T22:04:02.393 INFO:teuthology.orchestra.run.smithi005.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 15 MB/s | 7.4 MB 00:00 2024-09-10T22:04:02.503 INFO:teuthology.orchestra.run.smithi189.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 958 kB/s | 943 kB 00:00 2024-09-10T22:04:02.514 INFO:teuthology.orchestra.run.smithi052.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 285 kB/s | 253 kB 00:00 2024-09-10T22:04:02.551 INFO:teuthology.orchestra.run.smithi005.stdout:(32/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 21 MB/s | 14 MB 00:00 2024-09-10T22:04:02.577 INFO:teuthology.orchestra.run.smithi005.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 1.5 MB/s | 291 kB 00:00 2024-09-10T22:04:02.602 INFO:teuthology.orchestra.run.smithi005.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 982 kB/s | 49 kB 00:00 2024-09-10T22:04:02.627 INFO:teuthology.orchestra.run.smithi005.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 328 kB/s | 16 kB 00:00 2024-09-10T22:04:02.652 INFO:teuthology.orchestra.run.smithi005.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-10T22:04:02.686 INFO:teuthology.orchestra.run.smithi005.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 13 MB/s | 783 kB 00:00 2024-09-10T22:04:02.711 INFO:teuthology.orchestra.run.smithi005.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 312 kB/s | 18 kB 00:00 2024-09-10T22:04:02.761 INFO:teuthology.orchestra.run.smithi052.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-09-10T22:04:02.862 INFO:teuthology.orchestra.run.smithi005.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 455 kB/s | 80 kB 00:00 2024-09-10T22:04:02.920 INFO:teuthology.orchestra.run.smithi189.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2024-09-10T22:04:02.964 INFO:teuthology.orchestra.run.smithi005.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.8 MB/s | 191 kB 00:00 2024-09-10T22:04:02.986 INFO:teuthology.orchestra.run.smithi052.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.1 MB/s | 1.2 MB 00:01 2024-09-10T22:04:03.064 INFO:teuthology.orchestra.run.smithi005.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 801 kB 00:00 2024-09-10T22:04:03.078 INFO:teuthology.orchestra.run.smithi189.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 392 kB/s | 313 kB 00:00 2024-09-10T22:04:03.090 INFO:teuthology.orchestra.run.smithi005.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-10T22:04:03.148 INFO:teuthology.orchestra.run.smithi005.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T22:04:03.190 INFO:teuthology.orchestra.run.smithi005.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-10T22:04:03.215 INFO:teuthology.orchestra.run.smithi005.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-10T22:04:03.228 INFO:teuthology.orchestra.run.smithi052.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 189 kB/s | 135 kB 00:00 2024-09-10T22:04:03.282 INFO:teuthology.orchestra.run.smithi005.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-09-10T22:04:03.308 INFO:teuthology.orchestra.run.smithi005.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-09-10T22:04:03.391 INFO:teuthology.orchestra.run.smithi005.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 6.2 MB/s | 689 kB 00:00 2024-09-10T22:04:03.429 INFO:teuthology.orchestra.run.smithi189.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-10T22:04:03.437 INFO:teuthology.orchestra.run.smithi052.stdout:(47/157): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-10T22:04:03.512 INFO:teuthology.orchestra.run.smithi052.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-09-10T22:04:03.537 INFO:teuthology.orchestra.run.smithi052.stdout:(49/157): python3-requests-2.25.1-8.el9.noarch. 161 kB/s | 125 kB 00:00 2024-09-10T22:04:03.554 INFO:teuthology.orchestra.run.smithi189.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-10T22:04:03.570 INFO:teuthology.orchestra.run.smithi052.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.9 MB/s | 107 kB 00:00 2024-09-10T22:04:03.620 INFO:teuthology.orchestra.run.smithi052.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-10T22:04:03.645 INFO:teuthology.orchestra.run.smithi052.stdout:(52/157): elfutils-libelf-devel-0.191-4.el9.x86 202 kB/s | 22 kB 00:00 2024-09-10T22:04:03.670 INFO:teuthology.orchestra.run.smithi052.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-10T22:04:03.712 INFO:teuthology.orchestra.run.smithi052.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-10T22:04:03.754 INFO:teuthology.orchestra.run.smithi052.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-10T22:04:03.804 INFO:teuthology.orchestra.run.smithi052.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-10T22:04:03.830 INFO:teuthology.orchestra.run.smithi052.stdout:(57/157): python3-urllib3-1.26.5-6.el9.noarch.r 257 kB/s | 215 kB 00:00 2024-09-10T22:04:03.833 INFO:teuthology.orchestra.run.smithi005.stdout:(49/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 16 MB/s | 50 MB 00:03 2024-09-10T22:04:03.858 INFO:teuthology.orchestra.run.smithi005.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 229 kB/s | 107 kB 00:00 2024-09-10T22:04:03.863 INFO:teuthology.orchestra.run.smithi052.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-10T22:04:03.900 INFO:teuthology.orchestra.run.smithi005.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-09-10T22:04:03.904 INFO:teuthology.orchestra.run.smithi189.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.1 MB/s | 3.0 MB 00:01 2024-09-10T22:04:03.926 INFO:teuthology.orchestra.run.smithi005.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-10T22:04:03.930 INFO:teuthology.orchestra.run.smithi052.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-10T22:04:03.951 INFO:teuthology.orchestra.run.smithi005.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-10T22:04:03.955 INFO:teuthology.orchestra.run.smithi052.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-10T22:04:03.993 INFO:teuthology.orchestra.run.smithi005.stdout:(54/157): elfutils-libelf-devel-0.191-4.el9.x86 136 kB/s | 22 kB 00:00 2024-09-10T22:04:03.997 INFO:teuthology.orchestra.run.smithi052.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-10T22:04:04.018 INFO:teuthology.orchestra.run.smithi005.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-10T22:04:04.023 INFO:teuthology.orchestra.run.smithi052.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-10T22:04:04.040 INFO:teuthology.orchestra.run.smithi052.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 293 kB/s | 24 kB 00:00 2024-09-10T22:04:04.044 INFO:teuthology.orchestra.run.smithi005.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 221 kB/s | 11 kB 00:00 2024-09-10T22:04:04.065 INFO:teuthology.orchestra.run.smithi052.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-10T22:04:04.086 INFO:teuthology.orchestra.run.smithi005.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-10T22:04:04.090 INFO:teuthology.orchestra.run.smithi052.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-10T22:04:04.115 INFO:teuthology.orchestra.run.smithi052.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-10T22:04:04.136 INFO:teuthology.orchestra.run.smithi005.stdout:(58/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-10T22:04:04.140 INFO:teuthology.orchestra.run.smithi052.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T22:04:04.161 INFO:teuthology.orchestra.run.smithi005.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-09-10T22:04:04.213 INFO:teuthology.orchestra.run.smithi189.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 218 kB/s | 171 kB 00:00 2024-09-10T22:04:04.220 INFO:teuthology.orchestra.run.smithi005.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-09-10T22:04:04.241 INFO:teuthology.orchestra.run.smithi052.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-10T22:04:04.245 INFO:teuthology.orchestra.run.smithi005.stdout:(61/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 797 kB/s | 160 kB 00:00 2024-09-10T22:04:04.270 INFO:teuthology.orchestra.run.smithi005.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-10T22:04:04.296 INFO:teuthology.orchestra.run.smithi005.stdout:(63/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2024-09-10T22:04:04.308 INFO:teuthology.orchestra.run.smithi052.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-10T22:04:04.312 INFO:teuthology.orchestra.run.smithi005.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-09-10T22:04:04.338 INFO:teuthology.orchestra.run.smithi005.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-10T22:04:04.338 INFO:teuthology.orchestra.run.smithi189.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 204 kB/s | 160 kB 00:00 2024-09-10T22:04:04.341 INFO:teuthology.orchestra.run.smithi052.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-10T22:04:04.363 INFO:teuthology.orchestra.run.smithi005.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-10T22:04:04.367 INFO:teuthology.orchestra.run.smithi052.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T22:04:04.388 INFO:teuthology.orchestra.run.smithi005.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-10T22:04:04.400 INFO:teuthology.orchestra.run.smithi052.stdout:(72/157): postgresql-13.16-1.el9.x86_64.rpm 6.1 MB/s | 1.6 MB 00:00 2024-09-10T22:04:04.434 INFO:teuthology.orchestra.run.smithi052.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-10T22:04:04.459 INFO:teuthology.orchestra.run.smithi052.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-10T22:04:04.510 INFO:teuthology.orchestra.run.smithi052.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-10T22:04:04.530 INFO:teuthology.orchestra.run.smithi189.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-09-10T22:04:04.564 INFO:teuthology.orchestra.run.smithi005.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 22 MB/s | 4.9 MB 00:00 2024-09-10T22:04:04.584 INFO:teuthology.orchestra.run.smithi052.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-09-10T22:04:04.610 INFO:teuthology.orchestra.run.smithi052.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-10T22:04:04.644 INFO:teuthology.orchestra.run.smithi052.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-10T22:04:04.656 INFO:teuthology.orchestra.run.smithi005.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-10T22:04:04.669 INFO:teuthology.orchestra.run.smithi052.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-09-10T22:04:04.689 INFO:teuthology.orchestra.run.smithi005.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-10T22:04:04.694 INFO:teuthology.orchestra.run.smithi052.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-10T22:04:04.723 INFO:teuthology.orchestra.run.smithi005.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-10T22:04:04.765 INFO:teuthology.orchestra.run.smithi005.stdout:(72/157): postgresql-13.16-1.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2024-09-10T22:04:04.770 INFO:teuthology.orchestra.run.smithi052.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-10T22:04:04.795 INFO:teuthology.orchestra.run.smithi052.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-10T22:04:04.815 INFO:teuthology.orchestra.run.smithi005.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-10T22:04:04.820 INFO:teuthology.orchestra.run.smithi052.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-10T22:04:04.840 INFO:teuthology.orchestra.run.smithi005.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-09-10T22:04:04.845 INFO:teuthology.orchestra.run.smithi052.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-10T22:04:04.879 INFO:teuthology.orchestra.run.smithi052.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-10T22:04:04.904 INFO:teuthology.orchestra.run.smithi052.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T22:04:04.924 INFO:teuthology.orchestra.run.smithi005.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-10T22:04:04.929 INFO:teuthology.orchestra.run.smithi052.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-10T22:04:04.949 INFO:teuthology.orchestra.run.smithi005.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 563 kB/s | 61 kB 00:00 2024-09-10T22:04:04.955 INFO:teuthology.orchestra.run.smithi052.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-10T22:04:04.988 INFO:teuthology.orchestra.run.smithi052.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T22:04:05.000 INFO:teuthology.orchestra.run.smithi005.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-09-10T22:04:05.055 INFO:teuthology.orchestra.run.smithi052.stdout:(90/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-10T22:04:05.058 INFO:teuthology.orchestra.run.smithi005.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-10T22:04:05.081 INFO:teuthology.orchestra.run.smithi052.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 556 kB/s | 51 kB 00:00 2024-09-10T22:04:05.105 INFO:teuthology.orchestra.run.smithi189.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 43 kB/s | 24 kB 00:00 2024-09-10T22:04:05.106 INFO:teuthology.orchestra.run.smithi052.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T22:04:05.108 INFO:teuthology.orchestra.run.smithi005.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-09-10T22:04:05.131 INFO:teuthology.orchestra.run.smithi052.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-09-10T22:04:05.134 INFO:teuthology.orchestra.run.smithi005.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 254 kB/s | 19 kB 00:00 2024-09-10T22:04:05.156 INFO:teuthology.orchestra.run.smithi052.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-09-10T22:04:05.181 INFO:teuthology.orchestra.run.smithi052.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-09-10T22:04:05.207 INFO:teuthology.orchestra.run.smithi052.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T22:04:05.209 INFO:teuthology.orchestra.run.smithi005.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-10T22:04:05.232 INFO:teuthology.orchestra.run.smithi052.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-10T22:04:05.234 INFO:teuthology.orchestra.run.smithi005.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 347 kB/s | 35 kB 00:00 2024-09-10T22:04:05.257 INFO:teuthology.orchestra.run.smithi052.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-10T22:04:05.260 INFO:teuthology.orchestra.run.smithi005.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-10T22:04:05.283 INFO:teuthology.orchestra.run.smithi052.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-10T22:04:05.301 INFO:teuthology.orchestra.run.smithi005.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-10T22:04:05.308 INFO:teuthology.orchestra.run.smithi052.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-10T22:04:05.333 INFO:teuthology.orchestra.run.smithi052.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-10T22:04:05.358 INFO:teuthology.orchestra.run.smithi052.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-10T22:04:05.360 INFO:teuthology.orchestra.run.smithi005.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-10T22:04:05.384 INFO:teuthology.orchestra.run.smithi052.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-10T22:04:05.427 INFO:teuthology.orchestra.run.smithi005.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 633 kB/s | 42 kB 00:00 2024-09-10T22:04:05.452 INFO:teuthology.orchestra.run.smithi005.stdout:(87/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 222 kB 00:00 2024-09-10T22:04:05.459 INFO:teuthology.orchestra.run.smithi052.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2024-09-10T22:04:05.528 INFO:teuthology.orchestra.run.smithi005.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-09-10T22:04:05.543 INFO:teuthology.orchestra.run.smithi052.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.5 MB/s | 548 kB 00:00 2024-09-10T22:04:05.553 INFO:teuthology.orchestra.run.smithi005.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-10T22:04:05.563 INFO:teuthology.orchestra.run.smithi189.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 474 kB/s | 581 kB 00:01 2024-09-10T22:04:05.576 INFO:teuthology.orchestra.run.smithi052.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-10T22:04:05.578 INFO:teuthology.orchestra.run.smithi005.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-10T22:04:05.597 INFO:teuthology.orchestra.run.smithi189.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 479 kB/s | 662 kB 00:01 2024-09-10T22:04:05.603 INFO:teuthology.orchestra.run.smithi005.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-10T22:04:05.610 INFO:teuthology.orchestra.run.smithi052.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-10T22:04:05.629 INFO:teuthology.orchestra.run.smithi005.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-09-10T22:04:05.643 INFO:teuthology.orchestra.run.smithi052.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 291 kB/s | 19 kB 00:00 2024-09-10T22:04:05.654 INFO:teuthology.orchestra.run.smithi005.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 712 kB/s | 54 kB 00:00 2024-09-10T22:04:05.669 INFO:teuthology.orchestra.run.smithi052.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T22:04:05.681 INFO:teuthology.orchestra.run.smithi189.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-10T22:04:05.694 INFO:teuthology.orchestra.run.smithi052.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T22:04:05.696 INFO:teuthology.orchestra.run.smithi005.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 623 kB/s | 42 kB 00:00 2024-09-10T22:04:05.719 INFO:teuthology.orchestra.run.smithi052.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-10T22:04:05.738 INFO:teuthology.orchestra.run.smithi005.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 528 kB/s | 44 kB 00:00 2024-09-10T22:04:05.761 INFO:teuthology.orchestra.run.smithi052.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-10T22:04:05.805 INFO:teuthology.orchestra.run.smithi005.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 539 kB/s | 36 kB 00:00 2024-09-10T22:04:05.864 INFO:teuthology.orchestra.run.smithi005.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.3 MB/s | 221 kB 00:00 2024-09-10T22:04:05.878 INFO:teuthology.orchestra.run.smithi052.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-10T22:04:05.889 INFO:teuthology.orchestra.run.smithi005.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-10T22:04:05.956 INFO:teuthology.orchestra.run.smithi005.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 869 kB/s | 58 kB 00:00 2024-09-10T22:04:06.014 INFO:teuthology.orchestra.run.smithi005.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-10T22:04:06.045 INFO:teuthology.orchestra.run.smithi052.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-10T22:04:06.073 INFO:teuthology.orchestra.run.smithi005.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-10T22:04:06.087 INFO:teuthology.orchestra.run.smithi052.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-10T22:04:06.098 INFO:teuthology.orchestra.run.smithi005.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-09-10T22:04:06.121 INFO:teuthology.orchestra.run.smithi052.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-09-10T22:04:06.132 INFO:teuthology.orchestra.run.smithi005.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-10T22:04:06.137 INFO:teuthology.orchestra.run.smithi052.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T22:04:06.154 INFO:teuthology.orchestra.run.smithi052.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 424 kB/s | 14 kB 00:00 2024-09-10T22:04:06.180 INFO:teuthology.orchestra.run.smithi052.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-10T22:04:06.205 INFO:teuthology.orchestra.run.smithi052.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T22:04:06.248 INFO:teuthology.orchestra.run.smithi189.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-10T22:04:06.272 INFO:teuthology.orchestra.run.smithi052.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-10T22:04:06.297 INFO:teuthology.orchestra.run.smithi052.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-09-10T22:04:06.331 INFO:teuthology.orchestra.run.smithi052.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.7 MB/s | 220 kB 00:00 2024-09-10T22:04:06.385 INFO:teuthology.orchestra.run.smithi052.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 198 kB/s | 11 kB 00:00 2024-09-10T22:04:06.398 INFO:teuthology.orchestra.run.smithi189.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 235 kB/s | 188 kB 00:00 2024-09-10T22:04:06.415 INFO:teuthology.orchestra.run.smithi052.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-09-10T22:04:06.440 INFO:teuthology.orchestra.run.smithi052.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 324 kB/s | 18 kB 00:00 2024-09-10T22:04:06.465 INFO:teuthology.orchestra.run.smithi052.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-10T22:04:06.491 INFO:teuthology.orchestra.run.smithi052.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-10T22:04:06.499 INFO:teuthology.orchestra.run.smithi005.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-10T22:04:06.516 INFO:teuthology.orchestra.run.smithi052.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-10T22:04:06.524 INFO:teuthology.orchestra.run.smithi005.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 52 kB/s | 22 kB 00:00 2024-09-10T22:04:06.541 INFO:teuthology.orchestra.run.smithi052.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T22:04:06.575 INFO:teuthology.orchestra.run.smithi052.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T22:04:06.591 INFO:teuthology.orchestra.run.smithi005.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-10T22:04:06.598 INFO:teuthology.orchestra.run.smithi189.stdout:(67/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 283 kB/s | 292 kB 00:01 2024-09-10T22:04:06.600 INFO:teuthology.orchestra.run.smithi052.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T22:04:06.617 INFO:teuthology.orchestra.run.smithi005.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-10T22:04:06.634 INFO:teuthology.orchestra.run.smithi052.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-10T22:04:06.642 INFO:teuthology.orchestra.run.smithi005.stdout:(108/157): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-09-10T22:04:06.659 INFO:teuthology.orchestra.run.smithi052.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-10T22:04:06.667 INFO:teuthology.orchestra.run.smithi005.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-10T22:04:06.692 INFO:teuthology.orchestra.run.smithi005.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-10T22:04:06.693 INFO:teuthology.orchestra.run.smithi052.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T22:04:06.718 INFO:teuthology.orchestra.run.smithi052.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-10T22:04:06.726 INFO:teuthology.orchestra.run.smithi005.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T22:04:06.743 INFO:teuthology.orchestra.run.smithi052.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T22:04:06.759 INFO:teuthology.orchestra.run.smithi005.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T22:04:06.768 INFO:teuthology.orchestra.run.smithi052.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-10T22:04:06.811 INFO:teuthology.orchestra.run.smithi052.stdout:(139/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-09-10T22:04:06.836 INFO:teuthology.orchestra.run.smithi052.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 880 kB/s | 59 kB 00:00 2024-09-10T22:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-10T22:04:06.861 INFO:teuthology.orchestra.run.smithi052.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-10T22:04:06.886 INFO:teuthology.orchestra.run.smithi052.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-09-10T22:04:06.910 INFO:teuthology.orchestra.run.smithi005.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 8.1 MB/s | 548 kB 00:00 2024-09-10T22:04:06.912 INFO:teuthology.orchestra.run.smithi052.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-10T22:04:06.927 INFO:teuthology.orchestra.run.smithi005.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-10T22:04:06.937 INFO:teuthology.orchestra.run.smithi052.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T22:04:06.944 INFO:teuthology.orchestra.run.smithi005.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-10T22:04:06.962 INFO:teuthology.orchestra.run.smithi052.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T22:04:06.987 INFO:teuthology.orchestra.run.smithi052.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-10T22:04:07.011 INFO:teuthology.orchestra.run.smithi005.stdout:(117/157): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-10T22:04:07.013 INFO:teuthology.orchestra.run.smithi052.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T22:04:07.036 INFO:teuthology.orchestra.run.smithi005.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 153 kB/s | 14 kB 00:00 2024-09-10T22:04:07.046 INFO:teuthology.orchestra.run.smithi052.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T22:04:07.053 INFO:teuthology.orchestra.run.smithi005.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-10T22:04:07.087 INFO:teuthology.orchestra.run.smithi005.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-10T22:04:07.112 INFO:teuthology.orchestra.run.smithi005.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-10T22:04:07.145 INFO:teuthology.orchestra.run.smithi005.stdout:(122/157): protobuf-compiler-3.14.0-13.el9.x86_ 852 kB/s | 863 kB 00:01 2024-09-10T22:04:07.171 INFO:teuthology.orchestra.run.smithi005.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-10T22:04:07.196 INFO:teuthology.orchestra.run.smithi052.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-10T22:04:07.204 INFO:teuthology.orchestra.run.smithi005.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 422 kB/s | 11 kB 00:00 2024-09-10T22:04:07.230 INFO:teuthology.orchestra.run.smithi005.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 773 kB/s | 18 kB 00:00 2024-09-10T22:04:07.255 INFO:teuthology.orchestra.run.smithi005.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 928 kB/s | 23 kB 00:00 2024-09-10T22:04:07.272 INFO:teuthology.orchestra.run.smithi005.stdout:(127/157): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-09-10T22:04:07.298 INFO:teuthology.orchestra.run.smithi005.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2024-09-10T22:04:07.323 INFO:teuthology.orchestra.run.smithi005.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-10T22:04:07.330 INFO:teuthology.orchestra.run.smithi052.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-10T22:04:07.348 INFO:teuthology.orchestra.run.smithi005.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T22:04:07.373 INFO:teuthology.orchestra.run.smithi005.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-10T22:04:07.389 INFO:teuthology.orchestra.run.smithi052.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.2 MB/s | 3.5 MB 00:00 2024-09-10T22:04:07.398 INFO:teuthology.orchestra.run.smithi005.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T22:04:07.466 INFO:teuthology.orchestra.run.smithi005.stdout:(133/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-10T22:04:07.491 INFO:teuthology.orchestra.run.smithi005.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T22:04:07.516 INFO:teuthology.orchestra.run.smithi005.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-10T22:04:07.550 INFO:teuthology.orchestra.run.smithi005.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.1 MB/s | 1.0 MB 00:00 2024-09-10T22:04:07.575 INFO:teuthology.orchestra.run.smithi005.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-10T22:04:07.600 INFO:teuthology.orchestra.run.smithi005.stdout:(138/157): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-09-10T22:04:07.626 INFO:teuthology.orchestra.run.smithi005.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-09-10T22:04:07.651 INFO:teuthology.orchestra.run.smithi005.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-10T22:04:07.676 INFO:teuthology.orchestra.run.smithi005.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-10T22:04:07.701 INFO:teuthology.orchestra.run.smithi005.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-10T22:04:07.727 INFO:teuthology.orchestra.run.smithi005.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-10T22:04:07.752 INFO:teuthology.orchestra.run.smithi005.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T22:04:07.777 INFO:teuthology.orchestra.run.smithi005.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T22:04:07.794 INFO:teuthology.orchestra.run.smithi005.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-10T22:04:07.820 INFO:teuthology.orchestra.run.smithi005.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-10T22:04:07.845 INFO:teuthology.orchestra.run.smithi005.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-10T22:04:07.903 INFO:teuthology.orchestra.run.smithi005.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T22:04:07.915 INFO:teuthology.orchestra.run.smithi189.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.0 MB/s | 4.9 MB 00:01 2024-09-10T22:04:07.964 INFO:teuthology.orchestra.run.smithi052.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 71 kB/s | 41 kB 00:00 2024-09-10T22:04:08.095 INFO:teuthology.orchestra.run.smithi005.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 3.5 MB 00:00 2024-09-10T22:04:08.187 INFO:teuthology.orchestra.run.smithi005.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 9.5 MB/s | 3.2 MB 00:00 2024-09-10T22:04:08.254 INFO:teuthology.orchestra.run.smithi005.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 6.6 MB/s | 2.3 MB 00:00 2024-09-10T22:04:08.296 INFO:teuthology.orchestra.run.smithi005.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 376 kB/s | 41 kB 00:00 2024-09-10T22:04:08.321 INFO:teuthology.orchestra.run.smithi005.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-10T22:04:08.464 INFO:teuthology.orchestra.run.smithi005.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 4.9 MB/s | 1.8 MB 00:00 2024-09-10T22:04:08.505 INFO:teuthology.orchestra.run.smithi005.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-10T22:04:08.655 INFO:teuthology.orchestra.run.smithi005.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 3.8 MB/s | 1.4 MB 00:00 2024-09-10T22:04:08.661 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:04:08.662 INFO:teuthology.orchestra.run.smithi005.stdout:Total 21 MB/s | 240 MB 00:11 2024-09-10T22:04:08.781 INFO:teuthology.orchestra.run.smithi052.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 305 kB/s | 249 kB 00:00 2024-09-10T22:04:08.832 INFO:teuthology.orchestra.run.smithi189.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 727 kB/s | 1.6 MB 00:02 2024-09-10T22:04:08.874 INFO:teuthology.orchestra.run.smithi189.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 950 kB/s | 910 kB 00:00 2024-09-10T22:04:08.948 INFO:teuthology.orchestra.run.smithi052.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 1.1 MB/s | 1.8 MB 00:01 2024-09-10T22:04:09.557 INFO:teuthology.orchestra.run.smithi189.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 189 kB/s | 137 kB 00:00 2024-09-10T22:04:09.831 INFO:teuthology.orchestra.run.smithi052.stdout:(155/157): NetworkManager-1.49.90-1.el9.x86_64. 901 kB/s | 2.3 MB 00:02 2024-09-10T22:04:09.943 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-10T22:04:10.115 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-10T22:04:10.115 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-10T22:04:10.931 INFO:teuthology.orchestra.run.smithi052.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 645 kB/s | 1.4 MB 00:02 2024-09-10T22:04:10.941 INFO:teuthology.orchestra.run.smithi189.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 747 kB/s | 1.0 MB 00:01 2024-09-10T22:04:11.016 INFO:teuthology.orchestra.run.smithi189.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 981 kB/s | 4.4 MB 00:04 2024-09-10T22:04:11.056 INFO:teuthology.orchestra.run.smithi052.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 2.4 MB 00:02 2024-09-10T22:04:11.063 INFO:teuthology.orchestra.run.smithi052.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:04:11.063 INFO:teuthology.orchestra.run.smithi052.stdout:Total 15 MB/s | 240 MB 00:16 2024-09-10T22:04:11.191 INFO:teuthology.orchestra.run.smithi189.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 2.5 MB/s | 5.8 MB 00:02 2024-09-10T22:04:11.625 INFO:teuthology.orchestra.run.smithi189.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 128 kB/s | 87 kB 00:00 2024-09-10T22:04:11.808 INFO:teuthology.orchestra.run.smithi189.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 101 kB/s | 61 kB 00:00 2024-09-10T22:04:12.308 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction check 2024-09-10T22:04:12.392 INFO:teuthology.orchestra.run.smithi189.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.3 MB/s | 6.0 MB 00:01 2024-09-10T22:04:12.477 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction check succeeded. 2024-09-10T22:04:12.477 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction test 2024-09-10T22:04:12.485 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-10T22:04:12.487 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-10T22:04:12.534 INFO:teuthology.orchestra.run.smithi189.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 269 kB/s | 245 kB 00:00 2024-09-10T22:04:12.684 INFO:teuthology.orchestra.run.smithi189.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 283 kB/s | 248 kB 00:00 2024-09-10T22:04:12.976 INFO:teuthology.orchestra.run.smithi189.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-09-10T22:04:13.159 INFO:teuthology.orchestra.run.smithi189.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 31 kB/s | 19 kB 00:00 2024-09-10T22:04:13.543 INFO:teuthology.orchestra.run.smithi189.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 201 kB/s | 172 kB 00:00 2024-09-10T22:04:13.652 INFO:teuthology.orchestra.run.smithi189.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 51 kB/s | 35 kB 00:00 2024-09-10T22:04:14.410 INFO:teuthology.orchestra.run.smithi189.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 289 kB/s | 250 kB 00:00 2024-09-10T22:04:14.466 INFO:teuthology.orchestra.run.smithi052.stdout:Transaction test succeeded. 2024-09-10T22:04:14.467 INFO:teuthology.orchestra.run.smithi052.stdout:Running transaction 2024-09-10T22:04:14.535 INFO:teuthology.orchestra.run.smithi189.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 252 kB/s | 222 kB 00:00 2024-09-10T22:04:15.069 INFO:teuthology.orchestra.run.smithi189.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 117 kB/s | 77 kB 00:00 2024-09-10T22:04:15.111 INFO:teuthology.orchestra.run.smithi189.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 73 kB/s | 42 kB 00:00 2024-09-10T22:04:15.953 INFO:teuthology.orchestra.run.smithi189.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 189 kB/s | 159 kB 00:00 2024-09-10T22:04:15.978 INFO:teuthology.orchestra.run.smithi189.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 297 kB/s | 269 kB 00:00 2024-09-10T22:04:16.578 INFO:teuthology.orchestra.run.smithi189.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 85 kB/s | 51 kB 00:00 2024-09-10T22:04:16.853 INFO:teuthology.orchestra.run.smithi189.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 310 kB/s | 279 kB 00:00 2024-09-10T22:04:17.211 INFO:teuthology.orchestra.run.smithi189.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 85 kB/s | 54 kB 00:00 2024-09-10T22:04:17.803 INFO:teuthology.orchestra.run.smithi189.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 70 kB/s | 42 kB 00:00 2024-09-10T22:04:18.345 INFO:teuthology.orchestra.run.smithi189.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:05 2024-09-10T22:04:18.662 INFO:teuthology.orchestra.run.smithi189.stdout:(95/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-10T22:04:18.695 INFO:teuthology.orchestra.run.smithi189.stdout:(96/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 49 kB/s | 44 kB 00:00 2024-09-10T22:04:19.168 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-10T22:04:19.252 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T22:04:19.271 INFO:teuthology.orchestra.run.smithi189.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 60 kB/s | 36 kB 00:00 2024-09-10T22:04:19.296 INFO:teuthology.orchestra.run.smithi189.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 79 kB/s | 47 kB 00:00 2024-09-10T22:04:19.307 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T22:04:19.321 INFO:teuthology.orchestra.run.smithi189.stdout:(99/157): qatlib-24.02.0-1.el9.x86_64.rpm 226 kB/s | 221 kB 00:00 2024-09-10T22:04:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T22:04:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T22:04:19.436 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T22:04:19.486 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T22:04:19.840 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T22:04:19.921 INFO:teuthology.orchestra.run.smithi189.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 92 kB/s | 58 kB 00:00 2024-09-10T22:04:19.953 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:04:19.997 INFO:teuthology.orchestra.run.smithi189.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-09-10T22:04:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:04:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:04:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:04:20.230 INFO:teuthology.orchestra.run.smithi189.stdout:(102/157): socat-1.7.4.1-6.el9.x86_64.rpm 317 kB/s | 304 kB 00:00 2024-09-10T22:04:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T22:04:20.322 INFO:teuthology.orchestra.run.smithi189.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-09-10T22:04:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T22:04:20.456 INFO:teuthology.orchestra.run.smithi189.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 6.4 MB/s | 863 kB 00:00 2024-09-10T22:04:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T22:04:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:04:20.548 INFO:teuthology.orchestra.run.smithi189.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 5.9 MB/s | 548 kB 00:00 2024-09-10T22:04:20.581 INFO:teuthology.orchestra.run.smithi189.stdout:(106/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 97 kB/s | 64 kB 00:00 2024-09-10T22:04:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:04:20.614 INFO:teuthology.orchestra.run.smithi189.stdout:(107/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-09-10T22:04:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:04:20.640 INFO:teuthology.orchestra.run.smithi189.stdout:(108/157): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-09-10T22:04:20.674 INFO:teuthology.orchestra.run.smithi189.stdout:(109/157): grpc-data-1.46.7-10.el9.noarch.rpm 211 kB/s | 19 kB 00:00 2024-09-10T22:04:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:04:20.699 INFO:teuthology.orchestra.run.smithi189.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 507 kB/s | 26 kB 00:00 2024-09-10T22:04:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:04:20.724 INFO:teuthology.orchestra.run.smithi189.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2024-09-10T22:04:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:04:20.749 INFO:teuthology.orchestra.run.smithi189.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T22:04:20.783 INFO:teuthology.orchestra.run.smithi189.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-10T22:04:20.867 INFO:teuthology.orchestra.run.smithi189.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 6.5 MB/s | 548 kB 00:00 2024-09-10T22:04:20.908 INFO:teuthology.orchestra.run.smithi189.stdout:(115/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.2 MB/s | 839 kB 00:00 2024-09-10T22:04:20.934 INFO:teuthology.orchestra.run.smithi189.stdout:(116/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 651 kB/s | 43 kB 00:00 2024-09-10T22:04:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:04:20.959 INFO:teuthology.orchestra.run.smithi189.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-10T22:04:20.984 INFO:teuthology.orchestra.run.smithi189.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-10T22:04:21.018 INFO:teuthology.orchestra.run.smithi189.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T22:04:21.060 INFO:teuthology.orchestra.run.smithi189.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-09-10T22:04:21.085 INFO:teuthology.orchestra.run.smithi189.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T22:04:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:04:21.118 INFO:teuthology.orchestra.run.smithi189.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T22:04:21.152 INFO:teuthology.orchestra.run.smithi189.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-10T22:04:21.169 INFO:teuthology.orchestra.run.smithi189.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 643 kB/s | 11 kB 00:00 2024-09-10T22:04:21.186 INFO:teuthology.orchestra.run.smithi052.stdout: Preparing : 1/1 2024-09-10T22:04:21.194 INFO:teuthology.orchestra.run.smithi189.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-10T22:04:21.220 INFO:teuthology.orchestra.run.smithi189.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-10T22:04:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T22:04:21.245 INFO:teuthology.orchestra.run.smithi189.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 782 kB/s | 19 kB 00:00 2024-09-10T22:04:21.310 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T22:04:21.312 INFO:teuthology.orchestra.run.smithi189.stdout:(128/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.3 MB/s | 4.4 MB 00:00 2024-09-10T22:04:21.337 INFO:teuthology.orchestra.run.smithi189.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-09-10T22:04:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:21.349 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T22:04:21.364 INFO:teuthology.orchestra.run.smithi189.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T22:04:21.379 INFO:teuthology.orchestra.run.smithi189.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-10T22:04:21.403 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T22:04:21.429 INFO:teuthology.orchestra.run.smithi189.stdout:(132/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-09-10T22:04:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:21.445 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T22:04:21.455 INFO:teuthology.orchestra.run.smithi189.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 768 kB/s | 58 kB 00:00 2024-09-10T22:04:21.470 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T22:04:21.480 INFO:teuthology.orchestra.run.smithi189.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-10T22:04:21.505 INFO:teuthology.orchestra.run.smithi189.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-10T22:04:21.514 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T22:04:21.531 INFO:teuthology.orchestra.run.smithi189.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T22:04:21.556 INFO:teuthology.orchestra.run.smithi189.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-10T22:04:21.581 INFO:teuthology.orchestra.run.smithi189.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T22:04:21.615 INFO:teuthology.orchestra.run.smithi189.stdout:(139/157): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-09-10T22:04:21.640 INFO:teuthology.orchestra.run.smithi189.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-10T22:04:21.661 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:21.665 INFO:teuthology.orchestra.run.smithi189.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 705 kB/s | 59 kB 00:00 2024-09-10T22:04:21.691 INFO:teuthology.orchestra.run.smithi189.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 476 kB/s | 36 kB 00:00 2024-09-10T22:04:21.716 INFO:teuthology.orchestra.run.smithi189.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-10T22:04:21.741 INFO:teuthology.orchestra.run.smithi189.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-10T22:04:21.767 INFO:teuthology.orchestra.run.smithi189.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 805 kB/s | 20 kB 00:00 2024-09-10T22:04:21.775 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T22:04:21.791 INFO:teuthology.orchestra.run.smithi189.stdout:(146/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-10T22:04:21.802 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T22:04:21.817 INFO:teuthology.orchestra.run.smithi189.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T22:04:21.838 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T22:04:21.842 INFO:teuthology.orchestra.run.smithi189.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-10T22:04:21.865 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T22:04:21.901 INFO:teuthology.orchestra.run.smithi189.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-10T22:04:21.914 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T22:04:21.965 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T22:04:21.980 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:04:21.995 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T22:04:22.039 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T22:04:22.072 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T22:04:22.084 INFO:teuthology.orchestra.run.smithi189.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 3.5 MB 00:00 2024-09-10T22:04:22.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T22:04:22.104 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:04:22.147 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:04:22.168 INFO:teuthology.orchestra.run.smithi189.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-10T22:04:22.170 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T22:04:22.222 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T22:04:22.239 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:04:22.252 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T22:04:22.276 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:04:22.296 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T22:04:22.306 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T22:04:22.375 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T22:04:22.406 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T22:04:22.441 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T22:04:22.469 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T22:04:22.470 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T22:04:22.533 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T22:04:22.544 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T22:04:22.560 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:04:22.596 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T22:04:22.649 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:04:22.671 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T22:04:22.677 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:04:22.740 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:04:22.760 INFO:teuthology.orchestra.run.smithi189.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 70 kB/s | 41 kB 00:00 2024-09-10T22:04:22.761 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:04:22.787 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:04:22.816 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T22:04:22.872 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T22:04:22.947 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:04:23.035 INFO:teuthology.orchestra.run.smithi189.stdout:(153/157): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-10T22:04:23.095 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:04:23.226 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T22:04:23.227 INFO:teuthology.orchestra.run.smithi189.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 1.6 MB/s | 1.8 MB 00:01 2024-09-10T22:04:23.320 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:23.386 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:23.430 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T22:04:23.519 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T22:04:23.553 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T22:04:23.569 INFO:teuthology.orchestra.run.smithi189.stdout:(155/157): NetworkManager-tui-1.49.90-1.el9.x86 308 kB/s | 249 kB 00:00 2024-09-10T22:04:23.596 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T22:04:23.619 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:23.635 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T22:04:23.677 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T22:04:23.739 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T22:04:23.774 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T22:04:23.809 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T22:04:23.837 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T22:04:23.884 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T22:04:23.895 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T22:04:23.935 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T22:04:23.975 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T22:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T22:04:24.018 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T22:04:24.051 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T22:04:24.053 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T22:04:24.078 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T22:04:24.127 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T22:04:24.157 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T22:04:24.164 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T22:04:24.201 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T22:04:24.214 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T22:04:24.227 INFO:teuthology.orchestra.run.smithi189.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 1.4 MB 00:01 2024-09-10T22:04:24.242 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T22:04:24.248 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T22:04:24.283 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T22:04:24.286 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T22:04:24.327 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T22:04:24.369 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T22:04:24.373 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T22:04:24.405 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T22:04:24.449 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T22:04:24.477 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T22:04:24.503 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T22:04:24.545 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T22:04:24.551 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T22:04:24.587 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T22:04:24.592 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T22:04:24.644 INFO:teuthology.orchestra.run.smithi189.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 2.4 MB 00:01 2024-09-10T22:04:24.652 INFO:teuthology.orchestra.run.smithi189.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:04:24.652 INFO:teuthology.orchestra.run.smithi189.stdout:Total 7.8 MB/s | 240 MB 00:30 2024-09-10T22:04:24.677 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T22:04:24.694 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T22:04:24.832 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T22:04:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T22:04:24.895 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T22:04:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T22:04:24.952 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T22:04:24.977 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T22:04:25.075 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T22:04:25.209 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T22:04:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T22:04:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T22:04:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T22:04:25.370 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T22:04:25.409 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T22:04:25.439 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T22:04:25.470 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T22:04:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T22:04:25.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T22:04:25.549 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T22:04:25.552 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T22:04:25.583 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T22:04:25.585 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T22:04:25.637 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T22:04:25.665 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T22:04:25.683 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T22:04:25.714 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T22:04:25.729 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T22:04:25.745 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T22:04:25.852 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T22:04:25.888 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T22:04:25.910 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction check 2024-09-10T22:04:25.913 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T22:04:25.944 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T22:04:26.041 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T22:04:26.066 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction check succeeded. 2024-09-10T22:04:26.066 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction test 2024-09-10T22:04:26.113 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T22:04:26.185 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T22:04:26.229 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T22:04:26.265 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T22:04:26.321 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T22:04:26.355 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T22:04:26.399 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T22:04:26.441 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T22:04:26.584 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T22:04:26.684 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T22:04:26.734 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T22:04:26.763 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T22:04:26.817 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T22:04:26.868 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T22:04:26.868 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T22:04:26.928 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T22:04:26.973 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T22:04:26.978 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T22:04:27.017 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T22:04:27.057 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T22:04:27.063 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T22:04:27.090 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T22:04:27.100 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T22:04:27.115 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T22:04:27.194 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T22:04:27.281 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T22:04:27.305 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T22:04:27.322 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T22:04:27.363 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T22:04:27.385 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T22:04:27.392 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T22:04:27.426 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T22:04:27.474 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T22:04:27.514 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T22:04:27.543 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T22:04:27.578 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T22:04:27.611 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T22:04:27.653 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T22:04:27.687 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T22:04:27.777 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T22:04:27.827 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T22:04:27.865 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T22:04:27.968 INFO:teuthology.orchestra.run.smithi189.stdout:Transaction test succeeded. 2024-09-10T22:04:27.968 INFO:teuthology.orchestra.run.smithi189.stdout:Running transaction 2024-09-10T22:04:27.974 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T22:04:28.026 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T22:04:28.070 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T22:04:28.192 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T22:04:28.801 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T22:04:28.855 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T22:04:28.897 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T22:04:29.013 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T22:04:29.061 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T22:04:29.107 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T22:04:29.199 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T22:04:29.233 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T22:04:29.440 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T22:04:29.480 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T22:04:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T22:04:29.562 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T22:04:29.605 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T22:04:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T22:04:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T22:04:30.013 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T22:04:30.054 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:04:30.162 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:04:30.191 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T22:04:30.228 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T22:04:30.261 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T22:04:30.385 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T22:04:30.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T22:04:30.773 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:04:30.828 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:04:30.858 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T22:04:31.706 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T22:04:31.777 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T22:04:31.806 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T22:04:31.838 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T22:04:32.176 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T22:04:32.217 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:04:32.301 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:04:32.330 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T22:04:32.367 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T22:04:32.887 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T22:04:32.920 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:04:32.999 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:04:33.030 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T22:04:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:33.371 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:33.973 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:34.016 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:04:34.111 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:04:34.112 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:04:34.112 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:04:34.112 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:04:34.333 INFO:teuthology.orchestra.run.smithi189.stdout: Preparing : 1/1 2024-09-10T22:04:34.456 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-10T22:04:34.494 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-10T22:04:34.547 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-10T22:04:34.590 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-10T22:04:34.615 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-10T22:04:34.658 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-10T22:04:34.993 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-10T22:04:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:04:35.222 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:04:35.259 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:04:35.349 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:04:35.380 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:04:35.408 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:35.409 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-10T22:04:35.443 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:35.561 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-10T22:04:35.619 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-10T22:04:35.647 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:04:35.743 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:04:35.773 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:04:35.827 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-10T22:04:35.849 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:04:35.868 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-10T22:04:36.025 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:36.025 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:04:36.071 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:04:36.164 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-10T22:04:36.169 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:04:36.169 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:04:36.169 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:04:36.169 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:36.206 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:04:36.272 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-10T22:04:36.372 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:36.456 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:36.675 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-10T22:04:36.795 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-10T22:04:36.827 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-10T22:04:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-10T22:04:36.935 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-10T22:04:36.979 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-10T22:04:37.011 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-10T22:04:37.055 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-10T22:04:37.087 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-10T22:04:37.115 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-10T22:04:37.183 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-10T22:04:37.237 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-10T22:04:37.267 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-10T22:04:37.303 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-10T22:04:37.380 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-10T22:04:37.422 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-10T22:04:37.465 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-10T22:04:37.494 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-10T22:04:37.563 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-10T22:04:37.609 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-10T22:04:37.682 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-10T22:04:37.816 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-10T22:04:37.869 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-10T22:04:38.387 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-10T22:04:38.464 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-10T22:04:38.493 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-10T22:04:38.536 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-10T22:04:38.574 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-10T22:04:38.624 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-10T22:04:38.795 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-10T22:04:38.847 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-10T22:04:38.938 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-10T22:04:39.003 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-10T22:04:39.075 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-10T22:04:39.107 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-10T22:04:39.143 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-10T22:04:39.190 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-10T22:04:39.226 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-10T22:04:39.269 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-10T22:04:39.311 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-10T22:04:39.446 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-10T22:04:39.495 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-10T22:04:39.537 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-10T22:04:39.640 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-10T22:04:39.670 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-10T22:04:39.710 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-10T22:04:39.736 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-10T22:04:39.761 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-10T22:04:39.835 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-10T22:04:39.962 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-10T22:04:40.001 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-10T22:04:40.029 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-10T22:04:40.063 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-10T22:04:40.110 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-10T22:04:40.141 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-10T22:04:40.171 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-10T22:04:40.206 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-10T22:04:40.239 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-10T22:04:40.280 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-10T22:04:40.315 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-10T22:04:40.402 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-10T22:04:40.445 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-10T22:04:40.476 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-10T22:04:40.580 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-10T22:04:40.635 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-10T22:04:41.362 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-10T22:04:41.416 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-10T22:04:41.449 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-10T22:04:41.548 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-10T22:04:41.604 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-10T22:04:41.649 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-10T22:04:41.736 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-10T22:04:41.768 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-10T22:04:41.953 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-10T22:04:41.982 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-10T22:04:42.060 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-10T22:04:42.704 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-10T22:04:42.822 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-10T22:04:44.042 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-10T22:04:44.118 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-10T22:04:44.147 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-10T22:04:44.180 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-10T22:04:44.500 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-10T22:04:44.544 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:04:44.628 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-10T22:04:44.657 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-10T22:04:44.694 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-10T22:04:45.184 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-10T22:04:45.213 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:04:45.285 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-10T22:04:45.315 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-10T22:04:46.572 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-09-10T22:04:46.573 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:46.749 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:04:46.769 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:04:46.769 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:46.769 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:04:46.769 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:47.559 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:47.603 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:48.159 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-10T22:04:48.206 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:04:48.304 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-10T22:04:48.304 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T22:04:48.304 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T22:04:48.304 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:04:48.332 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:04:48.336 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:04:48.368 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:04:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:04:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:04:48.368 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:04:48.368 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:48.425 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:04:48.425 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /sys 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /proc 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /mnt 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /var/tmp 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /home 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /root 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout:skipping the directory /tmp 2024-09-10T22:04:48.426 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:48.607 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:04:48.612 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:04:48.625 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:04:48.626 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:48.626 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:04:48.626 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:48.637 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:04:48.638 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:48.638 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:04:48.638 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:04:48.638 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:04:48.638 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:49.113 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:04:49.138 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:04:49.138 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:49.138 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:04:49.138 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:04:49.138 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:04:49.138 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:49.252 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T22:04:49.310 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T22:04:49.375 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T22:04:49.572 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T22:04:49.623 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T22:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T22:04:49.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T22:04:49.947 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T22:04:49.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T22:04:50.030 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T22:04:50.057 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T22:04:50.200 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:04:50.227 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:04:50.227 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:50.227 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:04:50.227 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:04:50.227 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:04:50.227 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:50.468 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:04:50.492 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:04:50.492 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:50.493 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:04:50.493 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:04:50.493 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:04:50.493 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:50.557 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:04:50.589 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:04:50.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T22:04:50.692 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T22:04:50.720 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:04:50.961 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:04:50.984 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:04:50.985 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:50.985 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:04:50.985 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:04:50.985 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:04:50.985 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:51.092 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T22:04:51.149 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T22:04:51.222 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T22:04:51.424 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T22:04:51.470 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T22:04:51.551 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T22:04:51.640 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T22:04:51.791 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T22:04:51.837 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T22:04:51.877 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T22:04:51.913 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T22:04:52.310 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:04:52.337 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:04:52.369 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T22:04:52.438 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T22:04:52.476 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:04:54.177 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:04:54.234 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:04:55.254 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:04:55.293 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:04:55.415 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:04:55.580 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T22:04:55.603 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:04:55.629 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:04:55.629 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:55.629 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:04:55.629 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:04:55.629 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:04:55.629 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:55.679 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:04:55.691 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:04:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T22:04:55.859 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T22:04:55.884 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:04:55.940 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:04:56.870 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T22:04:56.899 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:04:56.924 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:04:56.924 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:56.924 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:04:56.924 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:04:56.924 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:04:56.924 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:56.958 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:04:56.967 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:04:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:04:56.990 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:56.990 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:04:56.990 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:56.991 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:04:57.041 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:04:57.069 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:04:57.069 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:57.069 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T22:04:57.069 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:04:57.070 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:04:57.070 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:57.111 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:04:57.277 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T22:04:57.301 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:04:57.325 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:04:57.325 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:57.325 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:04:57.325 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:04:57.325 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:04:57.325 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:57.376 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:04:57.388 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:04:57.400 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:04:57.426 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:04:57.426 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:57.426 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:04:57.426 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:04:57.426 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:04:57.426 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:04:57.490 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T22:04:57.543 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T22:04:58.558 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T22:04:58.587 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:04:58.612 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:04:58.612 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:58.612 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:04:58.612 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:04:58.613 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:04:58.613 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:58.655 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:04:58.677 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:04:58.677 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:58.677 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:04:58.677 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:58.722 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:04:58.745 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:04:58.745 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:58.745 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T22:04:58.745 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:04:58.745 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:04:58.746 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:04:59.073 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:04:59.096 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:04:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:04:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:04:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:04:59.096 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:04:59.096 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /sys 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /proc 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /mnt 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /var/tmp 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /home 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /root 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout:skipping the directory /tmp 2024-09-10T22:05:00.178 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:00.359 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:05:00.377 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-10T22:05:00.377 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:00.377 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T22:05:00.377 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:01.887 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:05:01.915 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-10T22:05:01.915 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:01.915 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T22:05:01.915 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:05:01.915 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T22:05:01.915 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:02.146 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:05:02.170 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-10T22:05:02.170 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:02.170 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T22:05:02.170 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:05:02.170 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T22:05:02.170 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:02.414 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T22:05:02.463 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T22:05:02.505 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T22:05:02.544 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T22:05:02.580 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T22:05:02.621 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:05:02.645 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-10T22:05:02.645 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:02.645 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T22:05:02.645 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:05:02.645 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T22:05:02.645 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:02.751 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-10T22:05:02.803 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T22:05:02.808 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-10T22:05:02.852 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T22:05:02.864 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-10T22:05:02.882 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T22:05:02.912 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T22:05:02.949 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T22:05:03.051 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-10T22:05:03.097 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-10T22:05:03.175 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-10T22:05:03.264 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-10T22:05:03.404 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-10T22:05:03.447 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-10T22:05:03.479 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-10T22:05:03.506 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-10T22:05:03.529 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:03.911 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:05:03.947 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-10T22:05:03.979 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-10T22:05:04.043 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T22:05:04.045 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-10T22:05:04.069 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:05:04.084 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T22:05:04.125 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T22:05:04.157 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T22:05:04.192 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T22:05:04.396 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T22:05:04.439 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T22:05:04.477 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T22:05:04.507 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T22:05:04.508 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T22:05:04.553 INFO:teuthology.orchestra.run.smithi052.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T22:05:04.594 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T22:05:04.642 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T22:05:04.753 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T22:05:04.789 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T22:05:04.814 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T22:05:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T22:05:04.840 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:05:04.916 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:05:04.983 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:05:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T22:05:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:05.198 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:05.211 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:05.211 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:05:05.234 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:05.254 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:05.295 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:05:05.363 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:06.151 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T22:05:06.238 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T22:05:06.280 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T22:05:06.364 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T22:05:06.399 INFO:teuthology.orchestra.run.smithi052.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T22:05:06.425 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T22:05:06.459 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T22:05:06.459 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:05:06.552 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:05:06.552 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:05:06.636 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:05:06.660 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T22:05:06.666 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:06.666 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:06.854 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:06.854 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:05:06.929 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:05:06.997 INFO:teuthology.orchestra.run.smithi052.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:07.266 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-10T22:05:07.325 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:05:08.299 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-10T22:05:08.325 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:05:08.443 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-10T22:05:08.604 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-10T22:05:08.636 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:05:08.660 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-10T22:05:08.661 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:08.661 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T22:05:08.661 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:05:08.661 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T22:05:08.661 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:08.712 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:05:08.724 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-10T22:05:08.821 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-10T22:05:08.868 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-10T22:05:09.820 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-10T22:05:09.847 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:05:09.871 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-10T22:05:09.871 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:09.871 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T22:05:09.871 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:05:09.871 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T22:05:09.871 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:09.916 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:05:09.938 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-10T22:05:09.938 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:09.939 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T22:05:09.939 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:09.982 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:05:10.005 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-10T22:05:10.005 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:10.006 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T22:05:10.006 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:05:10.006 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T22:05:10.006 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:10.315 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:05:10.340 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-10T22:05:10.340 INFO:teuthology.orchestra.run.smithi189.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T22:05:10.340 INFO:teuthology.orchestra.run.smithi189.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T22:05:10.340 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:05:10.340 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T22:05:10.340 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T22:05:11.507 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:05:11.508 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T22:05:11.509 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T22:05:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T22:05:11.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T22:05:11.524 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T22:05:11.525 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T22:05:11.526 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T22:05:11.527 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T22:05:11.528 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T22:05:11.529 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T22:05:11.530 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T22:05:11.531 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T22:05:11.532 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T22:05:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T22:05:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T22:05:13.515 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T22:05:13.516 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T22:05:13.517 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T22:05:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T22:05:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T22:05:13.518 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T22:05:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T22:05:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T22:05:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T22:05:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T22:05:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T22:05:13.530 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T22:05:13.531 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T22:05:13.532 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T22:05:13.533 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T22:05:13.534 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T22:05:13.535 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T22:05:13.536 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T22:05:13.537 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T22:05:13.538 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T22:05:13.539 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T22:05:13.540 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T22:05:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T22:05:13.541 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.523 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.524 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.525 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:05:14.526 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:05:14.527 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:05:14.528 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:05:14.529 INFO:teuthology.orchestra.run.smithi005.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T22:05:14.530 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:05:14.531 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:05:14.532 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:05:14.533 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.534 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:05:14.535 INFO:teuthology.orchestra.run.smithi005.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T22:05:14.536 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:05:14.536 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-10T22:05:14.966 DEBUG:teuthology.parallel:result is None 2024-09-10T22:05:15.037 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-10T22:05:15.077 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-10T22:05:15.118 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-10T22:05:15.150 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-10T22:05:15.177 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-10T22:05:15.362 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-10T22:05:15.407 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-10T22:05:15.437 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-10T22:05:15.475 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-10T22:05:15.521 INFO:teuthology.orchestra.run.smithi189.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-10T22:05:16.157 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:16.194 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:16.215 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout:Upgraded: 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:16.281 INFO:teuthology.orchestra.run.smithi052.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout:Installed: 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.282 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.283 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T22:05:16.284 INFO:teuthology.orchestra.run.smithi052.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:05:16.285 INFO:teuthology.orchestra.run.smithi052.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:05:16.286 INFO:teuthology.orchestra.run.smithi052.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T22:05:16.287 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.288 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:05:16.289 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:05:16.290 INFO:teuthology.orchestra.run.smithi052.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:05:16.291 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:05:16.292 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:05:16.293 INFO:teuthology.orchestra.run.smithi052.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:05:16.294 INFO:teuthology.orchestra.run.smithi052.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:05:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T22:05:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T22:05:16.295 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:05:16.296 INFO:teuthology.orchestra.run.smithi052.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T22:05:16.296 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:05:16.296 INFO:teuthology.orchestra.run.smithi052.stdout:Complete! 2024-09-10T22:05:16.716 DEBUG:teuthology.parallel:result is None 2024-09-10T22:05:17.069 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-10T22:05:17.157 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-10T22:05:17.197 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-10T22:05:17.279 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-10T22:05:17.318 INFO:teuthology.orchestra.run.smithi189.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-10T22:05:17.343 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-10T22:05:17.377 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-10T22:05:17.377 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:05:17.453 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-10T22:05:17.453 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:05:17.537 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-10T22:05:17.562 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-10T22:05:17.568 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:17.568 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:17.755 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-10T22:05:17.756 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:05:17.839 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-10T22:05:17.903 INFO:teuthology.orchestra.run.smithi189.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-10T22:05:24.278 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-10T22:05:24.279 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-10T22:05:24.280 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-10T22:05:24.281 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-10T22:05:24.282 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-10T22:05:24.283 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-10T22:05:24.284 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-10T22:05:24.285 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-10T22:05:24.286 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-10T22:05:24.287 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-10T22:05:24.288 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-10T22:05:24.289 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-10T22:05:24.290 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout:Upgraded: 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:26.723 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout:Installed: 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.724 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.725 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T22:05:26.726 INFO:teuthology.orchestra.run.smithi189.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T22:05:26.727 INFO:teuthology.orchestra.run.smithi189.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T22:05:26.728 INFO:teuthology.orchestra.run.smithi189.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T22:05:26.729 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T22:05:26.730 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T22:05:26.731 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T22:05:26.732 INFO:teuthology.orchestra.run.smithi189.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T22:05:26.733 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T22:05:26.734 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T22:05:26.735 INFO:teuthology.orchestra.run.smithi189.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-10T22:05:26.736 INFO:teuthology.orchestra.run.smithi189.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T22:05:26.737 INFO:teuthology.orchestra.run.smithi189.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T22:05:26.737 INFO:teuthology.orchestra.run.smithi189.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T22:05:26.737 INFO:teuthology.orchestra.run.smithi189.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T22:05:26.737 INFO:teuthology.orchestra.run.smithi189.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T22:05:26.737 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T22:05:26.738 INFO:teuthology.orchestra.run.smithi189.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T22:05:26.738 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:05:26.738 INFO:teuthology.orchestra.run.smithi189.stdout:Complete! 2024-09-10T22:05:27.192 DEBUG:teuthology.parallel:result is None 2024-09-10T22:05:27.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:05:27.349 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:05:27.377 INFO:teuthology.orchestra.run.smithi005.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:05:27.378 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:05:27.378 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:05:27.380 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:05:27.533 DEBUG:teuthology.orchestra.run.smithi052:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:05:27.559 INFO:teuthology.orchestra.run.smithi052.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:05:27.559 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:05:27.559 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:05:27.561 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:05:27.707 DEBUG:teuthology.orchestra.run.smithi189:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T22:05:27.731 INFO:teuthology.orchestra.run.smithi189.stdout:19.3.0-4854.g8f219c47.el9 2024-09-10T22:05:27.732 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-10T22:05:27.732 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-10T22:05:27.734 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T22:05:27.734 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:05:27.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:05:27.768 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:05:27.768 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:05:27.801 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:05:27.801 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T22:05:27.832 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T22:05:27.832 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:05:27.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:05:27.863 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:05:27.933 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:05:27.933 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:05:27.959 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:05:28.023 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:05:28.023 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T22:05:28.052 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T22:05:28.121 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T22:05:28.121 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:05:28.122 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:05:28.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:05:28.214 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:05:28.214 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:05:28.240 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:05:28.305 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:05:28.305 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T22:05:28.335 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T22:05:28.404 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T22:05:28.405 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:05:28.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:05:28.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:05:28.498 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:05:28.498 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:05:28.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:05:28.588 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:05:28.588 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T22:05:28.618 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T22:05:28.687 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-10T22:05:28.817 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T22:05:28.817 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:05:28.818 INFO:tasks.cephadm:Cluster fsid is ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:05:28.818 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-10T22:05:28.818 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.b': '172.21.15.52', 'mon.c': '172.21.15.189'} 2024-09-10T22:05:28.818 INFO:tasks.cephadm:First mon is mon.a on smithi005 2024-09-10T22:05:28.818 INFO:tasks.cephadm:First mgr is x 2024-09-10T22:05:28.818 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-10T22:05:28.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-09-10T22:05:28.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname $(hostname -s) 2024-09-10T22:05:28.871 DEBUG:teuthology.orchestra.run.smithi189:> sudo hostname $(hostname -s) 2024-09-10T22:05:28.901 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-10T22:05:28.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:05:29.054 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-10T22:05:29.225 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:05:29.226 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T22:05:29.227 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-10T22:05:29.227 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:29.602 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:05 /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:29.602 DEBUG:teuthology.orchestra.run.smithi052:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:29.976 INFO:teuthology.orchestra.run.smithi052.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:05 /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:29.976 DEBUG:teuthology.orchestra.run.smithi189:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:30.363 INFO:teuthology.orchestra.run.smithi189.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 10 22:05 /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:30.363 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:30.384 DEBUG:teuthology.orchestra.run.smithi052:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:30.403 DEBUG:teuthology.orchestra.run.smithi189:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-10T22:05:30.438 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-10T22:05:30.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:05:30.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:05:30.445 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-10T22:05:32.017 INFO:teuthology.orchestra.run.smithi052.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:05:32.061 INFO:teuthology.orchestra.run.smithi005.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:05:32.076 INFO:teuthology.orchestra.run.smithi189.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:06:04.517 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T22:06:04.517 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:06:04.517 INFO:teuthology.orchestra.run.smithi052.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:06:04.517 INFO:teuthology.orchestra.run.smithi052.stdout: "repo_digests": [ 2024-09-10T22:06:04.518 INFO:teuthology.orchestra.run.smithi052.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:06:04.518 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-09-10T22:06:04.518 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T22:06:24.592 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:06:24.592 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:06:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:06:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "repo_digests": [ 2024-09-10T22:06:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:06:24.593 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:06:24.593 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:06:26.815 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T22:06:26.815 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-10T22:06:26.815 INFO:teuthology.orchestra.run.smithi189.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-10T22:06:26.815 INFO:teuthology.orchestra.run.smithi189.stdout: "repo_digests": [ 2024-09-10T22:06:26.816 INFO:teuthology.orchestra.run.smithi189.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-10T22:06:26.816 INFO:teuthology.orchestra.run.smithi189.stdout: ] 2024-09-10T22:06:26.816 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T22:06:26.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-09-10T22:06:26.877 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph 2024-09-10T22:06:26.910 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph 2024-09-10T22:06:26.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-09-10T22:06:26.972 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /etc/ceph 2024-09-10T22:06:27.001 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /etc/ceph 2024-09-10T22:06:27.026 INFO:tasks.cephadm:Writing seed config... 2024-09-10T22:06:27.027 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-10T22:06:27.027 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-10T22:06:27.027 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-10T22:06:27.028 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-10T22:06:27.029 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-10T22:06:27.030 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:06:27.030 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-10T22:06:27.049 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ca2ddb2e-6fc0-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-10T22:06:27.050 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service 2024-09-10T22:06:27.093 DEBUG:teuthology.orchestra.run.smithi005:mgr.x> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x.service 2024-09-10T22:06:27.136 INFO:tasks.cephadm:Bootstrapping... 2024-09-10T22:06:27.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:06:27.354 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-10T22:06:27.354 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.5', '--skip-admin-label'] 2024-09-10T22:06:27.354 INFO:teuthology.orchestra.run.smithi005.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-10T22:06:27.355 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying podman|docker is present... 2024-09-10T22:06:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 5.2.2 2024-09-10T22:06:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying lvm2 is present... 2024-09-10T22:06:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying time synchronization is in place... 2024-09-10T22:06:27.386 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T22:06:27.386 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T22:06:27.392 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T22:06:27.392 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-10T22:06:27.399 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-09-10T22:06:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-09-10T22:06:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-09-10T22:06:27.406 INFO:teuthology.orchestra.run.smithi005.stdout:Repeating the final host check... 2024-09-10T22:06:27.435 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 5.2.2 2024-09-10T22:06:27.435 INFO:teuthology.orchestra.run.smithi005.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-10T22:06:27.435 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl is present 2024-09-10T22:06:27.436 INFO:teuthology.orchestra.run.smithi005.stdout:lvcreate is present 2024-09-10T22:06:27.441 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-10T22:06:27.442 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-10T22:06:27.448 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-10T22:06:27.448 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-10T22:06:27.454 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout enabled 2024-09-10T22:06:27.461 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout active 2024-09-10T22:06:27.461 INFO:teuthology.orchestra.run.smithi005.stdout:Unit chronyd.service is enabled and running 2024-09-10T22:06:27.461 INFO:teuthology.orchestra.run.smithi005.stdout:Host looks OK 2024-09-10T22:06:27.461 INFO:teuthology.orchestra.run.smithi005.stdout:Cluster fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:27.461 INFO:teuthology.orchestra.run.smithi005.stdout:Acquiring lock 140222404645744 on /run/cephadm/ca2ddb2e-6fc0-11ef-bcea-c7b262605968.lock 2024-09-10T22:06:27.462 INFO:teuthology.orchestra.run.smithi005.stdout:Lock 140222404645744 acquired on /run/cephadm/ca2ddb2e-6fc0-11ef-bcea-c7b262605968.lock 2024-09-10T22:06:27.462 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 3300 ... 2024-09-10T22:06:27.462 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying IP 172.21.15.5 port 6789 ... 2024-09-10T22:06:27.462 INFO:teuthology.orchestra.run.smithi005.stdout:Base mon IP(s) is [172.21.15.5:3300, 172.21.15.5:6789], mon addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-09-10T22:06:27.465 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.5 metric 100 2024-09-10T22:06:27.465 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2024-09-10T22:06:27.468 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-10T22:06:27.468 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-10T22:06:27.468 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1714sec hoplimit 64 pref medium 2024-09-10T22:06:27.471 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-10T22:06:27.471 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-10T22:06:27.471 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T22:06:27.471 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2024-09-10T22:06:27.471 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-10T22:06:27.471 INFO:teuthology.orchestra.run.smithi005.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-10T22:06:27.472 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-09-10T22:06:27.472 INFO:teuthology.orchestra.run.smithi005.stdout:Mon IP `172.21.15.5` is in CIDR network `172.21.0.0/20` 2024-09-10T22:06:27.472 INFO:teuthology.orchestra.run.smithi005.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-10T22:06:27.472 INFO:teuthology.orchestra.run.smithi005.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-10T22:06:27.473 INFO:teuthology.orchestra.run.smithi005.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:06:27.867 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T22:06:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-10T22:06:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Getting image source signatures 2024-09-10T22:06:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-10T22:06:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-10T22:06:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-10T22:06:27.868 INFO:teuthology.orchestra.run.smithi005.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-10T22:06:28.706 INFO:teuthology.orchestra.run.smithi005.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T22:06:28.706 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-10T22:06:28.706 INFO:teuthology.orchestra.run.smithi005.stdout:Extracting ceph user uid/gid from container image... 2024-09-10T22:06:29.679 INFO:teuthology.orchestra.run.smithi005.stdout:stat: stdout 167 167 2024-09-10T22:06:29.679 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial keys... 2024-09-10T22:06:30.535 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQDlwuBmGDJzOxAApGcT8imt2yKMtjEPKG02pA== 2024-09-10T22:06:31.440 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQDmwuBmeNpPMhAAM8Ki7Ba62O8+L5hMkyQu5g== 2024-09-10T22:06:33.614 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph-authtool: stdout AQDnwuBmen4lLRAApj6e4sLHF51GdkLiSuiyVg== 2024-09-10T22:06:33.615 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial monmap... 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool for a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: set fsid to ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:06:42.757 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mon... 2024-09-10T22:06:44.691 INFO:teuthology.orchestra.run.smithi005.stdout:create mon.a on 2024-09-10T22:06:44.901 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-10T22:06:45.048 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-10T22:06:45.228 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968.target. 2024-09-10T22:06:45.228 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968.target. 2024-09-10T22:06:45.481 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a 2024-09-10T22:06:45.481 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-10T22:06:45.652 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968.target.wants/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@.service. 2024-09-10T22:06:46.160 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:46 smithi005 ceph-mon[30740]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T22:06:46.160 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:46 smithi005 bash[30720]: 44a111026135f1f4b51cf5876b209d635e59826d9c26c588d5f31ea95a7b5d8c 2024-09-10T22:06:46.175 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:06:46.176 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-10T22:06:46.184 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:06:46.184 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-10T22:06:46.184 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-10T22:06:46.184 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T22:06:46.185 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon to start... 2024-09-10T22:06:46.185 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mon... 2024-09-10T22:06:46.419 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:46 smithi005 systemd[1]: Started Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: monmap epoch 1 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: last_changed 2024-09-10T22:06:36.514645+0000 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: min_mon_release 19 (squid) 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: election_strategy: 1 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: fsmap 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T22:06:47.192 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: mgrmap e1: no daemons active 2024-09-10T22:06:47.193 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:47 smithi005 ceph-mon[30740]: from='client.? 172.21.15.5:0/300843253' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-10T22:06:47.195 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout cluster: 2024-09-10T22:06:47.195 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout id: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout services: 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.493875s) 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout data: 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-10T22:06:47.196 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout pgs: 2024-09-10T22:06:47.197 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:47.197 INFO:teuthology.orchestra.run.smithi005.stdout:mon is available 2024-09-10T22:06:47.197 INFO:teuthology.orchestra.run.smithi005.stdout:Assimilating anything we can from ceph.conf... 2024-09-10T22:06:48.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:48 smithi005 ceph-mon[30740]: from='client.? 172.21.15.5:0/431862146' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T22:06:48.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:48 smithi005 ceph-mon[30740]: from='client.? 172.21.15.5:0/431862146' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T22:06:48.177 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T22:06:48.178 INFO:teuthology.orchestra.run.smithi005.stdout:Generating new minimal ceph.conf... 2024-09-10T22:06:49.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:49 smithi005 ceph-mon[30740]: from='client.? 172.21.15.5:0/2313319015' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:06:49.780 INFO:teuthology.orchestra.run.smithi005.stdout:Restarting the monitor... 2024-09-10T22:06:50.055 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:49 smithi005 systemd[1]: Stopping Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:06:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a[30735]: 2024-09-10T22:06:50.053+0000 7faa5bd93640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:06:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a[30735]: 2024-09-10T22:06:50.053+0000 7faa5bd93640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-10T22:06:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 podman[30992]: 2024-09-10 22:06:50.115536279 +0000 UTC m=+0.163005134 container died 44a111026135f1f4b51cf5876b209d635e59826d9c26c588d5f31ea95a7b5d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T22:06:50.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 podman[30992]: 2024-09-10 22:06:50.428232011 +0000 UTC m=+0.475700855 container cleanup 44a111026135f1f4b51cf5876b209d635e59826d9c26c588d5f31ea95a7b5d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-10T22:06:50.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 bash[30992]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a 2024-09-10T22:06:51.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 podman[31006]: 2024-09-10 22:06:50.629106286 +0000 UTC m=+0.511571954 container remove 44a111026135f1f4b51cf5876b209d635e59826d9c26c588d5f31ea95a7b5d8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T22:06:51.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 systemd[1]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T22:06:51.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 systemd[1]: Stopped Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:06:51.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:50 smithi005 systemd[1]: Starting Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:06:51.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 podman[31096]: 2024-09-10 22:06:51.046543023 +0000 UTC m=+0.111261549 container create a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T22:06:51.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 podman[31096]: 2024-09-10 22:06:50.951154584 +0000 UTC m=+0.015873123 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:06:51.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 podman[31096]: 2024-09-10 22:06:51.282629146 +0000 UTC m=+0.347347673 container init a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T22:06:51.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 podman[31096]: 2024-09-10 22:06:51.285818864 +0000 UTC m=+0.350537390 container start a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T22:06:51.371 INFO:teuthology.orchestra.run.smithi005.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-10T22:06:51.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: set uid:gid to 167:167 (ceph:ceph) 2024-09-10T22:06:51.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-10T22:06:51.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: pidfile_write: ignore empty --pid-file 2024-09-10T22:06:51.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: load: jerasure load: lrc 2024-09-10T22:06:51.569 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: RocksDB version: 7.9.2 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Git sha 0 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: DB SUMMARY 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: DB Session ID: IEETZLRZWWDS7E4IJDI5 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: CURRENT file: CURRENT 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: IDENTITY file: IDENTITY 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95086 ; 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.error_if_exists: 0 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.create_if_missing: 0 2024-09-10T22:06:51.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.paranoid_checks: 1 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.env: 0x5636b3229180 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.fs: PosixFileSystem 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.info_log: 0x5636b55c7700 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_file_opening_threads: 16 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.statistics: (nil) 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.use_fsync: 0 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_log_file_size: 0 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.keep_log_file_num: 1000 2024-09-10T22:06:51.571 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.recycle_log_file_num: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.allow_fallocate: 1 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.allow_mmap_reads: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.allow_mmap_writes: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.use_direct_reads: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.create_missing_column_families: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.db_log_dir: 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.wal_dir: 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-10T22:06:51.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.advise_random_on_open: 1 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.db_write_buffer_size: 0 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.write_buffer_manager: 0x5636b55cbb80 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.rate_limiter: (nil) 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.wal_recovery_mode: 2 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.enable_thread_tracking: 0 2024-09-10T22:06:51.573 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.enable_pipelined_write: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.unordered_write: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.row_cache: None 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.wal_filter: None 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.allow_ingest_behind: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.two_write_queues: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.manual_wal_flush: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.wal_compression: 0 2024-09-10T22:06:51.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.atomic_flush: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.log_readahead_size: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.best_efforts_recovery: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.allow_data_in_errors: 0 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.db_host_id: __hostname__ 2024-09-10T22:06:51.575 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-10T22:06:51.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_background_jobs: 2 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_background_compactions: -1 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_subcompactions: 1 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_total_wal_size: 0 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_open_files: -1 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bytes_per_sync: 0 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-10T22:06:51.577 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_readahead_size: 0 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_background_flushes: -1 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Compression algorithms supported: 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kZSTD supported: 0 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kXpressCompression supported: 0 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kBZip2Compression supported: 0 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kLZ4Compression supported: 1 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kZlibCompression supported: 1 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kLZ4HCCompression supported: 1 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: kSnappyCompression supported: 1 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-10T22:06:51.578 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.merge_operator: 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_filter: None 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_filter_factory: None 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.sst_partitioner_factory: None 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5636b55c7320) 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks: 1 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-10T22:06:51.579 INFO:journalctl@ceph.mon.a.smithi005.stdout: pin_top_level_index_and_filter: 1 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_type: 0 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_index_type: 0 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_shortening: 1 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: checksum: 4 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: no_block_cache: 0 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache: 0x5636b55bb610 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_name: BinnedLRUCache 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_options: 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: capacity : 536870912 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_shard_bits : 4 2024-09-10T22:06:51.580 INFO:journalctl@ceph.mon.a.smithi005.stdout: strict_capacity_limit : 0 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: high_pri_pool_ratio: 0.000 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_cache_compressed: (nil) 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: persistent_cache: (nil) 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size: 4096 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_size_deviation: 10 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_restart_interval: 16 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: index_block_restart_interval: 1 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: metadata_block_size: 4096 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: partition_filters: 0 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: use_delta_encoding: 1 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: filter_policy: bloomfilter 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: whole_key_filtering: 1 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: verify_compression: 0 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: read_amp_bytes_per_bit: 0 2024-09-10T22:06:51.581 INFO:journalctl@ceph.mon.a.smithi005.stdout: format_version: 5 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_index_compression: 1 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout: block_align: 0 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout: max_auto_readahead_size: 262144 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout: prepopulate_block_cache: 0 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout: initial_auto_readahead_size: 8192 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout: num_file_reads_for_auto_readahead: 2 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.write_buffer_size: 33554432 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_write_buffer_number: 2 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression: NoCompression 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression: Disabled 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.prefix_extractor: nullptr 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-10T22:06:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.num_levels: 7 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:06:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.level: 32767 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.strategy: 0 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.enabled: false 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.target_file_size_base: 67108864 2024-09-10T22:06:51.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-10T22:06:51.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.arena_block_size: 1048576 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.disable_auto_compactions: 0 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-10T22:06:51.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.inplace_update_support: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.bloom_locality: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.max_successive_merges: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.paranoid_file_checks: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.force_consistency_checks: 1 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.report_bg_io_stats: 0 2024-09-10T22:06:51.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.ttl: 2592000 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.enable_blob_files: false 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.min_blob_size: 0 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.blob_file_size: 268435456 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.blob_file_starting_level: 0 2024-09-10T22:06:51.588 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 032d9785-571a-4a26-b650-be474fdc141a 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006011312663, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006011313595, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91239, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 285, "table_properties": {"data_size": 89287, "index_size": 272, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11686, "raw_average_key_size": 47, "raw_value_size": 82707, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 244, "num_filter_entries": 244, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726006011, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "032d9785-571a-4a26-b650-be474fdc141a", "db_session_id": "IEETZLRZWWDS7E4IJDI5", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726006011313692, "job": 1, "event": "recovery_finished"} 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5636b55eae00 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: DB pointer 0x5636b56ec000 2024-09-10T22:06:51.589 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** DB Stats ** 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:06:51.590 INFO:journalctl@ceph.mon.a.smithi005.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: L0 2/0 90.96 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: Sum 2/0 90.96 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 153.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** Compaction Stats [default] ** 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 153.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-10T22:06:51.591 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: Cumulative compaction: 0.00 GB write, 27.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: Interval compaction: 0.00 GB write, 27.86 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache BinnedLRUCache@0x5636b55bb610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:51.592 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???) e1 preinit fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).mds e1 new map 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).mds e1 print_map 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: e1 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: btime 2024-09-10T22:06:46:142211+0000 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: legacy client fscid: -1 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout: No filesystems configured 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:06:51.593 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 bash[31096]: a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 systemd[1]: Started Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: monmap epoch 1 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: last_changed 2024-09-10T22:06:36.514645+0000 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: min_mon_release 19 (squid) 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: election_strategy: 1 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: fsmap 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: osdmap e1: 0 total, 0 up, 0 in 2024-09-10T22:06:51.594 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:51 smithi005 ceph-mon[31115]: mgrmap e1: no daemons active 2024-09-10T22:06:52.476 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-10T22:06:52.500 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:06:52.500 INFO:teuthology.orchestra.run.smithi005.stdout:Creating mgr... 2024-09-10T22:06:52.501 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-10T22:06:52.501 INFO:teuthology.orchestra.run.smithi005.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-10T22:06:52.777 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x 2024-09-10T22:06:52.777 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-10T22:06:52.936 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968.target.wants/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@.service. 2024-09-10T22:06:53.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1258806204' entity='client.admin' 2024-09-10T22:06:53.082 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:52 smithi005 systemd[1]: Starting Ceph mgr.x for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:06:53.480 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:53 smithi005 podman[31328]: 2024-09-10 22:06:53.07027519 +0000 UTC m=+0.016241131 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:06:53.480 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:53 smithi005 podman[31328]: 2024-09-10 22:06:53.479298582 +0000 UTC m=+0.425264514 container create 91187bfe8cd9facdf75312ffed5ec78f7f9114078d1c7d5caa6e0f139f929a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T22:06:54.043 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:06:54.044 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-10T22:06:54.051 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:06:54.051 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-10T22:06:54.051 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-10T22:06:54.051 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to enable service . firewalld.service is not available 2024-09-10T22:06:54.060 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:06:54.061 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-10T22:06:54.068 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:06:54.068 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-10T22:06:54.069 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-10T22:06:54.069 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-10T22:06:54.069 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr to start... 2024-09-10T22:06:54.069 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr... 2024-09-10T22:06:54.179 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:53 smithi005 podman[31328]: 2024-09-10 22:06:53.944015824 +0000 UTC m=+0.889981756 container init 91187bfe8cd9facdf75312ffed5ec78f7f9114078d1c7d5caa6e0f139f929a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T22:06:54.179 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:53 smithi005 podman[31328]: 2024-09-10 22:06:53.947196745 +0000 UTC m=+0.893162679 container start 91187bfe8cd9facdf75312ffed5ec78f7f9114078d1c7d5caa6e0f139f929a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-10T22:06:54.179 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:54 smithi005 bash[31328]: 91187bfe8cd9facdf75312ffed5ec78f7f9114078d1c7d5caa6e0f139f929a58 2024-09-10T22:06:54.179 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:06:54 smithi005 systemd[1]: Started Ceph mgr.x for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:06:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:54 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2274178697' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:06:55.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:55.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:06:55.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:06:55.198 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:06:55.199 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:06:55.200 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:06:55.203 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:06:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:06:46:142211+0000", 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.205 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:06:46.142881+0000", 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:06:55.206 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (1/15)... 2024-09-10T22:06:57.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:57 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2692026050' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:06:58.274 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:06:58.275 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:58.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:06:58.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:06:46:142211+0000", 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:06:58.278 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:06:46.142881+0000", 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:06:58.279 INFO:teuthology.orchestra.run.smithi005.stdout:mgr not available, waiting (2/15)... 2024-09-10T22:06:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: Activating manager daemon x 2024-09-10T22:06:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: mgrmap e2: x(active, starting, since 0.00328441s) 2024-09-10T22:06:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: Manager daemon x is now available 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' 2024-09-10T22:06:59.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:06:59 smithi005 ceph-mon[31115]: from='mgr.14100 172.21.15.5:0/529888307' entity='mgr.x' 2024-09-10T22:07:01.540 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:01 smithi005 ceph-mon[31115]: mgrmap e3: x(active, since 1.00783s) 2024-09-10T22:07:01.540 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:01 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2815671215' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-10T22:07:01.544 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "health": { 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 0 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-10T22:07:01.545 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "a" 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-10T22:07:01.546 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-10T22:07:01.547 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-10T22:07:01.550 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "btime": "2024-09-10T22:06:46:142211+0000", 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-10T22:07:01.551 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "restful" 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ], 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "modified": "2024-09-10T22:06:46.142881+0000", 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout }, 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:07:01.552 INFO:teuthology.orchestra.run.smithi005.stdout:mgr is available 2024-09-10T22:07:02.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:02 smithi005 ceph-mon[31115]: mgrmap e4: x(active, since 2s) 2024-09-10T22:07:02.404 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:02 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2613081461' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [global] 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout fsid = ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-10T22:07:02.692 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout [osd] 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-10T22:07:02.693 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling cephadm module... 2024-09-10T22:07:03.719 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:03 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4272556546' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-10T22:07:03.719 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:03 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: ignoring --setuser ceph since I am not root 2024-09-10T22:07:03.719 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:03 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: ignoring --setgroup ceph since I am not root 2024-09-10T22:07:04.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:04 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4272556546' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-10T22:07:04.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:04 smithi005 ceph-mon[31115]: mgrmap e5: x(active, since 4s) 2024-09-10T22:07:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:07:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-10T22:07:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:07:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T22:07:05.337 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T22:07:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:07:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-09-10T22:07:05.338 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 5... 2024-09-10T22:07:05.737 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:05 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3350195944' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T22:07:09.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: Active manager daemon x restarted 2024-09-10T22:07:09.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: Activating manager daemon x 2024-09-10T22:07:09.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: osdmap e2: 0 total, 0 up, 0 in 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: mgrmap e6: x(active, starting, since 0.00307998s) 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:07:09.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:08 smithi005 ceph-mon[31115]: Manager daemon x is now available 2024-09-10T22:07:10.276 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:07:10.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-10T22:07:10.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T22:07:10.277 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:07:10.277 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 5 is available 2024-09-10T22:07:10.277 INFO:teuthology.orchestra.run.smithi005.stdout:Setting orchestrator backend to cephadm... 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: mgrmap e7: x(active, since 1.00498s) 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: Found migration_current of "None". Setting to last migration. 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:10.919 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:10.920 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:07:10.920 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:10 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:07:11.662+0000 7f1c9835e640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:22:07:11] ENGINE Error in HTTPServer.serve 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: Traceback (most recent call last): 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self._connections.run(self.expiration_interval) 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self._run(expiration_interval) 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:07:11.833 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: s = self.context.wrap_socket( 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: return self.sslsocket_class._create( 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self.do_handshake() 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self._sslobj.do_handshake() 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:07:11.834 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:07:12.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-mon[31115]: mgrmap e8: x(active, since 2s) 2024-09-10T22:07:12.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-mon[31115]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:12.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:12.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:12.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:11] ENGINE Bus STARTING 2024-09-10T22:07:12.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:11 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:12.740 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-10T22:07:12.740 INFO:teuthology.orchestra.run.smithi005.stdout:Generating ssh key... 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:12 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:11] ENGINE Serving on http://172.21.15.5:8765 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:12 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:11] ENGINE Serving on https://172.21.15.5:7150 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:12 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:11] ENGINE Bus STARTED 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:12 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:11] ENGINE Error in HTTPServer.serve 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:07:12.993 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-09-10T22:07:12.994 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:07:12.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:12 smithi005 ceph-mon[31115]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:13.826 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: Generating public/private rsa key pair. 2024-09-10T22:07:13.826 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: Your identification has been saved in /tmp/tmpzrgfieox/key 2024-09-10T22:07:13.826 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: Your public key has been saved in /tmp/tmpzrgfieox/key.pub 2024-09-10T22:07:13.826 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: The key fingerprint is: 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: SHA256:eTNkv4seLx3o9KxbHnjOqugKIX2GUdQugOXMMYlPCoY ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: The key's randomart image is: 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: +---[RSA 3072]----+ 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: |.++oo. | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: |E=++ . | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: |o+=. . o | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: |...o. . + . | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: |. + o. S +.. | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: | . + .o+.. | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: | . oo+=. | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: | . . oX+o | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: | .oo .o*=* | 2024-09-10T22:07:13.827 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: +----[SHA256]-----+ 2024-09-10T22:07:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-mon[31115]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-mon[31115]: Generating ssh key... 2024-09-10T22:07:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:13 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:15.227 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:07:15.228 INFO:teuthology.orchestra.run.smithi005.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:07:15.228 INFO:teuthology.orchestra.run.smithi005.stdout:Adding key to root@localhost authorized_keys... 2024-09-10T22:07:15.233 INFO:teuthology.orchestra.run.smithi005.stdout:Adding host smithi005... 2024-09-10T22:07:15.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:15 smithi005 ceph-mon[31115]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:16.538 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:16 smithi005 ceph-mon[31115]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "addr": "172.21.15.5", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:17.771 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:17 smithi005 ceph-mon[31115]: Deploying cephadm binary to smithi005 2024-09-10T22:07:20.436 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Added host 'smithi005' with addr '172.21.15.5' 2024-09-10T22:07:20.436 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mon service... 2024-09-10T22:07:20.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:20 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:20.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:20 smithi005 ceph-mon[31115]: Added host smithi005 2024-09-10T22:07:20.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:20 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:22.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:22 smithi005 ceph-mon[31115]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:22.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:22 smithi005 ceph-mon[31115]: Saving service mon spec with placement count:5 2024-09-10T22:07:22.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:22 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:22.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:22 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:22.541 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-10T22:07:22.541 INFO:teuthology.orchestra.run.smithi005.stdout:Deploying unmanaged mgr service... 2024-09-10T22:07:23.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:23 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:23.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:23 smithi005 ceph-mon[31115]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:23.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:23 smithi005 ceph-mon[31115]: Saving service mgr spec with placement count:2 2024-09-10T22:07:23.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:23 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:24.443 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-10T22:07:25.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:25 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:25.413 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:25 smithi005 ceph-mon[31115]: from='mgr.14118 172.21.15.5:0/3817443212' entity='mgr.x' 2024-09-10T22:07:26.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:26 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1940081663' entity='client.admin' 2024-09-10T22:07:27.321 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling the dashboard module... 2024-09-10T22:07:27.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:27 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/89642470' entity='client.admin' 2024-09-10T22:07:28.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:28 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/280710286' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-10T22:07:28.667 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:28 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: ignoring --setuser ceph since I am not root 2024-09-10T22:07:28.667 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:28 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: ignoring --setgroup ceph since I am not root 2024-09-10T22:07:29.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:29 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/280710286' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-10T22:07:29.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:29 smithi005 ceph-mon[31115]: mgrmap e9: x(active, since 19s) 2024-09-10T22:07:30.228 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for the mgr to restart... 2024-09-10T22:07:30.229 INFO:teuthology.orchestra.run.smithi005.stdout:Waiting for mgr epoch 9... 2024-09-10T22:07:30.459 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:30 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/736989473' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-10T22:07:33.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: Active manager daemon x restarted 2024-09-10T22:07:33.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: Activating manager daemon x 2024-09-10T22:07:33.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: osdmap e3: 0 total, 0 up, 0 in 2024-09-10T22:07:33.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: mgrmap e10: x(active, starting, since 0.00333396s) 2024-09-10T22:07:33.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:07:33.985 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-10T22:07:33.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-10T22:07:33.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-10T22:07:33.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-10T22:07:33.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:33 smithi005 ceph-mon[31115]: Manager daemon x is now available 2024-09-10T22:07:34.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:34.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-10T22:07:34.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-10T22:07:34.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:34 smithi005 ceph-mon[31115]: mgrmap e11: x(active, since 1.00673s) 2024-09-10T22:07:35.265 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:07:35.179+0000 7f9c2dc23640 -1 log_channel(cephadm) log [ERR] : [10/Sep/2024:22:07:35] ENGINE Error in HTTPServer.serve 2024-09-10T22:07:35.265 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: Traceback (most recent call last): 2024-09-10T22:07:35.265 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:07:35.265 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self._connections.run(self.expiration_interval) 2024-09-10T22:07:35.265 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:07:35.265 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self._run(expiration_interval) 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: s = self.context.wrap_socket( 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: return self.sslsocket_class._create( 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self.do_handshake() 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: self._sslobj.do_handshake() 2024-09-10T22:07:35.266 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:07:35.267 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:07:35.267 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout { 2024-09-10T22:07:35.267 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-10T22:07:35.267 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-10T22:07:35.268 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout } 2024-09-10T22:07:35.268 INFO:teuthology.orchestra.run.smithi005.stdout:mgr epoch 9 is available 2024-09-10T22:07:35.268 INFO:teuthology.orchestra.run.smithi005.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-10T22:07:35.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:35] ENGINE Bus STARTING 2024-09-10T22:07:35.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:35] ENGINE Serving on https://172.21.15.5:7150 2024-09-10T22:07:35.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:35] ENGINE Error in HTTPServer.serve 2024-09-10T22:07:35.878 INFO:journalctl@ceph.mon.a.smithi005.stdout: Traceback (most recent call last): 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._connections.run(self.expiration_interval) 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._run(expiration_interval) 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: s = self.context.wrap_socket( 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: return self.sslsocket_class._create( 2024-09-10T22:07:35.879 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-10T22:07:35.880 INFO:journalctl@ceph.mon.a.smithi005.stdout: self.do_handshake() 2024-09-10T22:07:35.880 INFO:journalctl@ceph.mon.a.smithi005.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-10T22:07:35.880 INFO:journalctl@ceph.mon.a.smithi005.stdout: self._sslobj.do_handshake() 2024-09-10T22:07:35.880 INFO:journalctl@ceph.mon.a.smithi005.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-10T22:07:35.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:35] ENGINE Serving on http://172.21.15.5:8765 2024-09-10T22:07:35.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:35 smithi005 ceph-mon[31115]: [10/Sep/2024:22:07:35] ENGINE Bus STARTED 2024-09-10T22:07:37.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:36 smithi005 ceph-mon[31115]: mgrmap e12: x(active, since 2s) 2024-09-10T22:07:37.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:36 smithi005 ceph-mon[31115]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:37.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:37.810 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+jCCAuKgAwIBAgIUU+tMnMhySSCyhGqSp153C6A5uhAwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMDIyMDczN1oXDTM0\nMDkxMTIyMDczN1owFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjUwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQC1Jw62kP+h1Kv5IaAUI/Zg9CgnRrZARUDJfM9Q\nBUOW50ZuqBNG0GoJ26pqMs766K7baFUk9qQJGf5t1dgHsMJifMiLIk4I+sLeOK4L\nUi9bvaPYsHebgL2sPFHO0so92YGqUJti0m4eV1WzB6yPS0so25Erpd3MNR645UQ7\nYEk7dIJopn0w9ivjWqtaxPGxycl+OscI2LIdZUSPl18bxYDOUkEf787S9yo2+ZCn\naPR+BFTQYgbYsqPgHmNFNE/dIwLW2KCF737lrinwcmcGXGihdujo1QDI+aCBlX7h\nkm8YCvo0GtaavvpQzBFDOuG5m/CKcx6SSLrYAYpQhvagVwAYCETj8J4zO+X+tnms\nEZj+LmXQDQrgYott8xJC7zyWrHwt0NV3YZVe7b4stgEqaJKYbfKXq+Rq3psudzZh\nBrNOJezgnJPCsQuNBeaSuaMQuDBxBZewxE0BOFnsPSS8rv85rUSmpn5cq8fhEnij\nTEDa3CrYy1GUZG41fkebuRQcsNvPdSgjXK7k3B1+gpVw8dMkPXsWUY8uek5ftBZ6\n3F1FZ8SVQd8O+Otn6v7C9xN8qyyxm63xJ1MstytegdldHPWjGQmcksbgm49a1ycX\neSeFZZ50I0q0UJJ+9CsgEf+IVdAfBYbu8dBXyEFUGlxhkldhqQq49jKpHgrZFOQv\nPFhR4wIDAQABoz8wPTAtBgNVHREEJjAkgglzbWl0aGkwMDWCEWRhc2hib2FyZF9z\nZXJ2ZXJzhwSsFQ8FMAwGA1UdEwEB/wQCMAAwDQYJKoZIhvcNAQELBQADggIBAHTd\nh6edwywhikPpO3Lc5bQJefocUXbr3lgvdRyfAZkey8mAAm1qEN0A9650l/D35n1V\nfvb3R6Ao60aaXXUqFIVAdRcJ0U5cCJGTxATL3gkMKnEF/98x21gXIQvr9g28k3/f\nC549B/wkaG6/b4/TJ/TsfvqLsv2p1XHfKEAMyRqX7LkklnvU5TDCJlYX7PmzYYRF\nQs8TBPu604cK0BWJStikQvBsXc2I1AG06Gi7bZiu0ywIUbGLDNFnYdRSvcGVRoTD\nku+0g5QYWkZOY/J3sAvmUAzI/E+amzEEr1OgdW1QhS58tyhE0zLzdigBOAg04zmj\nz/WjIwp2jqdzH3I1kJ/TX8FZ79KdNQ/M+lLXupyHaFp28tEWyRtAHhnsauiI2bnG\nu97kNDUe+pO6GCiuYspT1tkCY+TQ2GFlPuFzsN6XXBu7gm342D5vSFS8H5N4xzBN\npyo9DQXdxNYGd7Of0w7MJEme4dn0pRgFg3oJCgVc36/Wc3s7TdpMbvmQMnxKnxeq\ntDkZh8/CLVbBpC5nh79U6n7l3HJ0PRYleS4AKmxkdpuhiD8EsGDYBszSvRAZ8HiK\n/vuXlWvlWa5Za+3arnFB6GMAEDlALuT4oZ+mb/TANVfBsas1ADPPH3EB6GjJOwTo\ndgOsvkNh+SoDO84/XLYCjZVi7wo9fiXgPzqy7k4S\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEAtScOtpD/odSr+SGgFCP2YPQoJ0a2QEVAyXzPUAVDludGbqgT\nRtBqCduqajLO+uiu22hVJPakCRn+bdXYB7DCYnzIiyJOCPrC3jiuC1IvW72j2LB3\nm4C9rDxRztLKPdmBqlCbYtJuHldVswesj0tLKNuRK6XdzDUeuOVEO2BJO3SCaKZ9\nMPYr41qrWsTxscnJfjrHCNiyHWVEj5dfG8WAzlJBH+/O0vcqNvmQp2j0fgRU0GIG\n2LKj4B5jRTRP3SMC1tighe9+5a4p8HJnBlxooXbo6NUAyPmggZV+4ZJvGAr6NBrW\nmr76UMwRQzrhuZvwinMekki62AGKUIb2oFcAGAhE4/CeMzvl/rZ5rBGY/i5l0A0K\n4GKLbfMSQu88lqx8LdDVd2GVXu2+LLYBKmiSmG3yl6vkat6bLnc2YQazTiXs4JyT\nwrELjQXmkrmjELgwcQWXsMRNAThZ7D0kvK7/Oa1EpqZ+XKvH4RJ4o0xA2twq2MtR\nlGRuNX5Hm7kUHLDbz3UoI1yu5NwdfoKVcPHTJD17FlGPLnpOX7QWetxdRWfElUHf\nDvjrZ+r+wvcTfKsssZut8SdTLLcrXoHZXRz1oxkJnJLG4JuPWtcnF3knhWWedCNK\ntFCSfvQrIBH/iFXQHwWG7vHQV8hBVBpcYZJXYakKuPYyqR4K2RTkLzxYUeMCAwEA\nAQKCAgADcgs7GLXr/44HzoZra6WvgWVUHemwfkC1tFyDEp6O+7Ygu6ymL6ecqWNr\n4qyCJDPTM4BPFCvZineG4kbaGpgP5Hyx/MSMMizLqjtRNs50yb4YjH6x4/h3kqwh\nqWu0UnM/aIoUDpmOlS2pmo9DKHT1AXwY3u5BiI8diCrMkE/ERDqIwAXojP4XtG1G\n7DEGpyZgcsC/X9O/cGIl8wSZlB+XjQP1FgwSgiX45rVEIeBoly9/ySWFMJyiUiGk\nOtL8C0LuEC+5bG029CGTE7H28oIA9DCI4ShDKlBNtqizpKPdSrQokowbZF+Bcugv\nJasOazNfhsIBmUWIfzsAvhhpw03anviDlJEk3LYvdOLUDuHsYB4CeKMfqocjrYLn\nsSNqbpfWFhCQJ972cTvlvmu3CpHKgpvShysuQ63nehXqLLJqaXdvb41i2Qi+CxQS\nKrqVBng7IZTzl5l86T6sdaMnSpeNDv5urRbMyFBqHAYi0JpqAHCCrrMFDcbjwKT7\nXU+Hn6g6+xqEcjU0XRO+KveRFj0ep+/dyoUYZMQEmnDmW2esVGSncqQG9JgSb2ke\nvWzpjt2ggysVsb62JkII8L1i4eEN2BNkRJdnFNpVd5vMeZkiu4ltnP1bbdk1iQdo\n2lJOYpe9H49IPJgjhM6dGX8vhBXpwir2es1E63Z2cpFn7tqknQKCAQEA16wwMgzO\n74LU7B6+DRCO7omHdPVpNDG3AU3/uX0Zw7K1QhFRn7kXcIz2JmnsSpfoWBh181Rm\nXDdvCKdaMHJ1DFeUwPpAfJc8dHTXD3Mk2boRRm/mqgxeUn8ghRqOsdfaNTAf3i8D\nZjOaIs4Sa2VpeTuBYyI6sdxNkEqUVhg8CeKq+u6Bo26KqgNDMRhUUaTkC7eT1ots\n60bit6yfAgPdY0joIaWK0ncsIYDSEWMD6vZIUc82jnejjjBM/mz+rYNYpbCDaGvI\nPmn4iHOfvvKgKKzt2Ib81/MoAGkg/tReY1EMrpGiCCMOuBsseekJ2qxip1kWPrGP\nEZny+tK05/rSRQKCAQEA1wZ278/XIfe3sJ/yfh5odrgekJFzJSYFQ5dy82PGBWG4\nPoldbW1P+MIcGtfxjnTen5cmwSU8gLZGxq/VUY//bTPDY33n/A91rNaf4KnCX2Kj\nJe28Oq9vGHZTTiVNxYePajgfyFCbe1jWMqu6hTaBVUZlOgloHZT7BcOFodmyMvde\nUxn+Z3steALExhf0GqT6qc0DRidoCzJV+SB6i5TquaCS4UhIkQm9lnHlSMBkQkeV\ny1bMf+yAO4eBFAr++++gX5VocZYAly6PZilwQJoT0qD8mt3rLveSdkjzu1aO6OvF\n+0cU3uuX8C+fB5fLSbRFICWKHsG/12At38WXcHxqBwKCAQEAneN2nQ13aSxUiE+x\nPotCuCqCugL3c7h5i0D412hYNkZcH/Ph15Z/LGxlv5WH4Mv40pWFtA+zqAsFBEbP\n5evE+LYdNnF+SDfHkFIBJ1RaQ/LNts0xBohrfOWIfykEEfo9yvZiPhwY1vcr/hLy\ntSDW6GPBwztJ0O/A8MNIeQbg3TPNjEqTKXxBk1k0FXsEL4kRUeqhFk2X/V41l9WN\nysHdj1PObONuD8oiypwuLYBZW+fU5d9Wx1GasPt3QkO05n3jpdjlOsq9G8QkqHBN\nIFMrINwIe53G+KkQPcy41RXPy9GIATyobGCN5AYwt0b9adMNngnAGUGPxYj4stsS\niUm8KQKCAQBERu85UtvTE1+mnANZ/LnbCLfb2/OeFiaRweNkWYglaVQht2iNOKqu\nKKTX+T3gqEeQkWRi7Dn7/OUYbfjkfz7yI/+k9fPV2+rXyQbXRdBMjXuUrZqZX998\n+wWUyM+bK2JkrhGZf87/KcRKLrF5X0dOFp5KAXan/gh/WghyzjeBa37uEFDx9vEH\nLInjBPQkCcL2a/zgJ98nvwIBq0h+TfkCnHRHSLaSJ2+l9+CAa2bqjOSJvrQM4sIN\nJQfdn2g8A2j/MOgLOUBSwRwTqpDUUph8x1Wur0zgiwhcuul50RBr8YHaOkXsSw7h\n2505wf9xFeblQEZNYeRStV2bsphVxYu9AoIBAQCD3vzsO+ElgXGq/QQFi2JExvde\n8un+Y82csg6si9jXeX4CkJqLUjntam8VXF1cdCCwJi8nmAW0OmvlS8ELSnye3UoN\n8g6+g+r7pTzEF3k+Vk3CmGRxCzFHz1iWl33wRLoesiJg3vE/owfSoxhShUV/ltes\nXFk9xrrVVGMio0Pa0W7wqyhwly21hYNAsbI9X5oi8sZ9a/3R6yxRfI0bhpASzFAQ\nI5t2rbWOtNyBczvRoUnHeNq7XxV/kMM5rdGb17PmyVNUSivtmod80Xkp250Rd/EW\nkX0bznvOgOuwSRcVLuROX5nxRxxZik+dwj6Ysd1VowzIHBkFtRsfoJC/dgk9\n-----END RSA PRIVATE KEY-----\n"} 2024-09-10T22:07:38.445 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:39 smithi005 ceph-mon[31115]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:39.881 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-10T22:07:41.096 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-10T22:07:41.096 INFO:teuthology.orchestra.run.smithi005.stdout:Creating initial admin user... 2024-09-10T22:07:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:41 smithi005 ceph-mon[31115]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:41 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:42.601 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$7vCt2LQQDSoT/3fMpzn/4.FRL7kaQGWUy4LnKrb2uR9.mtLgM77OW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726006062, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-10T22:07:42.602 INFO:teuthology.orchestra.run.smithi005.stdout:Fetching dashboard port number... 2024-09-10T22:07:43.201 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:43 smithi005 ceph-mon[31115]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:43.202 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:43.749 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stdout 8443 2024-09-10T22:07:43.760 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-10T22:07:43.760 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout disabled 2024-09-10T22:07:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-10T22:07:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:systemctl: stdout inactive 2024-09-10T22:07:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:firewalld.service is not enabled 2024-09-10T22:07:43.768 INFO:teuthology.orchestra.run.smithi005.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-10T22:07:43.770 INFO:teuthology.orchestra.run.smithi005.stdout:Ceph Dashboard is now available at: 2024-09-10T22:07:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: URL: https://smithi005.front.sepia.ceph.com:8443/ 2024-09-10T22:07:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: User: admin 2024-09-10T22:07:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: Password: oy4m3q1vbx 2024-09-10T22:07:43.770 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:43.771 INFO:teuthology.orchestra.run.smithi005.stdout:Saving cluster configuration to /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config directory 2024-09-10T22:07:44.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:44 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3077016916' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-10T22:07:45.173 INFO:teuthology.orchestra.run.smithi005.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-10T22:07:45.173 INFO:teuthology.orchestra.run.smithi005.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-10T22:07:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.173 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout:Or, if you are only running a single cluster on this host: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: ceph telemetry on 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.174 INFO:teuthology.orchestra.run.smithi005.stdout:For more information see: 2024-09-10T22:07:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-10T22:07:45.175 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:45.175 INFO:teuthology.orchestra.run.smithi005.stdout:Bootstrap complete. 2024-09-10T22:07:45.217 INFO:tasks.cephadm:Fetching config... 2024-09-10T22:07:45.218 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:07:45.218 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-10T22:07:45.235 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-10T22:07:45.235 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:07:45.235 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-10T22:07:45.292 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-10T22:07:45.292 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:07:45.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-10T22:07:45.358 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-10T22:07:45.358 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:07:45.358 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-10T22:07:45.414 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-10T22:07:45.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:07:45.489 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:07:45.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:07:45.543 INFO:teuthology.orchestra.run.smithi052.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:07:45.556 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-10T22:07:45.597 INFO:teuthology.orchestra.run.smithi189.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCueNDvRJWFL4cYTwf46ItTf7kLPc+VjGNulyJA4CBLXbED6HaDGQOWoSY14uPf3ZF33LcmLA5Q6a2Rj6XWtvebduBC/iPWxLx6TbuJOukxUqdsnj8xLrHuVKckiET2LOmNMBl7PmEFBb/sCWVdfvYoNwvuS8fUhN5lIFKooIq42RCREHxcE/ubYTOX5oiEtkIWlNeWNXunztAdoARHE9riDltWqNyI7x4c4n0QN9oFcFcVJcqJPV/1ba3FjX7KOHejhfTlfz2fSj4UIeaS1np7NQiNibd4oQEKG1of0VhyENr9LC/h8mlZht+3cXZfWG0OCuILqdglmFg0rzs3Lw6byStnMXUBcdU/+OTFIGSxJ8LYB0d2++6IA9KpZ4w+gdIbfR1A642rrzi19jrw6HheYYsyp8t8YvoxF+tfBHI81TmNKTX1vobrj1SthfRUiivdBy3WY1G7g08q0ICVBUaJex8BWQRIM4sFGDKoXdfQoJue1mwLgo0qiQvX/fw80ZM= ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:07:45.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-10T22:07:45.773 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:45 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1554968604' entity='client.admin' 2024-09-10T22:07:45.868 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:07:47.581 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:47 smithi005 ceph-mon[31115]: mgrmap e13: x(active, since 12s) 2024-09-10T22:07:47.581 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/531920891' entity='client.admin' 2024-09-10T22:07:48.101 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-10T22:07:48.101 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-10T22:07:48.893 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:07:50.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:50.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:50.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi005", "name": "osd_memory_target"} : dispatch 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:07:50.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:49 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:07:50.424 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi052 2024-09-10T22:07:50.425 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:07:50.425 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.conf 2024-09-10T22:07:50.444 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:07:50.444 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:07:50.502 INFO:tasks.cephadm:Adding host smithi052 to orchestrator... 2024-09-10T22:07:50.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch host add smithi052 2024-09-10T22:07:50.758 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:07:51.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:51.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-10T22:07:51.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: Updating smithi005:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:07:51.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: Updating smithi005:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:07:51.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: Updating smithi005:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:07:51.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:51.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:51.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:52.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:52 smithi005 ceph-mon[31115]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi052", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:07:53.733 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:53 smithi005 ceph-mon[31115]: Deploying cephadm binary to smithi052 2024-09-10T22:07:55.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:54 smithi005 ceph-mon[31115]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:07:55.273 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi052' with addr '172.21.15.52' 2024-09-10T22:07:55.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T22:07:56.157 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:07:56.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:56.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:56 smithi005 ceph-mon[31115]: Added host smithi052 2024-09-10T22:07:56.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:07:56.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:56.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:56.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:07:56.788 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}] 2024-09-10T22:07:57.481 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:57 smithi005 ceph-mon[31115]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:07:57.481 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:07:57.518 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi189 2024-09-10T22:07:57.518 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:07:57.518 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.conf 2024-09-10T22:07:57.536 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:07:57.536 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:07:57.592 INFO:tasks.cephadm:Adding host smithi189 to orchestrator... 2024-09-10T22:07:57.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch host add smithi189 2024-09-10T22:07:57.851 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:07:58.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:58 smithi005 ceph-mon[31115]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:07:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:07:59 smithi005 ceph-mon[31115]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:00.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:00.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:00.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:00.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:00.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:00.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-10T22:08:00.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:00.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T22:08:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: Deploying cephadm binary to smithi189 2024-09-10T22:08:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:01.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:01.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:08:01.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:01.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:01.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:02.356 INFO:teuthology.orchestra.run.smithi005.stdout:Added host 'smithi189' with addr '172.21.15.189' 2024-09-10T22:08:03.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-10T22:08:03.272 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:03.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:03 smithi005 ceph-mon[31115]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:03.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:03.648 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:03 smithi005 ceph-mon[31115]: Added host smithi189 2024-09-10T22:08:03.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:03.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:03.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:03.935 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:08:03.935 INFO:teuthology.orchestra.run.smithi005.stdout:[{"addr": "172.21.15.5", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "172.21.15.52", "hostname": "smithi052", "labels": [], "status": ""}, {"addr": "172.21.15.189", "hostname": "smithi189", "labels": [], "status": ""}] 2024-09-10T22:08:04.527 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-10T22:08:04.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-10T22:08:04.791 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:04 smithi005 ceph-mon[31115]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:04.791 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:04.791 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:04 smithi005 ceph-mon[31115]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:08:04.797 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:05.712 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-09-10T22:08:06.016 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:05 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2044277683' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T22:08:06.299 INFO:tasks.cephadm:Adding mon.a on smithi005 2024-09-10T22:08:06.299 INFO:tasks.cephadm:Adding mon.b on smithi052 2024-09-10T22:08:06.299 INFO:tasks.cephadm:Adding mon.c on smithi189 2024-09-10T22:08:06.300 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi005:172.21.15.5=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c' 2024-09-10T22:08:06.546 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:08:06.591 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2044277683' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:07.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:07.341 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mon update... 2024-09-10T22:08:07.962 DEBUG:teuthology.orchestra.run.smithi052:mon.b> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.b.service 2024-09-10T22:08:07.965 DEBUG:teuthology.orchestra.run.smithi189:mon.c> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.c.service 2024-09-10T22:08:07.967 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:08:07.967 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:08:08.238 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:08.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:08.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:08.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:08.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:08.852 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:08:08.852 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","modified":"2024-09-10T22:06:36.514645Z","created":"2024-09-10T22:06:36.514645Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:08:08.853 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-10T22:08:09.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T22:08:09.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: Reconfiguring daemon mon.a on smithi005 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:09.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:09 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/4032294259' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:10.510 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:08:10.510 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:08:10.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:10 smithi005 ceph-mon[31115]: Deploying daemon mon.c on smithi189 2024-09-10T22:08:11.375 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:11.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:11 smithi005 ceph-mon[31115]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:12.620 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:08:12.620 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":1,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","modified":"2024-09-10T22:06:36.514645Z","created":"2024-09-10T22:06:36.514645Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-10T22:08:12.621 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 1 2024-09-10T22:08:13.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:13 smithi005 ceph-mon[31115]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:13.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:13 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/462546849' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:13.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:13 smithi189 systemd[1]: Started Ceph mon.c for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:08:14.153 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:08:14.153 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:08:14.416 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:08:18.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:08:18.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: mon.a calling monitor election 2024-09-10T22:08:18.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:18.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: mon.c calling monitor election 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: monmap epoch 2 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: last_changed 2024-09-10T22:08:13.575254+0000 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:08:18.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: min_mon_release 19 (squid) 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: election_strategy: 1 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: fsmap 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: mgrmap e13: x(active, since 44s) 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: overall HEALTH_OK 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:18.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: mon.a calling monitor election 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: mon.c calling monitor election 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: monmap epoch 2 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: last_changed 2024-09-10T22:08:13.575254+0000 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: min_mon_release 19 (squid) 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: election_strategy: 1 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: fsmap 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: mgrmap e13: x(active, since 44s) 2024-09-10T22:08:19.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: overall HEALTH_OK 2024-09-10T22:08:19.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:19.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:19.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:19.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:19.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:19.491 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:08:19.491 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","modified":"2024-09-10T22:08:13.575254Z","created":"2024-09-10T22:06:36.514645Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T22:08:19.491 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-10T22:08:19.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:19 smithi189 ceph-mon[35784]: Deploying daemon mon.b on smithi052 2024-09-10T22:08:19.784 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/1831827540' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:19.785 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:19 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:20.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:19 smithi005 ceph-mon[31115]: Deploying daemon mon.b on smithi052 2024-09-10T22:08:20.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/1831827540' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:20.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:19 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:20.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:20 smithi189 ceph-mon[35784]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:21.073 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:08:21.073 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:08:21.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:20 smithi005 ceph-mon[31115]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:21.345 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:08:22.001 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:08:22.001 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":2,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","modified":"2024-09-10T22:08:13.575254Z","created":"2024-09-10T22:06:36.514645Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-10T22:08:22.002 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 2 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).mds e1 new map 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: e1 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: btime 2024-09-10T22:06:46:142211+0000 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: legacy client fscid: -1 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout: No filesystems configured 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-10T22:08:22.380 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-10T22:08:22.381 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-10T22:08:22.381 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-10T22:08:22.381 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-10T22:08:22.381 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-10T22:08:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-10T22:08:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi189", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi052", "name": "osd_memory_target"} : dispatch 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:22.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Deploying cephadm binary to smithi189 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi052:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Added host smithi189 2024-09-10T22:08:22.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2044277683' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2044277683' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi189", "name": "osd_memory_target"} : dispatch 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi189:/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.754 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi005:172.21.15.5=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Saving service mon spec with placement smithi005:172.21.15.5=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Reconfiguring mon.a (unknown last config time)... 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Reconfiguring daemon mon.a on smithi005 2024-09-10T22:08:22.755 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.756 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/4032294259' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Deploying daemon mon.c on smithi189 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/462546849' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.a calling monitor election 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.757 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.c calling monitor election 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: monmap epoch 2 2024-09-10T22:08:22.758 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: last_changed 2024-09-10T22:08:13.575254+0000 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: min_mon_release 19 (squid) 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: election_strategy: 1 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: fsmap 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mgrmap e13: x(active, since 44s) 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: overall HEALTH_OK 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:22.759 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: Deploying daemon mon.b on smithi052 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/1831827540' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 ceph-mon[34997]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 bash[34978]: 9a004c76f3f10b40b82d47933d5d4e2be3fbb16dd2bd613969297647b86e4516 2024-09-10T22:08:22.760 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:22 smithi052 systemd[1]: Started Ceph mon.b for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:08:23.607 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-10T22:08:23.607 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-10T22:08:23.876 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:08:27.739 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:08:27.739 INFO:teuthology.orchestra.run.smithi189.stdout:{"epoch":3,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","modified":"2024-09-10T22:08:22.385330Z","created":"2024-09-10T22:06:36.514645Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:3300","nonce":0},{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:3300","nonce":0},{"type":"v1","addr":"172.21.15.52:6789","nonce":0}]},"addr":"172.21.15.52:6789/0","public_addr":"172.21.15.52:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-10T22:08:27.740 INFO:teuthology.orchestra.run.smithi189.stderr:dumped monmap epoch 3 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: mon.a calling monitor election 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: mon.c calling monitor election 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.740 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: mon.b calling monitor election 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: monmap epoch 3 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: last_changed 2024-09-10T22:08:22.385330+0000 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: min_mon_release 19 (squid) 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: election_strategy: 1 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:08:27.741 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: fsmap 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: mgrmap e13: x(active, since 53s) 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: overall HEALTH_OK 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.742 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: mon.a calling monitor election 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: mon.c calling monitor election 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: mon.b calling monitor election 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T22:08:27.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: monmap epoch 3 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: last_changed 2024-09-10T22:08:22.385330+0000 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: min_mon_release 19 (squid) 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: election_strategy: 1 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: fsmap 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: mgrmap e13: x(active, since 53s) 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: overall HEALTH_OK 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: mon.a calling monitor election 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: mon.c calling monitor election 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: mon.b calling monitor election 2024-09-10T22:08:27.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: monmap epoch 3 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: last_changed 2024-09-10T22:08:22.385330+0000 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: created 2024-09-10T22:06:36.514645+0000 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: min_mon_release 19 (squid) 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: election_strategy: 1 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: 1: [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] mon.c 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: 2: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.b 2024-09-10T22:08:27.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: fsmap 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: osdmap e4: 0 total, 0 up, 0 in 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: mgrmap e13: x(active, since 53s) 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: overall HEALTH_OK 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:27.835 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:28.298 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-10T22:08:28.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-10T22:08:28.557 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:28 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:28.582 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:28 smithi189 ceph-mon[35784]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:28.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:28 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/2123529410' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:28.583 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:28 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:28.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:28 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:28.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:28 smithi005 ceph-mon[31115]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:28.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:28 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/2123529410' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:28.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:28 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:28.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:28 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:28.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:28 smithi052 ceph-mon[34997]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:28.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:28 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/2123529410' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-10T22:08:28.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:28 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:08:29.227 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:29.227 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-10T22:08:29.227 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:08:29.228 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] 2024-09-10T22:08:29.686 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:08:29.385+0000 7f9c61618640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:29.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/257672732' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: Updating smithi005:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.945 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:29.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:29.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:29.946 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:30.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-10T22:08:30.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T22:08:30.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T22:08:30.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.003 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/257672732' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.003 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:30.003 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:30.003 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: Updating smithi005:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:30.004 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.004 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.004 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.004 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.004 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.005 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.005 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.005 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:30.005 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:30.005 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: Updating smithi005:/etc/ceph/ceph.conf 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: Updating smithi052:/etc/ceph/ceph.conf 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: Updating smithi189:/etc/ceph/ceph.conf 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/257672732' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: Updating smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: Updating smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: Updating smithi005:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:30.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:30.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:30.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:30.133 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-10T22:08:30.133 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:08:30.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:08:30.161 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:08:30.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:30.226 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:08:30.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:08:30.258 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:08:30.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:30.328 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:08:30.328 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.conf 2024-09-10T22:08:30.357 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:08:30.357 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-10T22:08:30.425 INFO:tasks.cephadm:Adding mgr.x on smithi005 2024-09-10T22:08:30.425 INFO:tasks.cephadm:Adding mgr.y on smithi052 2024-09-10T22:08:30.426 INFO:tasks.cephadm:Adding mgr.z on smithi189 2024-09-10T22:08:30.426 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi005=x;smithi052=y;smithi189=z' 2024-09-10T22:08:30.707 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:08:30.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:30 smithi189 ceph-mon[35784]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:30.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:30 smithi189 ceph-mon[35784]: Reconfiguring mon.a (monmap changed)... 2024-09-10T22:08:30.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:30 smithi189 ceph-mon[35784]: Reconfiguring daemon mon.a on smithi005 2024-09-10T22:08:30.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:30 smithi052 ceph-mon[34997]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:30.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:30 smithi052 ceph-mon[34997]: Reconfiguring mon.a (monmap changed)... 2024-09-10T22:08:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:30 smithi052 ceph-mon[34997]: Reconfiguring daemon mon.a on smithi005 2024-09-10T22:08:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:30 smithi005 ceph-mon[31115]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:30 smithi005 ceph-mon[31115]: Reconfiguring mon.a (monmap changed)... 2024-09-10T22:08:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:30 smithi005 ceph-mon[31115]: Reconfiguring daemon mon.a on smithi005 2024-09-10T22:08:31.305 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mgr update... 2024-09-10T22:08:31.927 DEBUG:teuthology.orchestra.run.smithi052:mgr.y> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.y.service 2024-09-10T22:08:31.930 DEBUG:teuthology.orchestra.run.smithi189:mgr.z> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.z.service 2024-09-10T22:08:31.932 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-10T22:08:31.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-10T22:08:31.935 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-10T22:08:31.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-10T22:08:31.978 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-10T22:08:31.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-10T22:08:32.021 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-10T22:08:32.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-10T22:08:32.064 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-10T22:08:32.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-10T22:08:32.107 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-10T22:08:32.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-10T22:08:32.151 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-10T22:08:32.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-10T22:08:32.195 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-10T22:08:32.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-10T22:08:32.242 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-10T22:08:32.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-10T22:08:32.275 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:32.278 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-10T22:08:32.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-10T22:08:32.315 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:32.317 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-10T22:08:32.317 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-10T22:08:32.366 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-10T22:08:32.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-10T22:08:32.409 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-10T22:08:32.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-10T22:08:32.455 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-10T22:08:32.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-10T22:08:32.509 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-10T22:08:32.509 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: Reconfiguring mon.b (monmap changed)... 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: Reconfiguring daemon mon.b on smithi052 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi052=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:32.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: Saving service mgr spec with placement smithi005=x;smithi052=y;smithi189=z;count:3 2024-09-10T22:08:32.532 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.534 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-10T22:08:32.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-10T22:08:32.577 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-10T22:08:32.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: Reconfiguring mon.b (monmap changed)... 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: Reconfiguring daemon mon.b on smithi052 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi052=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:32.621 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: Saving service mgr spec with placement smithi005=x;smithi052=y;smithi189=z;count:3 2024-09-10T22:08:32.622 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.634 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-10T22:08:32.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-10T22:08:32.686 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-10T22:08:32.687 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-10T22:08:32.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: Reconfiguring mon.b (monmap changed)... 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: Reconfiguring daemon mon.b on smithi052 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi005=x;smithi052=y;smithi189=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: Saving service mgr spec with placement smithi005=x;smithi052=y;smithi189=z;count:3 2024-09-10T22:08:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:32.739 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-10T22:08:32.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-10T22:08:32.783 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-10T22:08:32.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-10T22:08:32.838 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-10T22:08:32.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-10T22:08:32.901 DEBUG:tasks.cephadm:set 22 configs 2024-09-10T22:08:32.901 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi005') 2024-09-10T22:08:33.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:33 smithi005 ceph-mon[31115]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:33.309 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:33.309 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:33.309 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:33.309 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:33.310 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:33.335 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:33 smithi189 ceph-mon[35784]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:33.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:33 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:33.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:33 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:33.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:33 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:33.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:33 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:33.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:33 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:33 smithi052 ceph-mon[34997]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:33.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:33 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:33.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:33 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:33.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:33 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-10T22:08:33.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:33 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-10T22:08:33.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:33 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: Reconfiguring mon.c (monmap changed)... 2024-09-10T22:08:34.424 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: Reconfiguring daemon mon.c on smithi189 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1449262994' entity='client.admin' 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2837040721' entity='client.admin' 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:34.425 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.445 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:34.468 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi005') 2024-09-10T22:08:34.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: Reconfiguring mon.c (monmap changed)... 2024-09-10T22:08:34.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: Reconfiguring daemon mon.c on smithi189 2024-09-10T22:08:34.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1449262994' entity='client.admin' 2024-09-10T22:08:34.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2837040721' entity='client.admin' 2024-09-10T22:08:34.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.650 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:34.651 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: Reconfiguring mon.c (monmap changed)... 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: Reconfiguring daemon mon.c on smithi189 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1449262994' entity='client.admin' 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2837040721' entity='client.admin' 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:34.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:34.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:34.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:08:34.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:34.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:34.878 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:34.909 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:34.922 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:34.925 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi005') 2024-09-10T22:08:35.162 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:35.163 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:35.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:35 smithi189 ceph-mon[35784]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:35.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:35 smithi189 ceph-mon[35784]: Deploying daemon mgr.z on smithi189 2024-09-10T22:08:35.448 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:35 smithi005 ceph-mon[31115]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:35.448 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:35 smithi005 ceph-mon[31115]: Deploying daemon mgr.z on smithi189 2024-09-10T22:08:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:35 smithi052 ceph-mon[34997]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:35 smithi052 ceph-mon[34997]: Deploying daemon mgr.z on smithi189 2024-09-10T22:08:35.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 -- 172.21.15.5:0/7421374 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68fc03f510 msgr2=0x7f68fc0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 --2- 172.21.15.5:0/7421374 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68fc03f510 0x7f68fc0419d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f68f800bbe0 tx=0x7f68f800b390 comp rx=0 tx=0).stop 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 -- 172.21.15.5:0/7421374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6910102a40 msgr2=0x7f6910198ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 --2- 172.21.15.5:0/7421374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6910102a40 0x7f6910198ad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f690000c920 tx=0x7f690000cde0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 -- 172.21.15.5:0/7421374 shutdown_connections 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 --2- 172.21.15.5:0/7421374 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68fc03f510 0x7f68fc0419d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 --2- 172.21.15.5:0/7421374 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6910104560 0x7f6910199d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 --2- 172.21.15.5:0/7421374 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6910103ba0 0x7f6910199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 --2- 172.21.15.5:0/7421374 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6910102a40 0x7f6910198ad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 -- 172.21.15.5:0/7421374 >> 172.21.15.5:0/7421374 conn(0x7f69100fe2f0 msgr2=0x7f6910106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 -- 172.21.15.5:0/7421374 shutdown_connections 2024-09-10T22:08:35.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.745+0000 7f6916b53640 1 -- 172.21.15.5:0/7421374 wait complete. 2024-09-10T22:08:35.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.832+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f97e0109dd0 con 0x7f97e0102a50 2024-09-10T22:08:35.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.836+0000 7f97dd7fa640 1 -- 172.21.15.5:0/4093643927 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v13)=0 v13) ==== 106+0+0 (secure 0 0 0) 0x7f97d002fdc0 con 0x7f97e0102a50 2024-09-10T22:08:35.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97c803f510 msgr2=0x7f97c80419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 --2- 172.21.15.5:0/4093643927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97c803f510 0x7f97c80419d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97d4005e10 tx=0x7f97d4005da0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e0102a50 msgr2=0x7f97e0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 --2- 172.21.15.5:0/4093643927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e0102a50 0x7f97e0198ae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f97d00057c0 tx=0x7f97d00043b0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 shutdown_connections 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 --2- 172.21.15.5:0/4093643927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97c803f510 0x7f97c80419d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 --2- 172.21.15.5:0/4093643927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f97e0104570 0x7f97e0199d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 --2- 172.21.15.5:0/4093643927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f97e0103bb0 0x7f97e0199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 --2- 172.21.15.5:0/4093643927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f97e0102a50 0x7f97e0198ae0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 >> 172.21.15.5:0/4093643927 conn(0x7f97e00fe320 msgr2=0x7f97e0106fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 shutdown_connections 2024-09-10T22:08:35.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:35.838+0000 7f97e648f640 1 -- 172.21.15.5:0/4093643927 wait complete. 2024-09-10T22:08:35.859 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:35 smithi189 systemd[1]: Starting Ceph mgr.z for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:08:35.963 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:36.110 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:35 smithi189 podman[37343]: 2024-09-10 22:08:35.760485253 +0000 UTC m=+0.016363470 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:08:36.110 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:35 smithi189 podman[37343]: 2024-09-10 22:08:35.862546586 +0000 UTC m=+0.118424855 container create 4db7ef2f0d5505df2b2f4f16e9ce8f37b5276267640aa02d3419598f10c2be59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-z, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T22:08:36.110 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:36 smithi189 podman[37343]: 2024-09-10 22:08:36.081860715 +0000 UTC m=+0.337738922 container init 4db7ef2f0d5505df2b2f4f16e9ce8f37b5276267640aa02d3419598f10c2be59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-z, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T22:08:36.110 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:36 smithi189 podman[37343]: 2024-09-10 22:08:36.084534971 +0000 UTC m=+0.340413179 container start 4db7ef2f0d5505df2b2f4f16e9ce8f37b5276267640aa02d3419598f10c2be59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T22:08:36.190 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:36.190 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:36.443 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mgr[37362]: -- 172.21.15.189:0/2423635425 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea2a8d90e0 con 0x55ea2a8b7400 2024-09-10T22:08:36.443 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:36 smithi189 bash[37343]: 4db7ef2f0d5505df2b2f4f16e9ce8f37b5276267640aa02d3419598f10c2be59 2024-09-10T22:08:36.444 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:08:36 smithi189 systemd[1]: Started Ceph mgr.z for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:08:36.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/7421374' entity='client.admin' 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/4093643927' entity='client.admin' 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:36 smithi052 ceph-mon[34997]: Deploying daemon mgr.y on smithi052 2024-09-10T22:08:37.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:37.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/7421374' entity='client.admin' 2024-09-10T22:08:37.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4093643927' entity='client.admin' 2024-09-10T22:08:37.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:37.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:36 smithi005 ceph-mon[31115]: Deploying daemon mgr.y on smithi052 2024-09-10T22:08:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/7421374' entity='client.admin' 2024-09-10T22:08:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/4093643927' entity='client.admin' 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:37.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:36 smithi189 ceph-mon[35784]: Deploying daemon mgr.y on smithi052 2024-09-10T22:08:37.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 -- 172.21.15.5:0/2200876805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00102a40 msgr2=0x7fbf00102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 --2- 172.21.15.5:0/2200876805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00102a40 0x7fbf00102e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009930 tx=0x7fbef002a420 comp rx=0 tx=0).stop 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 -- 172.21.15.5:0/2200876805 shutdown_connections 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 --2- 172.21.15.5:0/2200876805 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf00104560 0x7fbf0010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 --2- 172.21.15.5:0/2200876805 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00103ba0 0x7fbf00104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 --2- 172.21.15.5:0/2200876805 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00102a40 0x7fbf00102e40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 -- 172.21.15.5:0/2200876805 >> 172.21.15.5:0/2200876805 conn(0x7fbf000fe2f0 msgr2=0x7fbf00100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 -- 172.21.15.5:0/2200876805 shutdown_connections 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.579+0000 7fbf04f15640 1 -- 172.21.15.5:0/2200876805 wait complete. 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 Processor -- start 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 -- start start 2024-09-10T22:08:37.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00102a40 0x7fbf00198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 0x7fbf00199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf00104560 0x7fbf00199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0010e4a0 con 0x7fbf00103ba0 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0010e320 con 0x7fbf00102a40 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbf04f15640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0010e620 con 0x7fbf00104560 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 0x7fbf00199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbef7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 0x7fbf00199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44474/0 (socket says 172.21.15.5:44474) 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbef7fff640 1 -- 172.21.15.5:0/1191855156 learned_addr learned my addr 172.21.15.5:0/1191855156 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbefed9d640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf00104560 0x7fbf00199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.580+0000 7fbefe59c640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00102a40 0x7fbf00198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef7fff640 1 -- 172.21.15.5:0/1191855156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf00104560 msgr2=0x7fbf00199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef7fff640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf00104560 0x7fbf00199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef7fff640 1 -- 172.21.15.5:0/1191855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00102a40 msgr2=0x7fbf00198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef7fff640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00102a40 0x7fbf00198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef7fff640 1 -- 172.21.15.5:0/1191855156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0019a830 con 0x7fbf00103ba0 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbefe59c640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00102a40 0x7fbf00198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef7fff640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 0x7fbf00199350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbee800b4a0 tx=0x7fbee800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8014070 con 0x7fbf00103ba0 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fbee8010a80 con 0x7fbf00103ba0 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0019ab20 con 0x7fbf00103ba0 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8017ad0 con 0x7fbf00103ba0 2024-09-10T22:08:37.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.581+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf001a1200 con 0x7fbf00103ba0 2024-09-10T22:08:37.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.582+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7fbee8017c70 con 0x7fbf00103ba0 2024-09-10T22:08:37.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.582+0000 7fbef77fe640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbeec03f510 0x7fbeec0419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.582+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf00102e40 con 0x7fbf00103ba0 2024-09-10T22:08:37.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.582+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbee80535a0 con 0x7fbf00103ba0 2024-09-10T22:08:37.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.582+0000 7fbefe59c640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbeec03f510 0x7fbeec0419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.583+0000 7fbefe59c640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbeec03f510 0x7fbeec0419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbef0000c00 tx=0x7fbef0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:37.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.587+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbee801ad60 con 0x7fbf00103ba0 2024-09-10T22:08:37.778 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.777+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fbf001a1430 con 0x7fbf00103ba0 2024-09-10T22:08:37.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 -- 172.21.15.5:0/1841647624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528101910 msgr2=0x7f2528101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 --2- 172.21.15.5:0/1841647624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528101910 0x7f2528101d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2524009cd0 tx=0x7f252402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 -- 172.21.15.5:0/1841647624 shutdown_connections 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 --2- 172.21.15.5:0/1841647624 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2528103430 0x7f2528109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 --2- 172.21.15.5:0/1841647624 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528102a70 0x7f2528102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 --2- 172.21.15.5:0/1841647624 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528101910 0x7f2528101d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 -- 172.21.15.5:0/1841647624 >> 172.21.15.5:0/1841647624 conn(0x7f25280fd1e0 msgr2=0x7f25280ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 -- 172.21.15.5:0/1841647624 shutdown_connections 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 -- 172.21.15.5:0/1841647624 wait complete. 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.773+0000 7f252f851640 1 Processor -- start 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 -- start start 2024-09-10T22:08:37.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528101910 0x7f2528198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 0x7f25281992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2528103430 0x7f2528199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f252810d2f0 con 0x7f2528102a70 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f252810d170 con 0x7f2528101910 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252f851640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f252810d470 con 0x7f2528103430 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 0x7f25281992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 0x7f25281992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44496/0 (socket says 172.21.15.5:44496) 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 -- 172.21.15.5:0/1564574843 learned_addr learned my addr 172.21.15.5:0/1564574843 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252ddee640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2528103430 0x7f2528199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252d5ed640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528101910 0x7f2528198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 -- 172.21.15.5:0/1564574843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2528103430 msgr2=0x7f2528199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2528103430 0x7f2528199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 -- 172.21.15.5:0/1564574843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528101910 msgr2=0x7f2528198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528101910 0x7f2528198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 -- 172.21.15.5:0/1564574843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252819a780 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252d5ed640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528101910 0x7f2528198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.774+0000 7f252cdec640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 0x7f25281992a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f251800e9f0 tx=0x7f251800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.775+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251800ccc0 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.775+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f25180108a0 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.775+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252819aa70 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.775+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2518018660 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.775+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25281a1150 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.776+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7f2518010430 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.776+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2528101d10 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.776+0000 7f251e7fc640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f251403f510 0x7f25140419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.776+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2518054080 con 0x7f2528102a70 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.776+0000 7f252d5ed640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f251403f510 0x7f25140419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:37.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.777+0000 7f252d5ed640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f251403f510 0x7f25140419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2524031590 tx=0x7f2524009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.781+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f251800b2c0 con 0x7f2528102a70 2024-09-10T22:08:37.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.783+0000 7fbef77fe640 1 -- 172.21.15.5:0/1191855156 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v14)=0 v14) ==== 117+0+0 (secure 0 0 0) 0x7fbee801dd00 con 0x7fbf00103ba0 2024-09-10T22:08:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbeec03f510 msgr2=0x7fbeec0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbeec03f510 0x7fbeec0419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbef0000c00 tx=0x7fbef0005a20 comp rx=0 tx=0).stop 2024-09-10T22:08:37.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 msgr2=0x7fbf00199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 0x7fbf00199350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fbee800b4a0 tx=0x7fbee800b960 comp rx=0 tx=0).stop 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 shutdown_connections 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbeec03f510 0x7fbeec0419d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbf00104560 0x7fbf00199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbf00103ba0 0x7fbf00199350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 --2- 172.21.15.5:0/1191855156 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbf00102a40 0x7fbf00198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 >> 172.21.15.5:0/1191855156 conn(0x7fbf000fe2f0 msgr2=0x7fbf00105020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 shutdown_connections 2024-09-10T22:08:37.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.786+0000 7fbf04f15640 1 -- 172.21.15.5:0/1191855156 wait complete. 2024-09-10T22:08:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.974+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f25281a1320 con 0x7f2528102a70 2024-09-10T22:08:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.977+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7f2518018800 con 0x7f2528102a70 2024-09-10T22:08:37.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.978+0000 7f251e7fc640 1 -- 172.21.15.5:0/1564574843 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f25180168f0 con 0x7f2528102a70 2024-09-10T22:08:37.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f251403f510 msgr2=0x7f25140419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f251403f510 0x7f25140419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2524031590 tx=0x7f2524009360 comp rx=0 tx=0).stop 2024-09-10T22:08:37.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 msgr2=0x7f25281992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:37.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 0x7f25281992a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f251800e9f0 tx=0x7f251800edf0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 shutdown_connections 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f251403f510 0x7f25140419d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2528103430 0x7f2528199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2528102a70 0x7f25281992a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 --2- 172.21.15.5:0/1564574843 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2528101910 0x7f2528198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 >> 172.21.15.5:0/1564574843 conn(0x7f25280fd1e0 msgr2=0x7f252806ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 shutdown_connections 2024-09-10T22:08:37.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:37.980+0000 7f252f851640 1 -- 172.21.15.5:0/1564574843 wait complete. 2024-09-10T22:08:38.249 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 systemd[1]: Starting Ceph mgr.y for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:08:38.632 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 podman[36121]: 2024-09-10 22:08:38.377789515 +0000 UTC m=+0.113232494 container create 211f7d5ca89b51988574706b439cdd004c0dc3a9e3fae4087d103b6912538088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-y, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:08:38.632 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 podman[36121]: 2024-09-10 22:08:38.280610532 +0000 UTC m=+0.016053514 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:08:38.632 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 podman[36121]: 2024-09-10 22:08:38.631120573 +0000 UTC m=+0.366563553 container init 211f7d5ca89b51988574706b439cdd004c0dc3a9e3fae4087d103b6912538088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-y, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 -- 172.21.15.5:0/4096294518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4102a70 msgr2=0x7ff0f4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 --2- 172.21.15.5:0/4096294518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4102a70 0x7ff0f4102ef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009930 tx=0x7ff0e402a420 comp rx=0 tx=0).stop 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 -- 172.21.15.5:0/4096294518 shutdown_connections 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 --2- 172.21.15.5:0/4096294518 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f4103430 0x7ff0f4109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 --2- 172.21.15.5:0/4096294518 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4102a70 0x7ff0f4102ef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 --2- 172.21.15.5:0/4096294518 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4101910 0x7ff0f4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 -- 172.21.15.5:0/4096294518 >> 172.21.15.5:0/4096294518 conn(0x7ff0f40fd1e0 msgr2=0x7ff0f40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 -- 172.21.15.5:0/4096294518 shutdown_connections 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.628+0000 7ff0fba83640 1 -- 172.21.15.5:0/4096294518 wait complete. 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 Processor -- start 2024-09-10T22:08:38.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 -- start start 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 0x7ff0f4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4102a70 0x7ff0f4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f4103430 0x7ff0f4199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410e590 con 0x7ff0f4101910 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410e410 con 0x7ff0f4103430 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fba83640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410e710 con 0x7ff0f4102a70 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 0x7ff0f4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 0x7ff0f4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44512/0 (socket says 172.21.15.5:44512) 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 -- 172.21.15.5:0/1744449017 learned_addr learned my addr 172.21.15.5:0/1744449017 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f901e640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4102a70 0x7ff0f4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0fa020640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f4103430 0x7ff0f4199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 -- 172.21.15.5:0/1744449017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4102a70 msgr2=0x7ff0f4199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4102a70 0x7ff0f4199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 -- 172.21.15.5:0/1744449017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f4103430 msgr2=0x7ff0f4199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:38.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.629+0000 7ff0f981f640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f4103430 0x7ff0f4199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0f981f640 1 -- 172.21.15.5:0/1744449017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f419a850 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0f901e640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4102a70 0x7ff0f4199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0f981f640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 0x7ff0f4198d20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000e9f0 tx=0x7ff0f000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000cd80 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff0f00054b0 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f419ab40 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0010430 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.630+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f41a1220 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.631+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7ff0f00105f0 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.631+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f4101d10 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.631+0000 7ff0eaffd640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff0e003f510 0x7ff0e00419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.631+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff0f0054220 con 0x7ff0f4101910 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.631+0000 7ff0f901e640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff0e003f510 0x7ff0e00419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:38.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.632+0000 7ff0f901e640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff0e003f510 0x7ff0e00419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009900 tx=0x7ff0e4005720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:38.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.636+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff0f0016330 con 0x7ff0f4101910 2024-09-10T22:08:38.647 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.653 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.654 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.655 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.657 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.660 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:38.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.861+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7ff0f4063d50 con 0x7ff0f4101910 2024-09-10T22:08:38.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.865+0000 7ff0eaffd640 1 -- 172.21.15.5:0/1744449017 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v16)=0 v16) ==== 127+0+0 (secure 0 0 0) 0x7ff0f0010910 con 0x7ff0f4101910 2024-09-10T22:08:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff0e003f510 msgr2=0x7ff0e00419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff0e003f510 0x7ff0e00419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009900 tx=0x7ff0e4005720 comp rx=0 tx=0).stop 2024-09-10T22:08:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 msgr2=0x7ff0f4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 0x7ff0f4198d20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff0f000e9f0 tx=0x7ff0f000edf0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 shutdown_connections 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff0e003f510 0x7ff0e00419d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff0f4103430 0x7ff0f4199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff0f4102a70 0x7ff0f4199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 --2- 172.21.15.5:0/1744449017 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff0f4101910 0x7ff0f4198d20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 >> 172.21.15.5:0/1744449017 conn(0x7ff0f40fd1e0 msgr2=0x7ff0f4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 shutdown_connections 2024-09-10T22:08:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:38.868+0000 7ff0fba83640 1 -- 172.21.15.5:0/1744449017 wait complete. 2024-09-10T22:08:38.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:38 smithi005 ceph-mon[31115]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:38.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1191855156' entity='client.admin' 2024-09-10T22:08:38.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1564574843' entity='client.admin' 2024-09-10T22:08:38.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:38 smithi052 ceph-mon[34997]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1191855156' entity='client.admin' 2024-09-10T22:08:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1564574843' entity='client.admin' 2024-09-10T22:08:39.000 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 podman[36121]: 2024-09-10 22:08:38.633895223 +0000 UTC m=+0.369338205 container start 211f7d5ca89b51988574706b439cdd004c0dc3a9e3fae4087d103b6912538088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-10T22:08:39.000 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 ceph-mgr[36140]: -- 172.21.15.52:0/3496180624 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570a71450e0 con 0x5570a7123400 2024-09-10T22:08:39.000 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 bash[36121]: 211f7d5ca89b51988574706b439cdd004c0dc3a9e3fae4087d103b6912538088 2024-09-10T22:08:39.000 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:08:38 smithi052 systemd[1]: Started Ceph mgr.y for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:08:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:38 smithi189 ceph-mon[35784]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1191855156' entity='client.admin' 2024-09-10T22:08:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1564574843' entity='client.admin' 2024-09-10T22:08:40.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1744449017' entity='client.admin' 2024-09-10T22:08:40.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:40.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1744449017' entity='client.admin' 2024-09-10T22:08:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1744449017' entity='client.admin' 2024-09-10T22:08:40.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:40.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.309+0000 7f900f4b8640 1 -- 172.21.15.5:0/1687606024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 msgr2=0x7f9008102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.309+0000 7f900f4b8640 1 --2- 172.21.15.5:0/1687606024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008102e40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9004009930 tx=0x7f900402a420 comp rx=0 tx=0).stop 2024-09-10T22:08:40.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 -- 172.21.15.5:0/1687606024 shutdown_connections 2024-09-10T22:08:40.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 --2- 172.21.15.5:0/1687606024 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008104560 0x7f900810aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 --2- 172.21.15.5:0/1687606024 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9008103ba0 0x7f9008104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 --2- 172.21.15.5:0/1687606024 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008102e40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 -- 172.21.15.5:0/1687606024 >> 172.21.15.5:0/1687606024 conn(0x7f90080fe2f0 msgr2=0x7f9008100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:40.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 -- 172.21.15.5:0/1687606024 shutdown_connections 2024-09-10T22:08:40.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 -- 172.21.15.5:0/1687606024 wait complete. 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.310+0000 7f900f4b8640 1 Processor -- start 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 -- start start 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008103ba0 0x7f90081993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9008104560 0x7f9008199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f900810e580 con 0x7f9008102a40 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f900810e400 con 0x7f9008104560 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900f4b8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f900810e700 con 0x7f9008103ba0 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44530/0 (socket says 172.21.15.5:44530) 2024-09-10T22:08:40.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 -- 172.21.15.5:0/2081270389 learned_addr learned my addr 172.21.15.5:0/2081270389 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900ca53640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008103ba0 0x7f90081993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900da55640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9008104560 0x7f9008199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 -- 172.21.15.5:0/2081270389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008103ba0 msgr2=0x7f90081993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008103ba0 0x7f90081993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 -- 172.21.15.5:0/2081270389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9008104560 msgr2=0x7f9008199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9008104560 0x7f9008199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900d254640 1 -- 172.21.15.5:0/2081270389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900819a880 con 0x7f9008102a40 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.311+0000 7f900ca53640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008103ba0 0x7f90081993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.312+0000 7f900d254640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008198d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9004009a50 tx=0x7f9004004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.312+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900403f030 con 0x7f9008102a40 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.312+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9004003a80 con 0x7f9008102a40 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.312+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f900819ab10 con 0x7f9008102a40 2024-09-10T22:08:40.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.312+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9004035070 con 0x7f9008102a40 2024-09-10T22:08:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.312+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90081a1080 con 0x7f9008102a40 2024-09-10T22:08:40.316 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.313+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7f900403b960 con 0x7f9008102a40 2024-09-10T22:08:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.313+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9008102e40 con 0x7f9008102a40 2024-09-10T22:08:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.313+0000 7f8ffe7fc640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8ff403f510 0x7f8ff40419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.313+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9004074680 con 0x7f9008102a40 2024-09-10T22:08:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.313+0000 7f900ca53640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8ff403f510 0x7f8ff40419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:40.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.314+0000 7f900ca53640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8ff403f510 0x7f8ff40419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009fc0 tx=0x7f8ff8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:40.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.319+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9004003c30 con 0x7f9008102a40 2024-09-10T22:08:40.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.505+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f90081a14c0 con 0x7f9008102a40 2024-09-10T22:08:40.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.508+0000 7f8ffe7fc640 1 -- 172.21.15.5:0/2081270389 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f9004036df0 con 0x7f9008102a40 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8ff403f510 msgr2=0x7f8ff40419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8ff403f510 0x7f8ff40419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009fc0 tx=0x7f8ff8005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 msgr2=0x7f9008198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008198d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9004009a50 tx=0x7f9004004040 comp rx=0 tx=0).stop 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 shutdown_connections 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8ff403f510 0x7f8ff40419d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9008104560 0x7f9008199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9008103ba0 0x7f90081993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 --2- 172.21.15.5:0/2081270389 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9008102a40 0x7f9008198d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 >> 172.21.15.5:0/2081270389 conn(0x7f90080fe2f0 msgr2=0x7f9008104f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:40.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 shutdown_connections 2024-09-10T22:08:40.513 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:40.510+0000 7f900f4b8640 1 -- 172.21.15.5:0/2081270389 wait complete. 2024-09-10T22:08:41.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:40 smithi005 ceph-mon[31115]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:41.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.027 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:40 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2081270389' entity='client.admin' 2024-09-10T22:08:41.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:40 smithi052 ceph-mon[34997]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:41.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:40 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2081270389' entity='client.admin' 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.298+0000 7f26f81db640 1 -- 172.21.15.5:0/1278371938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0103430 msgr2=0x7f26f0109db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.298+0000 7f26f81db640 1 --2- 172.21.15.5:0/1278371938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0103430 0x7f26f0109db0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009cd0 tx=0x7f26e802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 -- 172.21.15.5:0/1278371938 shutdown_connections 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 --2- 172.21.15.5:0/1278371938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0103430 0x7f26f0109db0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 --2- 172.21.15.5:0/1278371938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0102a70 0x7f26f0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 --2- 172.21.15.5:0/1278371938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 -- 172.21.15.5:0/1278371938 >> 172.21.15.5:0/1278371938 conn(0x7f26f00fd1e0 msgr2=0x7f26f00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:41.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 -- 172.21.15.5:0/1278371938 shutdown_connections 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 -- 172.21.15.5:0/1278371938 wait complete. 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.299+0000 7f26f81db640 1 Processor -- start 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 -- start start 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f01056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0102a70 0x7f26f0103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0103430 0x7f26f0104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f26f010d430 con 0x7f26f0102a70 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f26f010d2b0 con 0x7f26f0103430 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f81db640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f26f010d5b0 con 0x7f26f0101910 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5f77640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f01056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5776640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0102a70 0x7f26f0103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5f77640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f01056d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:36834/0 (socket says 172.21.15.5:36834) 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5f77640 1 -- 172.21.15.5:0/3262252139 learned_addr learned my addr 172.21.15.5:0/3262252139 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:41.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f6778640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0103430 0x7f26f0104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5776640 1 -- 172.21.15.5:0/3262252139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 msgr2=0x7f26f01056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5776640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f01056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5776640 1 -- 172.21.15.5:0/3262252139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0103430 msgr2=0x7f26f0104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5776640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0103430 0x7f26f0104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5776640 1 -- 172.21.15.5:0/3262252139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f0104d40 con 0x7f26f0102a70 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f5f77640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f01056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.300+0000 7f26f6778640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0103430 0x7f26f0104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.301+0000 7f26f5776640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0102a70 0x7f26f0103f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00e9f0 tx=0x7f26ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.301+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00ccc0 con 0x7f26f0102a70 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.301+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f26ec0108c0 con 0x7f26f0102a70 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.301+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ec0187c0 con 0x7f26f0102a70 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.301+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f01a2de0 con 0x7f26f0102a70 2024-09-10T22:08:41.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.301+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f01a32e0 con 0x7f26f0102a70 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.302+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7f26ec018960 con 0x7f26f0102a70 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.302+0000 7f26e2ffd640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26dc03f510 0x7f26dc0419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.302+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f26ec054130 con 0x7f26f0102a70 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.302+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f0101d10 con 0x7f26f0102a70 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.302+0000 7f26f5f77640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26dc03f510 0x7f26dc0419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.303+0000 7f26f5f77640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26dc03f510 0x7f26dc0419d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f26e40095f0 tx=0x7f26e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:41.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.307+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f26ec010ae0 con 0x7f26f0102a70 2024-09-10T22:08:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.213+0000 7f1754d4c640 1 -- 172.21.15.5:0/1476109080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750108730 msgr2=0x7f175010abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.213+0000 7f1754d4c640 1 --2- 172.21.15.5:0/1476109080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750108730 0x7f175010abf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1740009ca0 tx=0x7f174002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 -- 172.21.15.5:0/1476109080 shutdown_connections 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 --2- 172.21.15.5:0/1476109080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750108730 0x7f175010abf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 --2- 172.21.15.5:0/1476109080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1750105b80 0x7f1750107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 --2- 172.21.15.5:0/1476109080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f17501055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 -- 172.21.15.5:0/1476109080 >> 172.21.15.5:0/1476109080 conn(0x7f17500fd1e0 msgr2=0x7f17500ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 -- 172.21.15.5:0/1476109080 shutdown_connections 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 -- 172.21.15.5:0/1476109080 wait complete. 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.214+0000 7f1754d4c640 1 Processor -- start 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 -- start start 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f1750198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 0x7f17501992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1750108730 0x7f1750199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f175010e570 con 0x7f1750105b80 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f175010e3f0 con 0x7f175006b6e0 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f1754d4c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f175010e6f0 con 0x7f1750108730 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 0x7f17501992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f1750198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174e59c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f1750198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:48350/0 (socket says 172.21.15.5:48350) 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 0x7f17501992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44536/0 (socket says 172.21.15.5:44536) 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174e59c640 1 -- 172.21.15.5:0/2551137950 learned_addr learned my addr 172.21.15.5:0/2551137950 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174ed9d640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1750108730 0x7f1750199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 -- 172.21.15.5:0/2551137950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1750108730 msgr2=0x7f1750199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1750108730 0x7f1750199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 -- 172.21.15.5:0/2551137950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 msgr2=0x7f1750198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f1750198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 -- 172.21.15.5:0/2551137950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175019a7d0 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174e59c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f1750198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.215+0000 7f174dd9b640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 0x7f17501992f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f173800e9c0 tx=0x7f173800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.216+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173800ccc0 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.216+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1738005020 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.216+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173800ce60 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.216+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175019aac0 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.216+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17501a11a0 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.217+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1750105fe0 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.217+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 13) ==== 51479+0+0 (secure 0 0 0) 0x7f1738004a40 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.217+0000 7f17477fe640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f173c03f510 0x7f173c0419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.217+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1738053c10 con 0x7f1750105b80 2024-09-10T22:08:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.217+0000 7f174e59c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f173c03f510 0x7f173c0419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.218+0000 7f174e59c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f173c03f510 0x7f173c0419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1748011550 tx=0x7f1748005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.222+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f173801fe30 con 0x7f1750105b80 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.410+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f175002e8c0 con 0x7f1750105b80 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.413+0000 7f17477fe640 1 -- 172.21.15.5:0/2551137950 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v18)=0 v18) ==== 119+0+0 (secure 0 0 0) 0x7f1738004d60 con 0x7f1750105b80 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.415+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f173c03f510 msgr2=0x7f173c0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.415+0000 7f1754d4c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f173c03f510 0x7f173c0419d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1748011550 tx=0x7f1748005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 msgr2=0x7f17501992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 0x7f17501992f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f173800e9c0 tx=0x7f173800ee80 comp rx=0 tx=0).stop 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 shutdown_connections 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f173c03f510 0x7f173c0419d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1750108730 0x7f1750199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1750105b80 0x7f17501992f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 --2- 172.21.15.5:0/2551137950 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f175006b6e0 0x7f1750198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 >> 172.21.15.5:0/2551137950 conn(0x7f17500fd1e0 msgr2=0x7f1750103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 shutdown_connections 2024-09-10T22:08:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.416+0000 7f1754d4c640 1 -- 172.21.15.5:0/2551137950 wait complete. 2024-09-10T22:08:41.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:40 smithi189 ceph-mon[35784]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:41.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:41.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:40 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2081270389' entity='client.admin' 2024-09-10T22:08:41.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.496+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f26f01a3630 con 0x7f26f0102a70 2024-09-10T22:08:41.501 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.499+0000 7f26e2ffd640 1 -- 172.21.15.5:0/3262252139 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v19)=0 v19) ==== 118+0+0 (secure 0 0 0) 0x7f26ec010d70 con 0x7f26f0102a70 2024-09-10T22:08:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26dc03f510 msgr2=0x7f26dc0419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26dc03f510 0x7f26dc0419d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f26e40095f0 tx=0x7f26e4005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0102a70 msgr2=0x7f26f0103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:41.504 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0102a70 0x7f26f0103f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00e9f0 tx=0x7f26ec00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 shutdown_connections 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26dc03f510 0x7f26dc0419d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f26f0103430 0x7f26f0104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f26f0102a70 0x7f26f0103f40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 --2- 172.21.15.5:0/3262252139 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f26f0101910 0x7f26f01056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 >> 172.21.15.5:0/3262252139 conn(0x7f26f00fd1e0 msgr2=0x7f26f00fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 shutdown_connections 2024-09-10T22:08:41.505 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:41.502+0000 7f26f81db640 1 -- 172.21.15.5:0/3262252139 wait complete. 2024-09-10T22:08:42.173 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: Standby manager daemon z started 2024-09-10T22:08:42.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T22:08:42.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:08:42.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T22:08:42.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:08:42.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2551137950' entity='client.admin' 2024-09-10T22:08:42.174 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:41 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3262252139' entity='client.admin' 2024-09-10T22:08:42.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: Standby manager daemon z started 2024-09-10T22:08:42.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T22:08:42.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:08:42.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T22:08:42.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:08:42.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2551137950' entity='client.admin' 2024-09-10T22:08:42.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:41 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3262252139' entity='client.admin' 2024-09-10T22:08:42.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: Standby manager daemon z started 2024-09-10T22:08:42.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-10T22:08:42.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:08:42.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-10T22:08:42.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.189:0/3557928063' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:08:42.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2551137950' entity='client.admin' 2024-09-10T22:08:42.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:41 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3262252139' entity='client.admin' 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 -- 172.21.15.5:0/4211561513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 msgr2=0x7f424410ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 --2- 172.21.15.5:0/4211561513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f424410ad20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f423c009930 tx=0x7f423c02a420 comp rx=0 tx=0).stop 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 -- 172.21.15.5:0/4211561513 shutdown_connections 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 --2- 172.21.15.5:0/4211561513 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f424410ad20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 --2- 172.21.15.5:0/4211561513 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f42441039e0 0x7f4244103e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 --2- 172.21.15.5:0/4211561513 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4244102880 0x7f4244102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 -- 172.21.15.5:0/4211561513 >> 172.21.15.5:0/4211561513 conn(0x7f42440fe150 msgr2=0x7f4244100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 -- 172.21.15.5:0/4211561513 shutdown_connections 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.171+0000 7f4243fff640 1 -- 172.21.15.5:0/4211561513 wait complete. 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 Processor -- start 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 -- start start 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4244102880 0x7f4244076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42441039e0 0x7f4244075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f4244075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f424410e410 con 0x7f42441043a0 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f424410e290 con 0x7f4244102880 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4243fff640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f424410e590 con 0x7f42441039e0 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f42437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f4244075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f42437fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f4244075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55462/0 (socket says 172.21.15.5:55462) 2024-09-10T22:08:42.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f42437fe640 1 -- 172.21.15.5:0/3571067912 learned_addr learned my addr 172.21.15.5:0/3571067912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.172+0000 7f4242ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4244102880 0x7f4244076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f42427fc640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42441039e0 0x7f4244075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4242ffd640 1 -- 172.21.15.5:0/3571067912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42441039e0 msgr2=0x7f4244075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4242ffd640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42441039e0 0x7f4244075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4242ffd640 1 -- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 msgr2=0x7f4244075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4242ffd640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f4244075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4242ffd640 1 -- 172.21.15.5:0/3571067912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4244076340 con 0x7f4244102880 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f42437fe640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f4244075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4242ffd640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4244102880 0x7f4244076cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4234005fd0 tx=0x7f423400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423400cd80 con 0x7f4244102880 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4234005020 con 0x7f4244102880 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42441a2ae0 con 0x7f4244102880 2024-09-10T22:08:42.533 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340116d0 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.173+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42441a2ff0 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.175+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4244102c80 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.175+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 14) ==== 102336+0+0 (secure 0 0 0) 0x7f423400f040 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.176+0000 7f4248a01640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f422c07a450 0x7f422c07c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.176+0000 7f42427fc640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f422c07a450 0x7f422c07c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.176+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f423409be80 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.176+0000 7f42427fc640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f422c07a450 0x7f422c07c910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4238009b60 tx=0x7f4238005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.180+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4234016030 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.367+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f424402e830 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.371+0000 7f4248a01640 1 -- 172.21.15.5:0/3571067912 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v20)=0 v20) ==== 120+0+0 (secure 0 0 0) 0x7f4234064560 con 0x7f4244102880 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f422c07a450 msgr2=0x7f422c07c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f422c07a450 0x7f422c07c910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4238009b60 tx=0x7f4238005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4244102880 msgr2=0x7f4244076cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:42.534 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4244102880 0x7f4244076cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4234005fd0 tx=0x7f423400ee80 comp rx=0 tx=0).stop 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 shutdown_connections 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f422c07a450 0x7f422c07c910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f42441043a0 0x7f4244075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f42441039e0 0x7f4244075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 --2- 172.21.15.5:0/3571067912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4244102880 0x7f4244076cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.373+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 >> 172.21.15.5:0/3571067912 conn(0x7f42440fe150 msgr2=0x7f4244106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.374+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 shutdown_connections 2024-09-10T22:08:42.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:42.374+0000 7f4243fff640 1 -- 172.21.15.5:0/3571067912 wait complete. 2024-09-10T22:08:43.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:42 smithi005 ceph-mon[31115]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:43.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:42 smithi005 ceph-mon[31115]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-10T22:08:43.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:42 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T22:08:43.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:42 smithi005 ceph-mon[31115]: from='client.? ' entity='client.admin' 2024-09-10T22:08:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:42 smithi052 ceph-mon[34997]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:42 smithi052 ceph-mon[34997]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-10T22:08:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:42 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T22:08:43.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:42 smithi052 ceph-mon[34997]: from='client.? ' entity='client.admin' 2024-09-10T22:08:43.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 -- 172.21.15.5:0/3763214232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c108730 msgr2=0x7f151c10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 --2- 172.21.15.5:0/3763214232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c108730 0x7f151c10abf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1514009900 tx=0x7f151402a3f0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 -- 172.21.15.5:0/3763214232 shutdown_connections 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 --2- 172.21.15.5:0/3763214232 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c108730 0x7f151c10abf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 --2- 172.21.15.5:0/3763214232 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 0x7f151c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 --2- 172.21.15.5:0/3763214232 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c06b6e0 0x7f151c1055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 -- 172.21.15.5:0/3763214232 >> 172.21.15.5:0/3763214232 conn(0x7f151c0fd1e0 msgr2=0x7f151c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 -- 172.21.15.5:0/3763214232 shutdown_connections 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 -- 172.21.15.5:0/3763214232 wait complete. 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 Processor -- start 2024-09-10T22:08:43.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 -- start start 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 0x7f151c19ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.198+0000 7f1523a10640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 0x7f151c19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1523a10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c108730 0x7f151c19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1523a10640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f151c10e540 con 0x7f151c06b6e0 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1523a10640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f151c10e3c0 con 0x7f151c108730 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1523a10640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f151c10e6c0 con 0x7f151c105b80 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 0x7f151c19ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 0x7f151c19ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55466/0 (socket says 172.21.15.5:55466) 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 -- 172.21.15.5:0/389316250 learned_addr learned my addr 172.21.15.5:0/389316250 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1521fad640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c108730 0x7f151c19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1520fab640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 0x7f151c19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 -- 172.21.15.5:0/389316250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 msgr2=0x7f151c19b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 0x7f151c19b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 -- 172.21.15.5:0/389316250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c108730 msgr2=0x7f151c19c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c108730 0x7f151c19c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 -- 172.21.15.5:0/389316250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151c19c960 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1520fab640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 0x7f151c19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f15217ac640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 0x7f151c19ae30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f150c00ebc0 tx=0x7f150c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c010630 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f150c010c60 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c018b10 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f151c19cc50 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.199+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f151c1a3330 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.200+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151c105fe0 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.201+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 14) ==== 102336+0+0 (secure 0 0 0) 0x7f150c018cb0 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.202+0000 7f151a7fc640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f150407a3b0 0x7f150407c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.202+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f150c09c340 con 0x7f151c06b6e0 2024-09-10T22:08:43.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.202+0000 7f1520fab640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f150407a3b0 0x7f150407c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.202+0000 7f1520fab640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f150407a3b0 0x7f150407c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f151c06bb90 tx=0x7f1510005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:43.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.206+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f150c064a20 con 0x7f151c06b6e0 2024-09-10T22:08:43.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.395+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f151c1a3500 con 0x7f151c06b6e0 2024-09-10T22:08:43.400 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.398+0000 7f151a7fc640 1 -- 172.21.15.5:0/389316250 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v21)=0 v21) ==== 108+0+0 (secure 0 0 0) 0x7f150c069450 con 0x7f151c06b6e0 2024-09-10T22:08:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f150407a3b0 msgr2=0x7f150407c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f150407a3b0 0x7f150407c870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f151c06bb90 tx=0x7f1510005d90 comp rx=0 tx=0).stop 2024-09-10T22:08:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 msgr2=0x7f151c19ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 0x7f151c19ae30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f150c00ebc0 tx=0x7f150c00c6a0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 shutdown_connections 2024-09-10T22:08:43.403 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f150407a3b0 0x7f150407c870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f151c108730 0x7f151c19c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f151c105b80 0x7f151c19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 --2- 172.21.15.5:0/389316250 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f151c06b6e0 0x7f151c19ae30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 >> 172.21.15.5:0/389316250 conn(0x7f151c0fd1e0 msgr2=0x7f151c0ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 shutdown_connections 2024-09-10T22:08:43.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.400+0000 7f1523a10640 1 -- 172.21.15.5:0/389316250 wait complete. 2024-09-10T22:08:43.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:42 smithi189 ceph-mon[35784]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:43.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:42 smithi189 ceph-mon[35784]: mgrmap e14: x(active, since 68s), standbys: z 2024-09-10T22:08:43.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:42 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-10T22:08:43.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:42 smithi189 ceph-mon[35784]: from='client.? ' entity='client.admin' 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 -- 172.21.15.5:0/818548183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 msgr2=0x7f1658108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 --2- 172.21.15.5:0/818548183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f1658108030 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f164c009900 tx=0x7f164c02a410 comp rx=0 tx=0).stop 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 -- 172.21.15.5:0/818548183 shutdown_connections 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 --2- 172.21.15.5:0/818548183 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1658108770 0x7f165810ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 --2- 172.21.15.5:0/818548183 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f1658108030 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 --2- 172.21.15.5:0/818548183 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f165806c0c0 0x7f1658105630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 -- 172.21.15.5:0/818548183 >> 172.21.15.5:0/818548183 conn(0x7f16580fd200 msgr2=0x7f16580ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:43.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 -- 172.21.15.5:0/818548183 shutdown_connections 2024-09-10T22:08:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.938+0000 7f165d3f2640 1 -- 172.21.15.5:0/818548183 wait complete. 2024-09-10T22:08:43.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 Processor -- start 2024-09-10T22:08:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 -- start start 2024-09-10T22:08:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806c0c0 0x7f165819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f165819b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1658108770 0x7f165819c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f165810e580 con 0x7f1658105bc0 2024-09-10T22:08:43.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f165810e400 con 0x7f165806c0c0 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f165d3f2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f165810e700 con 0x7f1658108770 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f16567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f165819b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f1656ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806c0c0 0x7f165819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f16567fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f165819b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55494/0 (socket says 172.21.15.5:55494) 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.939+0000 7f16567fc640 1 -- 172.21.15.5:0/2178068301 learned_addr learned my addr 172.21.15.5:0/2178068301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16577fe640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1658108770 0x7f165819c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16567fc640 1 -- 172.21.15.5:0/2178068301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1658108770 msgr2=0x7f165819c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16567fc640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1658108770 0x7f165819c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16567fc640 1 -- 172.21.15.5:0/2178068301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806c0c0 msgr2=0x7f165819af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16567fc640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806c0c0 0x7f165819af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16567fc640 1 -- 172.21.15.5:0/2178068301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165819caa0 con 0x7f1658105bc0 2024-09-10T22:08:43.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f1656ffd640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806c0c0 0x7f165819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f16567fc640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f165819b5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f164c031440 tx=0x7f164c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c03f030 con 0x7f1658105bc0 2024-09-10T22:08:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f164c003a80 con 0x7f1658105bc0 2024-09-10T22:08:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f164c035070 con 0x7f1658105bc0 2024-09-10T22:08:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165819cd30 con 0x7f1658105bc0 2024-09-10T22:08:43.945 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.940+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16581a32a0 con 0x7f1658105bc0 2024-09-10T22:08:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.941+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1658106020 con 0x7f1658105bc0 2024-09-10T22:08:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.942+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 14) ==== 102336+0+0 (secure 0 0 0) 0x7f164c0035f0 con 0x7f1658105bc0 2024-09-10T22:08:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.942+0000 7f163ffff640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f164007a3b0 0x7f164007c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.942+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f164c0bc620 con 0x7f1658105bc0 2024-09-10T22:08:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.942+0000 7f1656ffd640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f164007a3b0 0x7f164007c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:43.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.943+0000 7f1656ffd640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f164007a3b0 0x7f164007c870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1648005fd0 tx=0x7f164800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:43.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:43.947+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f164c084c60 con 0x7f1658105bc0 2024-09-10T22:08:44.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.133+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f16581a36b0 con 0x7f1658105bc0 2024-09-10T22:08:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.137+0000 7f163ffff640 1 -- 172.21.15.5:0/2178068301 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f164c089690 con 0x7f1658105bc0 2024-09-10T22:08:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f164007a3b0 msgr2=0x7f164007c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:44.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f164007a3b0 0x7f164007c870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1648005fd0 tx=0x7f164800b390 comp rx=0 tx=0).stop 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 msgr2=0x7f165819b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f165819b5c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f164c031440 tx=0x7f164c004270 comp rx=0 tx=0).stop 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 shutdown_connections 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f164007a3b0 0x7f164007c870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1658108770 0x7f165819c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1658105bc0 0x7f165819b5c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 --2- 172.21.15.5:0/2178068301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f165806c0c0 0x7f165819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 >> 172.21.15.5:0/2178068301 conn(0x7f16580fd200 msgr2=0x7f16580ff5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 shutdown_connections 2024-09-10T22:08:44.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:44.139+0000 7f165d3f2640 1 -- 172.21.15.5:0/2178068301 wait complete. 2024-09-10T22:08:44.483 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-09-10T22:08:44.668 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/389316250' entity='client.admin' 2024-09-10T22:08:44.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: Standby manager daemon y started 2024-09-10T22:08:44.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T22:08:44.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:08:44.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T22:08:44.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:08:44.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:44 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2178068301' entity='client.admin' 2024-09-10T22:08:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/389316250' entity='client.admin' 2024-09-10T22:08:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: Standby manager daemon y started 2024-09-10T22:08:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T22:08:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:08:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T22:08:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:08:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:44 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2178068301' entity='client.admin' 2024-09-10T22:08:44.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/389316250' entity='client.admin' 2024-09-10T22:08:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: Standby manager daemon y started 2024-09-10T22:08:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-10T22:08:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-10T22:08:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-10T22:08:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: from='mgr.? 172.21.15.52:0/3302601742' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-10T22:08:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:44 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2178068301' entity='client.admin' 2024-09-10T22:08:45.486 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:45 smithi005 ceph-mon[31115]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:45.486 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:45 smithi005 ceph-mon[31115]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-10T22:08:45.487 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:45 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T22:08:45.487 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:45 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:45.487 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:45 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:45.487 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:45 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:45 smithi189 ceph-mon[35784]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:45 smithi189 ceph-mon[35784]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-10T22:08:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:45 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T22:08:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:45 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:45 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:45 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:45.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:45 smithi052 ceph-mon[34997]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:45.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:45 smithi052 ceph-mon[34997]: mgrmap e15: x(active, since 70s), standbys: z, y 2024-09-10T22:08:45.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:45 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-10T22:08:45.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:45 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:45.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:45 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:45.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:45 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/1065135270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f006c0c0 msgr2=0x7fa5f0105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/1065135270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0105630 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec009ca0 tx=0x7fa5ec02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/1065135270 shutdown_connections 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/1065135270 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5f0108770 0x7fa5f010ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/1065135270 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f0105bc0 0x7fa5f0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/1065135270 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0105630 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/1065135270 >> 172.21.15.5:0/1065135270 conn(0x7fa5f00fd200 msgr2=0x7fa5f00ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/1065135270 shutdown_connections 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.783+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/1065135270 wait complete. 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 Processor -- start 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 -- start start 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5f0105bc0 0x7fa5f01015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 0x7fa5f0101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f010e5b0 con 0x7fa5f0108770 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f010e430 con 0x7fa5f006c0c0 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f7ac1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f010e730 con 0x7fa5f0105bc0 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f605e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 0x7fa5f0101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f605e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 0x7fa5f0101b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55506/0 (socket says 172.21.15.5:55506) 2024-09-10T22:08:45.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f605e640 1 -- 172.21.15.5:0/2772764742 learned_addr learned my addr 172.21.15.5:0/2772764742 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.784+0000 7fa5f585d640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f505c640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5f0105bc0 0x7fa5f01015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f605e640 1 -- 172.21.15.5:0/2772764742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5f0105bc0 msgr2=0x7fa5f01015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f605e640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5f0105bc0 0x7fa5f01015d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f605e640 1 -- 172.21.15.5:0/2772764742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f006c0c0 msgr2=0x7fa5f0102d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f605e640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0102d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f605e640 1 -- 172.21.15.5:0/2772764742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f01023d0 con 0x7fa5f0108770 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f585d640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f605e640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 0x7fa5f0101b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800e970 tx=0x7fa5e800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e800ccc0 con 0x7fa5f0108770 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa5e800ce60 con 0x7fa5f0108770 2024-09-10T22:08:45.926 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f01a2e30 con 0x7fa5f0108770 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8010430 con 0x7fa5f0108770 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.785+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f01a3330 con 0x7fa5f0108770 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.786+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f0106020 con 0x7fa5f0108770 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.788+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fa5e8004f00 con 0x7fa5f0108770 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.788+0000 7fa5e6ffd640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa5dc0b52d0 0x7fa5dc0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.788+0000 7fa5f585d640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa5dc0b52d0 0x7fa5dc0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.788+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5e80e4460 con 0x7fa5f0108770 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.789+0000 7fa5f585d640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa5dc0b52d0 0x7fa5dc0b7790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec004af0 tx=0x7fa5ec009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:45.927 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.791+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa5e8056220 con 0x7fa5f0108770 2024-09-10T22:08:45.981 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.979+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fa5f00fecf0 con 0x7fa5f0108770 2024-09-10T22:08:45.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.982+0000 7fa5e6ffd640 1 -- 172.21.15.5:0/2772764742 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7fa5f00fecf0 con 0x7fa5f0108770 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa5dc0b52d0 msgr2=0x7fa5dc0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa5dc0b52d0 0x7fa5dc0b7790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec004af0 tx=0x7fa5ec009360 comp rx=0 tx=0).stop 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 msgr2=0x7fa5f0101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 0x7fa5f0101b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800e970 tx=0x7fa5e800ed70 comp rx=0 tx=0).stop 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 shutdown_connections 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa5dc0b52d0 0x7fa5dc0b7790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa5f0108770 0x7fa5f0101b10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa5f0105bc0 0x7fa5f01015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 --2- 172.21.15.5:0/2772764742 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa5f006c0c0 0x7fa5f0102d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 >> 172.21.15.5:0/2772764742 conn(0x7fa5f00fd200 msgr2=0x7fa5f0103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 shutdown_connections 2024-09-10T22:08:45.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:45.985+0000 7fa5f7ac1640 1 -- 172.21.15.5:0/2772764742 wait complete. 2024-09-10T22:08:46.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:46.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:46.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:46.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:46 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2772764742' entity='client.admin' 2024-09-10T22:08:46.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:46.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:46.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:46.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:46 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2772764742' entity='client.admin' 2024-09-10T22:08:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 -- 172.21.15.5:0/1818363054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38104570 msgr2=0x7fdf3810aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1818363054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38104570 0x7fdf3810aef0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009930 tx=0x7fdf3002a420 comp rx=0 tx=0).stop 2024-09-10T22:08:46.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 -- 172.21.15.5:0/1818363054 shutdown_connections 2024-09-10T22:08:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1818363054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38104570 0x7fdf3810aef0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1818363054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf38103bb0 0x7fdf38104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1818363054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38102a50 0x7fdf38102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 -- 172.21.15.5:0/1818363054 >> 172.21.15.5:0/1818363054 conn(0x7fdf380fe320 msgr2=0x7fdf38100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 -- 172.21.15.5:0/1818363054 shutdown_connections 2024-09-10T22:08:46.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 -- 172.21.15.5:0/1818363054 wait complete. 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 Processor -- start 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.704+0000 7fdf4065d640 1 -- start start 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf4065d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 0x7fdf38198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf4065d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf38103bb0 0x7fdf38199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf4065d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38104570 0x7fdf38199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf4065d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3810e5e0 con 0x7fdf38102a50 2024-09-10T22:08:46.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf4065d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3810e460 con 0x7fdf38103bb0 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf4065d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3810e760 con 0x7fdf38104570 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 0x7fdf38198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 0x7fdf38198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55522/0 (socket says 172.21.15.5:55522) 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 -- 172.21.15.5:0/1565862155 learned_addr learned my addr 172.21.15.5:0/1565862155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3dbf8640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf38103bb0 0x7fdf38199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3ebfa640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38104570 0x7fdf38199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 -- 172.21.15.5:0/1565862155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38104570 msgr2=0x7fdf38199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38104570 0x7fdf38199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 -- 172.21.15.5:0/1565862155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf38103bb0 msgr2=0x7fdf38199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf38103bb0 0x7fdf38199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3e3f9640 1 -- 172.21.15.5:0/1565862155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf3819a840 con 0x7fdf38102a50 2024-09-10T22:08:46.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.705+0000 7fdf3ebfa640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38104570 0x7fdf38199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.706+0000 7fdf3e3f9640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 0x7fdf38198d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400cce0 tx=0x7fdf3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.706+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf34004b20 con 0x7fdf38102a50 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.706+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3819ab30 con 0x7fdf38102a50 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.706+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdf34004cc0 con 0x7fdf38102a50 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.706+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400f690 con 0x7fdf38102a50 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.706+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf381a1210 con 0x7fdf38102a50 2024-09-10T22:08:46.711 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.707+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf38102e50 con 0x7fdf38102a50 2024-09-10T22:08:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.708+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fdf34005540 con 0x7fdf38102a50 2024-09-10T22:08:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.709+0000 7fdf2f7fe640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fdf240b5250 0x7fdf240b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.712 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.709+0000 7fdf3dbf8640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fdf240b5250 0x7fdf240b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.709+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdf340e4380 con 0x7fdf38102a50 2024-09-10T22:08:46.713 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.709+0000 7fdf3dbf8640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fdf240b5250 0x7fdf240b7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005d00 tx=0x7fdf2800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:46.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.712+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fdf34014030 con 0x7fdf38102a50 2024-09-10T22:08:46.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-10T22:08:46.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-10T22:08:46.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:46.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:46 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2772764742' entity='client.admin' 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 -- 172.21.15.5:0/712295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 msgr2=0x7ff5e0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 --2- 172.21.15.5:0/712295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0102ef0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0009930 tx=0x7ff5d002a420 comp rx=0 tx=0).stop 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 -- 172.21.15.5:0/712295 shutdown_connections 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 --2- 172.21.15.5:0/712295 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5e0103430 0x7ff5e0109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 --2- 172.21.15.5:0/712295 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0102ef0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 --2- 172.21.15.5:0/712295 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0101910 0x7ff5e0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 -- 172.21.15.5:0/712295 >> 172.21.15.5:0/712295 conn(0x7ff5e00fd1e0 msgr2=0x7ff5e00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 -- 172.21.15.5:0/712295 shutdown_connections 2024-09-10T22:08:46.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.898+0000 7ff5e8054640 1 -- 172.21.15.5:0/712295 wait complete. 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 Processor -- start 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 -- start start 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5e0101910 0x7ff5e0198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0103430 0x7ff5e0199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e010d4a0 con 0x7ff5e0102a70 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e010d320 con 0x7ff5e0103430 2024-09-10T22:08:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e8054640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e010d620 con 0x7ff5e0101910 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e55ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e55ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55544/0 (socket says 172.21.15.5:55544) 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e55ef640 1 -- 172.21.15.5:0/294994664 learned_addr learned my addr 172.21.15.5:0/294994664 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e5df0640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5e0101910 0x7ff5e0198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e65f1640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0103430 0x7ff5e0199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e55ef640 1 -- 172.21.15.5:0/294994664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5e0101910 msgr2=0x7ff5e0198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.899+0000 7ff5e55ef640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5e0101910 0x7ff5e0198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e55ef640 1 -- 172.21.15.5:0/294994664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0103430 msgr2=0x7ff5e0199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e55ef640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0103430 0x7ff5e0199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e55ef640 1 -- 172.21.15.5:0/294994664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e019a810 con 0x7ff5e0102a70 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e65f1640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0103430 0x7ff5e0199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e55ef640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0199330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0005ab0 tx=0x7ff5d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d003f070 con 0x7ff5e0102a70 2024-09-10T22:08:46.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff5d0031b10 con 0x7ff5e0102a70 2024-09-10T22:08:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e019aaa0 con 0x7ff5e0102a70 2024-09-10T22:08:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0035030 con 0x7ff5e0102a70 2024-09-10T22:08:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.900+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e01a1010 con 0x7ff5e0102a70 2024-09-10T22:08:46.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.901+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e0101d10 con 0x7ff5e0102a70 2024-09-10T22:08:46.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.904+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7ff5d0031680 con 0x7ff5e0102a70 2024-09-10T22:08:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.904+0000 7ff5d6ffd640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff5cc0b5250 0x7ff5cc0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.905+0000 7ff5e5df0640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff5cc0b5250 0x7ff5cc0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.905+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff5d0104d40 con 0x7ff5e0102a70 2024-09-10T22:08:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.905+0000 7ff5e5df0640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff5cc0b5250 0x7ff5cc0b7710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0095f0 tx=0x7ff5dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:46.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.905+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fdf381a1500 con 0x7fdf38102a50 2024-09-10T22:08:46.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.907+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff5d00cd8b0 con 0x7ff5e0102a70 2024-09-10T22:08:46.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.910+0000 7fdf2f7fe640 1 -- 172.21.15.5:0/1565862155 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7fdf340acf10 con 0x7fdf38102a50 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fdf240b5250 msgr2=0x7fdf240b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fdf240b5250 0x7fdf240b7710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005d00 tx=0x7fdf2800b410 comp rx=0 tx=0).stop 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 msgr2=0x7fdf38198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 0x7fdf38198d10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdf3400cce0 tx=0x7fdf3400a620 comp rx=0 tx=0).stop 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 shutdown_connections 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fdf240b5250 0x7fdf240b7710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdf38104570 0x7fdf38199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdf38103bb0 0x7fdf38199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 --2- 172.21.15.5:0/1565862155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdf38102a50 0x7fdf38198d10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 >> 172.21.15.5:0/1565862155 conn(0x7fdf380fe320 msgr2=0x7fdf38104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 shutdown_connections 2024-09-10T22:08:46.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:46.912+0000 7fdf4065d640 1 -- 172.21.15.5:0/1565862155 wait complete. 2024-09-10T22:08:47.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.095+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7ff5e01a1450 con 0x7ff5e0102a70 2024-09-10T22:08:47.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.099+0000 7ff5d6ffd640 1 -- 172.21.15.5:0/294994664 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v25)=0 v25) ==== 122+0+0 (secure 0 0 0) 0x7ff5d00cd1b0 con 0x7ff5e0102a70 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff5cc0b5250 msgr2=0x7ff5cc0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff5cc0b5250 0x7ff5cc0b7710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0095f0 tx=0x7ff5dc005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 msgr2=0x7ff5e0199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0199330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0005ab0 tx=0x7ff5d0003c10 comp rx=0 tx=0).stop 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 shutdown_connections 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff5cc0b5250 0x7ff5cc0b7710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff5e0103430 0x7ff5e0199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:47.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff5e0102a70 0x7ff5e0199330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 --2- 172.21.15.5:0/294994664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff5e0101910 0x7ff5e0198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.101+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 >> 172.21.15.5:0/294994664 conn(0x7ff5e00fd1e0 msgr2=0x7ff5e00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.102+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 shutdown_connections 2024-09-10T22:08:47.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.102+0000 7ff5e8054640 1 -- 172.21.15.5:0/294994664 wait complete. 2024-09-10T22:08:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:47 smithi189 ceph-mon[35784]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T22:08:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:47 smithi189 ceph-mon[35784]: Reconfiguring daemon mgr.x on smithi005 2024-09-10T22:08:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:47 smithi189 ceph-mon[35784]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:47 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1565862155' entity='client.admin' 2024-09-10T22:08:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:47 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/294994664' entity='client.admin' 2024-09-10T22:08:47.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:47 smithi052 ceph-mon[34997]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T22:08:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:47 smithi052 ceph-mon[34997]: Reconfiguring daemon mgr.x on smithi005 2024-09-10T22:08:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:47 smithi052 ceph-mon[34997]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:47 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1565862155' entity='client.admin' 2024-09-10T22:08:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:47 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/294994664' entity='client.admin' 2024-09-10T22:08:47.770 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:47 smithi005 ceph-mon[31115]: Reconfiguring mgr.x (unknown last config time)... 2024-09-10T22:08:47.770 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:47 smithi005 ceph-mon[31115]: Reconfiguring daemon mgr.x on smithi005 2024-09-10T22:08:47.771 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:47 smithi005 ceph-mon[31115]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:47.771 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1565862155' entity='client.admin' 2024-09-10T22:08:47.771 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/294994664' entity='client.admin' 2024-09-10T22:08:47.905 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.995+0000 7f99fb999640 1 -- 172.21.15.5:0/3885740782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4104560 msgr2=0x7f99f410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.995+0000 7f99fb999640 1 --2- 172.21.15.5:0/3885740782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4104560 0x7f99f410aee0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009cd0 tx=0x7f99ec02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- 172.21.15.5:0/3885740782 shutdown_connections 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 --2- 172.21.15.5:0/3885740782 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4104560 0x7f99f410aee0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 --2- 172.21.15.5:0/3885740782 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 --2- 172.21.15.5:0/3885740782 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99f4102a40 0x7f99f4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- 172.21.15.5:0/3885740782 >> 172.21.15.5:0/3885740782 conn(0x7f99f40fe2f0 msgr2=0x7f99f4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:48.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- 172.21.15.5:0/3885740782 shutdown_connections 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- 172.21.15.5:0/3885740782 wait complete. 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 Processor -- start 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- start start 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4102a40 0x7f99f4076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99f4104560 0x7f99f4075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f99f410e560 con 0x7f99f4103ba0 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.996+0000 7f99fb999640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f99f410e3e0 con 0x7f99f4102a40 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99fb999640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f99f410e6e0 con 0x7f99f4104560 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55560/0 (socket says 172.21.15.5:55560) 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 -- 172.21.15.5:0/34055732 learned_addr learned my addr 172.21.15.5:0/34055732 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f9735640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4102a40 0x7f99f4076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:48.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f9f36640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99f4104560 0x7f99f4075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 -- 172.21.15.5:0/34055732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99f4104560 msgr2=0x7f99f4075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99f4104560 0x7f99f4075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 -- 172.21.15.5:0/34055732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4102a40 msgr2=0x7f99f4076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4102a40 0x7f99f4076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 -- 172.21.15.5:0/34055732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f4076340 con 0x7f99f4103ba0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f9735640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4102a40 0x7f99f4076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99f8f34640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4075540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99e400ea60 tx=0x7f99e400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e400cde0 con 0x7f99f4103ba0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f41a2da0 con 0x7f99f4103ba0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f99e40035f0 con 0x7f99f4103ba0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.997+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4010690 con 0x7f99f4103ba0 2024-09-10T22:08:48.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.998+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f41a3260 con 0x7f99f4103ba0 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:47.999+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f4102e40 con 0x7f99f4103ba0 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.001+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f99e4004000 con 0x7f99f4103ba0 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.002+0000 7f99ea7fc640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f99e00b5250 0x7f99e00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.002+0000 7f99f9735640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f99e00b5250 0x7f99e00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.002+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f99e40e4310 con 0x7f99f4103ba0 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.002+0000 7f99f9735640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f99e00b5250 0x7f99e00b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009fc0 tx=0x7f99f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:48.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.005+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f99e4056220 con 0x7f99f4103ba0 2024-09-10T22:08:48.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.193+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f99f4109d60 con 0x7f99f4103ba0 2024-09-10T22:08:48.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.196+0000 7f99ea7fc640 1 -- 172.21.15.5:0/34055732 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v26)=0 v26) ==== 125+0+0 (secure 0 0 0) 0x7f99f4109d60 con 0x7f99f4103ba0 2024-09-10T22:08:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f99e00b5250 msgr2=0x7f99e00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:48.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f99e00b5250 0x7f99e00b7710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009fc0 tx=0x7f99f0005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 msgr2=0x7f99f4075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4075540 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99e400ea60 tx=0x7f99e400ef20 comp rx=0 tx=0).stop 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 shutdown_connections 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f99e00b5250 0x7f99e00b7710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f99f4104560 0x7f99f4075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f99f4103ba0 0x7f99f4075540 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 --2- 172.21.15.5:0/34055732 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f99f4102a40 0x7f99f4076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 >> 172.21.15.5:0/34055732 conn(0x7f99f40fe2f0 msgr2=0x7f99f4106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 shutdown_connections 2024-09-10T22:08:48.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:48.199+0000 7f99fb999640 1 -- 172.21.15.5:0/34055732 wait complete. 2024-09-10T22:08:49.296 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:49 smithi005 ceph-mon[31115]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:49.296 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:49 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/34055732' entity='client.admin' 2024-09-10T22:08:49.495 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:49 smithi189 ceph-mon[35784]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:49.496 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:49 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/34055732' entity='client.admin' 2024-09-10T22:08:49.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:49 smithi052 ceph-mon[34997]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:49.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:49 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/34055732' entity='client.admin' 2024-09-10T22:08:49.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 -- 172.21.15.5:0/1707813208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 msgr2=0x7ff88c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 --2- 172.21.15.5:0/1707813208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c101220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009900 tx=0x7ff87c02a410 comp rx=0 tx=0).stop 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 -- 172.21.15.5:0/1707813208 shutdown_connections 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 --2- 172.21.15.5:0/1707813208 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 0x7ff88c10ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 --2- 172.21.15.5:0/1707813208 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff88c105ef0 0x7ff88c1082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 --2- 172.21.15.5:0/1707813208 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c101220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 -- 172.21.15.5:0/1707813208 >> 172.21.15.5:0/1707813208 conn(0x7ff88c0fc9b0 msgr2=0x7ff88c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 -- 172.21.15.5:0/1707813208 shutdown_connections 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.779+0000 7ff891bc0640 1 -- 172.21.15.5:0/1707813208 wait complete. 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 Processor -- start 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 -- start start 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:49.784 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff88c105ef0 0x7ff88c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 0x7ff88c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10e560 con 0x7ff88c100e20 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10e3e0 con 0x7ff88c105ef0 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff891bc0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c10e6e0 con 0x7ff88c108820 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff88b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.780+0000 7ff88b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55584/0 (socket says 172.21.15.5:55584) 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 -- 172.21.15.5:0/3653511338 learned_addr learned my addr 172.21.15.5:0/3653511338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88bfff640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 0x7ff88c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88affd640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff88c105ef0 0x7ff88c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 -- 172.21.15.5:0/3653511338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 msgr2=0x7ff88c199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 0x7ff88c199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 -- 172.21.15.5:0/3653511338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff88c105ef0 msgr2=0x7ff88c199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff88c105ef0 0x7ff88c199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 -- 172.21.15.5:0/3653511338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c19a7f0 con 0x7ff88c100e20 2024-09-10T22:08:49.785 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88bfff640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 0x7ff88c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff88b7fe640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c198cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff87c005940 tx=0x7ff87c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c03f030 con 0x7ff88c100e20 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff87c0044c0 con 0x7ff88c100e20 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c035070 con 0x7ff88c100e20 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c19aa80 con 0x7ff88c100e20 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.781+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c1a11c0 con 0x7ff88c100e20 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.782+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c10ed20 con 0x7ff88c100e20 2024-09-10T22:08:49.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.784+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7ff87c03b940 con 0x7ff88c100e20 2024-09-10T22:08:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.785+0000 7ff888ff9640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff8740b52d0 0x7ff8740b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:49.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.785+0000 7ff88affd640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff8740b52d0 0x7ff8740b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.785+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff87c104be0 con 0x7ff88c100e20 2024-09-10T22:08:49.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.785+0000 7ff88affd640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff8740b52d0 0x7ff8740b7790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff880009bd0 tx=0x7ff880005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:49.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.788+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff87c0cd100 con 0x7ff88c100e20 2024-09-10T22:08:49.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.984+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7ff88c0fe4a0 con 0x7ff88c100e20 2024-09-10T22:08:49.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.987+0000 7ff888ff9640 1 -- 172.21.15.5:0/3653511338 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v27)=0 v27) ==== 116+0+0 (secure 0 0 0) 0x7ff87c0d1b30 con 0x7ff88c100e20 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff8740b52d0 msgr2=0x7ff8740b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff8740b52d0 0x7ff8740b7790 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff880009bd0 tx=0x7ff880005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 msgr2=0x7ff88c198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c198cc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff87c005940 tx=0x7ff87c0040c0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 shutdown_connections 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff8740b52d0 0x7ff8740b7790 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff88c108820 0x7ff88c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff88c105ef0 0x7ff88c199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 --2- 172.21.15.5:0/3653511338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff88c100e20 0x7ff88c198cc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.989+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 >> 172.21.15.5:0/3653511338 conn(0x7ff88c0fc9b0 msgr2=0x7ff88c106af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.990+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 shutdown_connections 2024-09-10T22:08:49.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:49.990+0000 7ff891bc0640 1 -- 172.21.15.5:0/3653511338 wait complete. 2024-09-10T22:08:51.242 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:50 smithi005 ceph-mon[31115]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:51.243 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:50 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3653511338' entity='client.admin' 2024-09-10T22:08:51.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:50 smithi052 ceph-mon[34997]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:51.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:50 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3653511338' entity='client.admin' 2024-09-10T22:08:51.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.333+0000 7f259363c640 1 -- 172.21.15.5:0/3827071369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c10a980 msgr2=0x7f258c10ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:51.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.333+0000 7f259363c640 1 --2- 172.21.15.5:0/3827071369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c10a980 0x7f258c10ce40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2584009ca0 tx=0x7f258402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 -- 172.21.15.5:0/3827071369 shutdown_connections 2024-09-10T22:08:51.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 --2- 172.21.15.5:0/3827071369 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c10a980 0x7f258c10ce40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 --2- 172.21.15.5:0/3827071369 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f258c107f70 0x7f258c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 --2- 172.21.15.5:0/3827071369 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f258c06bfb0 0x7f258c107a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 -- 172.21.15.5:0/3827071369 >> 172.21.15.5:0/3827071369 conn(0x7f258c0fd200 msgr2=0x7f258c0ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:51.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 -- 172.21.15.5:0/3827071369 shutdown_connections 2024-09-10T22:08:51.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 -- 172.21.15.5:0/3827071369 wait complete. 2024-09-10T22:08:51.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 Processor -- start 2024-09-10T22:08:51.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 -- start start 2024-09-10T22:08:51.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 0x7f258c19ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:51.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f258c107f70 0x7f258c19b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f258c10a980 0x7f258c19c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.334+0000 7f259363c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f258c110790 con 0x7f258c06bfb0 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f259363c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f258c110610 con 0x7f258c10a980 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f259363c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f258c110910 con 0x7f258c107f70 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 0x7f258c19ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 0x7f258c19ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55598/0 (socket says 172.21.15.5:55598) 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 -- 172.21.15.5:0/3371154052 learned_addr learned my addr 172.21.15.5:0/3371154052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f2591bd9640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f258c10a980 0x7f258c19c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f2590bd7640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f258c107f70 0x7f258c19b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 -- 172.21.15.5:0/3371154052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f258c107f70 msgr2=0x7f258c19b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f258c107f70 0x7f258c19b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 -- 172.21.15.5:0/3371154052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f258c10a980 msgr2=0x7f258c19c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f258c10a980 0x7f258c19c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 -- 172.21.15.5:0/3371154052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c19c980 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25913d8640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 0x7f258c19ae50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f258800c890 tx=0x7f258800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2588004220 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2588007e40 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880047a0 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.335+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c19cc70 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.336+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c1a3350 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.337+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c107a30 con 0x7f258c06bfb0 2024-09-10T22:08:51.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.338+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f25880079b0 con 0x7f258c06bfb0 2024-09-10T22:08:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.339+0000 7f25827fc640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25780b5250 0x7f25780b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.339+0000 7f2590bd7640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25780b5250 0x7f25780b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.339+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f25880e3b30 con 0x7f258c06bfb0 2024-09-10T22:08:51.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.339+0000 7f2590bd7640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25780b5250 0x7f25780b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f258c1035f0 tx=0x7f257c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:51.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.343+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2588014030 con 0x7f258c06bfb0 2024-09-10T22:08:51.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:50 smithi189 ceph-mon[35784]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:51.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:50 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3653511338' entity='client.admin' 2024-09-10T22:08:51.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.533+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f258c063d50 con 0x7f258c06bfb0 2024-09-10T22:08:51.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.536+0000 7f25827fc640 1 -- 172.21.15.5:0/3371154052 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f25880b3e20 con 0x7f258c06bfb0 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25780b5250 msgr2=0x7f25780b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25780b5250 0x7f25780b7710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f258c1035f0 tx=0x7f257c00a2d0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 msgr2=0x7f258c19ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 0x7f258c19ae50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f258800c890 tx=0x7f258800cc90 comp rx=0 tx=0).stop 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 shutdown_connections 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25780b5250 0x7f25780b7710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f258c10a980 0x7f258c19c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f258c107f70 0x7f258c19b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 --2- 172.21.15.5:0/3371154052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f258c06bfb0 0x7f258c19ae50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.538+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 >> 172.21.15.5:0/3371154052 conn(0x7f258c0fd200 msgr2=0x7f258c108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.539+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 shutdown_connections 2024-09-10T22:08:51.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:51.539+0000 7f259363c640 1 -- 172.21.15.5:0/3371154052 wait complete. 2024-09-10T22:08:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 -- 172.21.15.5:0/1209433666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 msgr2=0x7fb838101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1209433666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838101d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb820009930 tx=0x7fb82002a420 comp rx=0 tx=0).stop 2024-09-10T22:08:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 -- 172.21.15.5:0/1209433666 shutdown_connections 2024-09-10T22:08:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1209433666 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb838103430 0x7fb838109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1209433666 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb838102a70 0x7fb838102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1209433666 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838101d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 -- 172.21.15.5:0/1209433666 >> 172.21.15.5:0/1209433666 conn(0x7fb8380fd1e0 msgr2=0x7fb8380ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 -- 172.21.15.5:0/1209433666 shutdown_connections 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.055+0000 7fb83f12f640 1 -- 172.21.15.5:0/1209433666 wait complete. 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 Processor -- start 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 -- start start 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb838102a70 0x7fb838199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb838103430 0x7fb838199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb83810e5a0 con 0x7fb838101910 2024-09-10T22:08:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb83810e420 con 0x7fb838102a70 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83f12f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb83810e720 con 0x7fb838103430 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55622/0 (socket says 172.21.15.5:55622) 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 -- 172.21.15.5:0/1298442137 learned_addr learned my addr 172.21.15.5:0/1298442137 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb837fff640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb838102a70 0x7fb838199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 -- 172.21.15.5:0/1298442137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb838103430 msgr2=0x7fb838199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb838103430 0x7fb838199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 -- 172.21.15.5:0/1298442137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb838102a70 msgr2=0x7fb838199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb838102a70 0x7fb838199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.056+0000 7fb83cecb640 1 -- 172.21.15.5:0/1298442137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83819a850 con 0x7fb838101910 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.057+0000 7fb83cecb640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838198d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb820009a50 tx=0x7fb820004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.057+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82003f030 con 0x7fb838101910 2024-09-10T22:08:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.057+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb83819aae0 con 0x7fb838101910 2024-09-10T22:08:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.057+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb820003a80 con 0x7fb838101910 2024-09-10T22:08:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.057+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820035070 con 0x7fb838101910 2024-09-10T22:08:52.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.057+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8381a1050 con 0x7fb838101910 2024-09-10T22:08:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.058+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb838101d10 con 0x7fb838101910 2024-09-10T22:08:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.059+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fb82003bcc0 con 0x7fb838101910 2024-09-10T22:08:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.060+0000 7fb835ffb640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8240b5250 0x7fb8240b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.060+0000 7fb837fff640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8240b5250 0x7fb8240b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.060+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb820104f80 con 0x7fb838101910 2024-09-10T22:08:52.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.061+0000 7fb837fff640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8240b5250 0x7fb8240b7710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb82800bbe0 tx=0x7fb82800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:52.066 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.063+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8200cda70 con 0x7fb838101910 2024-09-10T22:08:52.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.251+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb83802e5c0 con 0x7fb838101910 2024-09-10T22:08:52.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.254+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v29)=0 v29) ==== 123+0+0 (secure 0 0 0) 0x7fb8200d6220 con 0x7fb838101910 2024-09-10T22:08:52.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.255+0000 7fb835ffb640 1 -- 172.21.15.5:0/1298442137 <== mon.0 v2:172.21.15.5:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8200cce80 con 0x7fb838101910 2024-09-10T22:08:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8240b5250 msgr2=0x7fb8240b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8240b5250 0x7fb8240b7710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb82800bbe0 tx=0x7fb82800b390 comp rx=0 tx=0).stop 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 msgr2=0x7fb838198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838198d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb820009a50 tx=0x7fb820004270 comp rx=0 tx=0).stop 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 shutdown_connections 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8240b5250 0x7fb8240b7710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb838103430 0x7fb838199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb838102a70 0x7fb838199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 --2- 172.21.15.5:0/1298442137 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb838101910 0x7fb838198d20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 >> 172.21.15.5:0/1298442137 conn(0x7fb8380fd1e0 msgr2=0x7fb838105eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 shutdown_connections 2024-09-10T22:08:52.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.257+0000 7fb83f12f640 1 -- 172.21.15.5:0/1298442137 wait complete. 2024-09-10T22:08:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 -- 172.21.15.5:0/973757433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4102ab0 msgr2=0x7f9ca4102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/973757433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4102f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009930 tx=0x7f9c9402a420 comp rx=0 tx=0).stop 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 -- 172.21.15.5:0/973757433 shutdown_connections 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/973757433 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4103470 0x7f9ca4109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/973757433 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4102f30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/973757433 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca4101950 0x7f9ca4101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 -- 172.21.15.5:0/973757433 >> 172.21.15.5:0/973757433 conn(0x7f9ca40fd200 msgr2=0x7f9ca40ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 -- 172.21.15.5:0/973757433 shutdown_connections 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.661+0000 7f9cab6a8640 1 -- 172.21.15.5:0/973757433 wait complete. 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 Processor -- start 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 -- start start 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca4101950 0x7f9ca41056f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 0x7f9ca41044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410d5d0 con 0x7f9ca4103470 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410d450 con 0x7f9ca4102ab0 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9cab6a8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca410d750 con 0x7f9ca4101950 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9ca9c45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 0x7f9ca41044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9ca9c45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 0x7f9ca41044a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54552/0 (socket says 172.21.15.5:54552) 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.662+0000 7f9ca9c45640 1 -- 172.21.15.5:0/838727310 learned_addr learned my addr 172.21.15.5:0/838727310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9444640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca4101950 0x7f9ca41056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca8c43640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9c45640 1 -- 172.21.15.5:0/838727310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca4101950 msgr2=0x7f9ca41056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9c45640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca4101950 0x7f9ca41056f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9c45640 1 -- 172.21.15.5:0/838727310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4102ab0 msgr2=0x7f9ca4103f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9c45640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4103f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9c45640 1 -- 172.21.15.5:0/838727310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca4104d60 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca8c43640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9ca9c45640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 0x7f9ca41044a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00eb10 tx=0x7f9c9c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c004b20 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c9c004cc0 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca41a2f30 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c010670 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.663+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca41a33e0 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.664+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca41a36d0 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.666+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f9c9c005000 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.666+0000 7f9c9a7fc640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c900b52d0 0x7f9c900b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.666+0000 7f9ca9444640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c900b52d0 0x7f9c900b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.667+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9c9c0e46f0 con 0x7f9ca4103470 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.667+0000 7f9ca9444640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c900b52d0 0x7f9c900b7790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009b60 tx=0x7f9ca0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:52.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.669+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9c9c056220 con 0x7f9ca4103470 2024-09-10T22:08:52.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3371154052' entity='client.admin' 2024-09-10T22:08:52.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:52 smithi005 ceph-mon[31115]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:52.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1298442137' entity='client.admin' 2024-09-10T22:08:52.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.856+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9ca41a38a0 con 0x7f9ca4103470 2024-09-10T22:08:52.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.860+0000 7f9c9a7fc640 1 -- 172.21.15.5:0/838727310 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f9c9c0ad280 con 0x7f9ca4103470 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c900b52d0 msgr2=0x7f9c900b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c900b52d0 0x7f9c900b7790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009b60 tx=0x7f9ca0005f90 comp rx=0 tx=0).stop 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 msgr2=0x7f9ca41044a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 0x7f9ca41044a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00eb10 tx=0x7f9c9c00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 shutdown_connections 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c900b52d0 0x7f9c900b7790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ca4103470 0x7f9ca41044a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ca4102ab0 0x7f9ca4103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 --2- 172.21.15.5:0/838727310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ca4101950 0x7f9ca41056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 >> 172.21.15.5:0/838727310 conn(0x7f9ca40fd200 msgr2=0x7f9ca40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:52.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 shutdown_connections 2024-09-10T22:08:52.866 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:52.862+0000 7f9cab6a8640 1 -- 172.21.15.5:0/838727310 wait complete. 2024-09-10T22:08:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:52 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3371154052' entity='client.admin' 2024-09-10T22:08:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:52 smithi189 ceph-mon[35784]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:52 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1298442137' entity='client.admin' 2024-09-10T22:08:52.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:52 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3371154052' entity='client.admin' 2024-09-10T22:08:53.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:52 smithi052 ceph-mon[34997]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:53.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:52 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1298442137' entity='client.admin' 2024-09-10T22:08:54.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/838727310' entity='client.admin' 2024-09-10T22:08:54.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:54.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:54.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:54.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/838727310' entity='client.admin' 2024-09-10T22:08:54.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:54.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:54.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:54.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/838727310' entity='client.admin' 2024-09-10T22:08:54.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:08:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:08:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:08:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:08:55.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:55 smithi005 ceph-mon[31115]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:55.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:55 smithi189 ceph-mon[35784]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:55.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:55 smithi052 ceph-mon[34997]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:55.797 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.797 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.797 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.797 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.797 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.798 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.799 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-09-10T22:08:55.799 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi005') 2024-09-10T22:08:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 -- 172.21.15.5:0/115778503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4104560 msgr2=0x7ffbd410aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:56.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/115778503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4104560 0x7ffbd410aee0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009cd0 tx=0x7ffbcc02a8e0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 -- 172.21.15.5:0/115778503 shutdown_connections 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/115778503 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4104560 0x7ffbd410aee0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/115778503 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/115778503 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbd4102a40 0x7ffbd4102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 -- 172.21.15.5:0/115778503 >> 172.21.15.5:0/115778503 conn(0x7ffbd40fe2f0 msgr2=0x7ffbd4100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 -- 172.21.15.5:0/115778503 shutdown_connections 2024-09-10T22:08:56.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 -- 172.21.15.5:0/115778503 wait complete. 2024-09-10T22:08:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.332+0000 7ffbdb03f640 1 Processor -- start 2024-09-10T22:08:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 -- start start 2024-09-10T22:08:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbd4102a40 0x7ffbd4198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4104560 0x7ffbd419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:56.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd410e6a0 con 0x7ffbd4103ba0 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd410e520 con 0x7ffbd4104560 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbdb03f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd410e820 con 0x7ffbd4102a40 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54580/0 (socket says 172.21.15.5:54580) 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 -- 172.21.15.5:0/2758543701 learned_addr learned my addr 172.21.15.5:0/2758543701 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd8ddb640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbd4102a40 0x7ffbd4198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd95dc640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4104560 0x7ffbd419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 -- 172.21.15.5:0/2758543701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbd4102a40 msgr2=0x7ffbd4198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbd4102a40 0x7ffbd4198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 -- 172.21.15.5:0/2758543701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4104560 msgr2=0x7ffbd419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4104560 0x7ffbd419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd3fff640 1 -- 172.21.15.5:0/2758543701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd419a930 con 0x7ffbd4103ba0 2024-09-10T22:08:56.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.333+0000 7ffbd95dc640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4104560 0x7ffbd419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:08:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.334+0000 7ffbd3fff640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4199450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000d950 tx=0x7ffbc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.334+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0017070 con 0x7ffbd4103ba0 2024-09-10T22:08:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.334+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbc0009c30 con 0x7ffbd4103ba0 2024-09-10T22:08:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.334+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd419ac20 con 0x7ffbd4103ba0 2024-09-10T22:08:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.334+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000f620 con 0x7ffbd4103ba0 2024-09-10T22:08:56.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.334+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd41a1300 con 0x7ffbd4103ba0 2024-09-10T22:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.335+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd4109cf0 con 0x7ffbd4103ba0 2024-09-10T22:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.336+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7ffbc0010460 con 0x7ffbd4103ba0 2024-09-10T22:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.337+0000 7ffbd1ffb640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffbc40b52d0 0x7ffbc40b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.337+0000 7ffbd8ddb640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffbc40b52d0 0x7ffbc40b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.337+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffbc00e3a50 con 0x7ffbd4103ba0 2024-09-10T22:08:56.339 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.338+0000 7ffbd8ddb640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffbc40b52d0 0x7ffbc40b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8005d00 tx=0x7ffbc800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:08:56.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.341+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffbc00ac5e0 con 0x7ffbd4103ba0 2024-09-10T22:08:56.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.527+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ffbd4063d50 con 0x7ffbd4103ba0 2024-09-10T22:08:56.532 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.531+0000 7ffbd1ffb640 1 -- 172.21.15.5:0/2758543701 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7ffbc0009de0 con 0x7ffbd4103ba0 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffbc40b52d0 msgr2=0x7ffbc40b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffbc40b52d0 0x7ffbc40b7790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8005d00 tx=0x7ffbc800b410 comp rx=0 tx=0).stop 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 msgr2=0x7ffbd4199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4199450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000d950 tx=0x7ffbc000de10 comp rx=0 tx=0).stop 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 shutdown_connections 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffbc40b52d0 0x7ffbc40b7790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffbd4104560 0x7ffbd419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffbd4103ba0 0x7ffbd4199450 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 --2- 172.21.15.5:0/2758543701 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffbd4102a40 0x7ffbd4198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 >> 172.21.15.5:0/2758543701 conn(0x7ffbd40fe2f0 msgr2=0x7ffbd4106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 shutdown_connections 2024-09-10T22:08:56.536 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:08:56.533+0000 7ffbdb03f640 1 -- 172.21.15.5:0/2758543701 wait complete. 2024-09-10T22:08:57.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi005') 2024-09-10T22:08:57.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi005') 2024-09-10T22:08:57.126 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ca2ddb2e-6fc0-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi005') 2024-09-10T22:08:57.126 INFO:tasks.cephadm:Deploying OSDs... 2024-09-10T22:08:57.126 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:08:57.127 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:08:57.146 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:08:57.146 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-10 22:07:47.989072115 +0000 2024-09-10T22:08:57.203 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-10 22:02:53.345871397 +0000 2024-09-10T22:08:57.204 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-10 22:02:53.346871377 +0000 2024-09-10T22:08:57.204 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-10 22:02:53.345871397 +0000 2024-09-10T22:08:57.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:08:57.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-10T22:08:57.270 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-10T22:08:57.270 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00011916 s, 4.3 MB/s 2024-09-10T22:08:57.272 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:08:57.330 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-10 22:07:48.019071505 +0000 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-10 22:02:53.672864725 +0000 2024-09-10T22:08:57.387 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-10 22:02:53.672864725 +0000 2024-09-10T22:08:57.388 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-10 22:02:53.672864725 +0000 2024-09-10T22:08:57.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:08:57.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:57 smithi189 ceph-mon[35784]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:57.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:57 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2758543701' entity='client.admin' 2024-09-10T22:08:57.450 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:57 smithi005 ceph-mon[31115]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:57.450 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:57 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2758543701' entity='client.admin' 2024-09-10T22:08:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-10T22:08:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-10T22:08:57.452 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 9.1942e-05 s, 5.6 MB/s 2024-09-10T22:08:57.454 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:08:57.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:57 smithi052 ceph-mon[34997]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:57.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:57 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2758543701' entity='client.admin' 2024-09-10T22:08:57.511 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-09-10T22:08:57.567 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:08:57.567 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:57.567 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-10T22:08:57.567 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:57.567 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:57.567 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-10 22:07:48.048070916 +0000 2024-09-10T22:08:57.568 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-10 22:02:53.997858093 +0000 2024-09-10T22:08:57.568 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-10 22:02:53.997858093 +0000 2024-09-10T22:08:57.568 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-10 22:02:53.997858093 +0000 2024-09-10T22:08:57.568 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:08:57.631 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-10T22:08:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-10T22:08:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000113289 s, 4.5 MB/s 2024-09-10T22:08:57.633 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:08:57.690 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-09-10T22:08:57.746 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:08:57.746 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-10 22:07:48.079070285 +0000 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-10 22:02:54.332851257 +0000 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-10 22:02:54.332851257 +0000 2024-09-10T22:08:57.747 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-10 22:02:54.332851257 +0000 2024-09-10T22:08:57.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:08:57.810 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-10T22:08:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-10T22:08:57.811 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000105093 s, 4.9 MB/s 2024-09-10T22:08:57.812 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:08:57.869 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-09-10T22:08:57.869 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:08:57.889 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:08:57.889 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_1 2024-09-10T22:08:57.949 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:08:57.949 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:57.949 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-10T22:08:57.950 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:57.950 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:57.950 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 22:08:38.108385020 +0000 2024-09-10T22:08:57.950 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 22:03:12.545010231 +0000 2024-09-10T22:08:57.950 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 22:03:12.545010231 +0000 2024-09-10T22:08:57.950 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 22:03:12.545010231 +0000 2024-09-10T22:08:57.950 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:08:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T22:08:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T22:08:58.020 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000126442 s, 4.0 MB/s 2024-09-10T22:08:58.021 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:08:58.081 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_2 2024-09-10T22:08:58.139 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:08:58.139 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 22:08:38.108385020 +0000 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 22:03:12.869006299 +0000 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 22:03:12.869006299 +0000 2024-09-10T22:08:58.140 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 22:03:12.869006299 +0000 2024-09-10T22:08:58.140 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:08:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T22:08:58.206 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T22:08:58.207 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000117124 s, 4.4 MB/s 2024-09-10T22:08:58.208 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:08:58.267 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_3 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 22:08:38.108385020 +0000 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 22:03:13.190002403 +0000 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 22:03:13.190002403 +0000 2024-09-10T22:08:58.325 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 22:03:13.190002403 +0000 2024-09-10T22:08:58.326 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:08:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T22:08:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T22:08:58.392 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000116773 s, 4.4 MB/s 2024-09-10T22:08:58.394 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:08:58.452 DEBUG:teuthology.orchestra.run.smithi052:> stat /dev/vg_nvme/lv_4 2024-09-10T22:08:58.509 INFO:teuthology.orchestra.run.smithi052.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:Access: 2024-09-10 22:08:38.109385008 +0000 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:Modify: 2024-09-10 22:03:13.512998483 +0000 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout:Change: 2024-09-10 22:03:13.512998483 +0000 2024-09-10T22:08:58.510 INFO:teuthology.orchestra.run.smithi052.stdout: Birth: 2024-09-10 22:03:13.512998483 +0000 2024-09-10T22:08:58.510 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:08:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records in 2024-09-10T22:08:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:1+0 records out 2024-09-10T22:08:58.577 INFO:teuthology.orchestra.run.smithi052.stderr:512 bytes copied, 0.000106491 s, 4.8 MB/s 2024-09-10T22:08:58.579 DEBUG:teuthology.orchestra.run.smithi052:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:08:58.638 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T22:08:58.638 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T22:08:58.657 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T22:08:58.658 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-10T22:08:58.717 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 22:08:35.587231602 +0000 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 22:03:07.638648699 +0000 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 22:03:07.638648699 +0000 2024-09-10T22:08:58.718 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 22:03:07.638648699 +0000 2024-09-10T22:08:58.718 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T22:08:58.788 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T22:08:58.788 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T22:08:58.788 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000285053 s, 1.8 MB/s 2024-09-10T22:08:58.790 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T22:08:58.849 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-10T22:08:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T22:08:58.906 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:58.906 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-10T22:08:58.906 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:58.906 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:58.906 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 22:08:35.588231582 +0000 2024-09-10T22:08:58.907 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 22:03:08.002641413 +0000 2024-09-10T22:08:58.907 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 22:03:08.002641413 +0000 2024-09-10T22:08:58.907 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 22:03:08.002641413 +0000 2024-09-10T22:08:58.907 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T22:08:58.972 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T22:08:58.972 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T22:08:58.972 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000193782 s, 2.6 MB/s 2024-09-10T22:08:58.974 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T22:08:59.033 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 22:08:35.588231582 +0000 2024-09-10T22:08:59.090 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 22:03:08.322635008 +0000 2024-09-10T22:08:59.091 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 22:03:08.322635008 +0000 2024-09-10T22:08:59.091 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 22:03:08.322635008 +0000 2024-09-10T22:08:59.091 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T22:08:59.156 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T22:08:59.156 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T22:08:59.157 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000185847 s, 2.8 MB/s 2024-09-10T22:08:59.157 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T22:08:59.215 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 22:08:35.589231563 +0000 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 22:03:08.637628702 +0000 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 22:03:08.637628702 +0000 2024-09-10T22:08:59.272 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: 2024-09-10 22:03:08.637628702 +0000 2024-09-10T22:08:59.273 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T22:08:59.337 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T22:08:59.337 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T22:08:59.337 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000195055 s, 2.6 MB/s 2024-09-10T22:08:59.338 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T22:08:59.388 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:08:59 smithi005 ceph-mon[31115]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:59.395 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2024-09-10T22:08:59.395 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:08:59.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:08:59 smithi189 ceph-mon[35784]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:59.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:08:59 smithi052 ceph-mon[34997]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:08:59.656 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:09:01.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:01 smithi005 ceph-mon[31115]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:01.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:01 smithi189 ceph-mon[35784]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:01.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:01 smithi052 ceph-mon[34997]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:02.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:09:02.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2024-09-10T22:09:02.568 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:09:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.994+0000 7fa928cf9640 1 -- 172.21.15.5:0/3358541190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 msgr2=0x7fa92410abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.994+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3358541190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa92410abf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009ca0 tx=0x7fa91c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:09:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 -- 172.21.15.5:0/3358541190 shutdown_connections 2024-09-10T22:09:02.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3358541190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa92410abf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3358541190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa924105b80 0x7fa924107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3358541190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa92406b6e0 0x7fa9241055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 -- 172.21.15.5:0/3358541190 >> 172.21.15.5:0/3358541190 conn(0x7fa9240fd1e0 msgr2=0x7fa9240ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:09:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 -- 172.21.15.5:0/3358541190 shutdown_connections 2024-09-10T22:09:02.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 -- 172.21.15.5:0/3358541190 wait complete. 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 Processor -- start 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.995+0000 7fa928cf9640 1 -- start start 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa928cf9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa92406b6e0 0x7fa924102d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa928cf9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa924105b80 0x7fa924101590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa928cf9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa924101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa928cf9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa92410e6a0 con 0x7fa924108730 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa928cf9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa92410e520 con 0x7fa92406b6e0 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa928cf9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa92410e820 con 0x7fa924105b80 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa924101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa92259c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa92406b6e0 0x7fa924102d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:02.999 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa924101ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:49538/0 (socket says 172.21.15.5:49538) 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 -- 172.21.15.5:0/3524365284 learned_addr learned my addr 172.21.15.5:0/3524365284 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa921d9b640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa924105b80 0x7fa924101590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 -- 172.21.15.5:0/3524365284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa924105b80 msgr2=0x7fa924101590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa924105b80 0x7fa924101590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 -- 172.21.15.5:0/3524365284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa92406b6e0 msgr2=0x7fa924102d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa92406b6e0 0x7fa924102d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 -- 172.21.15.5:0/3524365284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924102390 con 0x7fa924108730 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.996+0000 7fa922d9d640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa924101ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0097b0 tx=0x7fa91c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.997+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c004240 con 0x7fa924108730 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.997+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa91c0317c0 con 0x7fa924108730 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.997+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9241a2e00 con 0x7fa924108730 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.997+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c02fd80 con 0x7fa924108730 2024-09-10T22:09:03.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.997+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9241a32b0 con 0x7fa924108730 2024-09-10T22:09:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.998+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9240fecd0 con 0x7fa924108730 2024-09-10T22:09:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:02.999+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fa91c0043e0 con 0x7fa924108730 2024-09-10T22:09:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:03.000+0000 7fa9137fe640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa90c0b5250 0x7fa90c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:03.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:03.000+0000 7fa92259c640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa90c0b5250 0x7fa90c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:03.000+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa91c1056a0 con 0x7fa924108730 2024-09-10T22:09:03.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:03.000+0000 7fa92259c640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa90c0b5250 0x7fa90c0b7710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9140058c0 tx=0x7fa91400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:09:03.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:03.003+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa91c082220 con 0x7fa924108730 2024-09-10T22:09:03.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:03.198+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa924063590 con 0x7fa90c0b5250 2024-09-10T22:09:03.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:03 smithi005 ceph-mon[31115]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:03.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:03 smithi189 ceph-mon[35784]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:03.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:03 smithi052 ceph-mon[34997]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:04.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:04 smithi005 ceph-mon[31115]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:04.284 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:04.285 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:04.285 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:04.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:04 smithi189 ceph-mon[35784]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:04.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:04.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:04.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:04.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:04 smithi052 ceph-mon[34997]: from='client.14358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:04.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:04.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:04.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:05.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:05 smithi189 ceph-mon[35784]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:05.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:05 smithi052 ceph-mon[34997]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:05 smithi005 ceph-mon[31115]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:06.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:06 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3035185597' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0222d8dd-610f-4eea-9c9f-2beea3a602b6"} : dispatch 2024-09-10T22:09:06.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:06 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3035185597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0222d8dd-610f-4eea-9c9f-2beea3a602b6"}]': finished 2024-09-10T22:09:06.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:06 smithi189 ceph-mon[35784]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T22:09:06.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:06 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:06.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:06 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/824457845' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:06.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:06 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3035185597' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0222d8dd-610f-4eea-9c9f-2beea3a602b6"} : dispatch 2024-09-10T22:09:06.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:06 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3035185597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0222d8dd-610f-4eea-9c9f-2beea3a602b6"}]': finished 2024-09-10T22:09:06.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:06 smithi052 ceph-mon[34997]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T22:09:06.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:06 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:06.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:06 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/824457845' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:06.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:06 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3035185597' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0222d8dd-610f-4eea-9c9f-2beea3a602b6"} : dispatch 2024-09-10T22:09:06.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:06 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3035185597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0222d8dd-610f-4eea-9c9f-2beea3a602b6"}]': finished 2024-09-10T22:09:06.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:06 smithi005 ceph-mon[31115]: osdmap e5: 1 total, 0 up, 1 in 2024-09-10T22:09:06.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:06.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:06 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/824457845' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:07.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:07 smithi189 ceph-mon[35784]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:07.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:07 smithi052 ceph-mon[34997]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:07.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:07 smithi005 ceph-mon[31115]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:09.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:09 smithi189 ceph-mon[35784]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:09.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:09 smithi052 ceph-mon[34997]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:09.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:09 smithi005 ceph-mon[31115]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:11.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:11 smithi005 ceph-mon[31115]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:11 smithi189 ceph-mon[35784]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:11.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:11 smithi052 ceph-mon[34997]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:13.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:13 smithi189 ceph-mon[35784]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:13.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:13 smithi052 ceph-mon[34997]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:13.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:13 smithi005 ceph-mon[31115]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:14.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:09:14.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:14.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:09:14.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:14.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-10T22:09:14.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:15.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:15 smithi189 ceph-mon[35784]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:15.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:15 smithi189 ceph-mon[35784]: Deploying daemon osd.0 on smithi005 2024-09-10T22:09:15.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:15 smithi005 ceph-mon[31115]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:15.473 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:15 smithi005 ceph-mon[31115]: Deploying daemon osd.0 on smithi005 2024-09-10T22:09:15.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:15 smithi052 ceph-mon[34997]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:15.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:15 smithi052 ceph-mon[34997]: Deploying daemon osd.0 on smithi005 2024-09-10T22:09:17.409 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:17 smithi005 ceph-mon[31115]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:17.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:17 smithi189 ceph-mon[35784]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:17.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:17 smithi052 ceph-mon[34997]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:19.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:19 smithi189 ceph-mon[35784]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:19 smithi005 ceph-mon[31115]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:19.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:19 smithi052 ceph-mon[34997]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:21 smithi189 ceph-mon[35784]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:21.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:21 smithi052 ceph-mon[34997]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:21.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:21.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:21.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:21.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:21 smithi005 ceph-mon[31115]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:21.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:21.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:21.527 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:23 smithi052 ceph-mon[34997]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:23 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:23 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:23 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:23 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:23 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:23 smithi005 ceph-mon[31115]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:23.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:23 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:23 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:23 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:23.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:23 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:23.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:23 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:23 smithi189 ceph-mon[35784]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:23 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:23 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:23 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:23.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:23 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:23.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:23 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:24.857 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.855+0000 7fa9137fe640 1 -- 172.21.15.5:0/3524365284 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa924063590 con 0x7fa90c0b5250 2024-09-10T22:09:24.857 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2024-09-10T22:09:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa90c0b5250 msgr2=0x7fa90c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:24.858 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa90c0b5250 0x7fa90c0b7710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9140058c0 tx=0x7fa91400a250 comp rx=0 tx=0).stop 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 msgr2=0x7fa924101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa924101ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0097b0 tx=0x7fa91c003c20 comp rx=0 tx=0).stop 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 shutdown_connections 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa90c0b5250 0x7fa90c0b7710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa924108730 0x7fa924101ad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa924105b80 0x7fa924101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 --2- 172.21.15.5:0/3524365284 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa92406b6e0 0x7fa924102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 >> 172.21.15.5:0/3524365284 conn(0x7fa9240fd1e0 msgr2=0x7fa924103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 shutdown_connections 2024-09-10T22:09:24.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:09:24.857+0000 7fa928cf9640 1 -- 172.21.15.5:0/3524365284 wait complete. 2024-09-10T22:09:25.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:25 smithi052 ceph-mon[34997]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:25.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:25 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:25.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:25 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:25.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:25 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:25.504 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:25 smithi005 ceph-mon[31115]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:25.505 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:25 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:25.505 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:25 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:25.505 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:25 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:25.542 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.0.service 2024-09-10T22:09:25.544 INFO:tasks.cephadm:Deploying osd.1 on smithi052 with /dev/vg_nvme/lv_4... 2024-09-10T22:09:25.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:09:25.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:25 smithi189 ceph-mon[35784]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:25.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:25 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:25.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:25 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:25.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:25 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:25.804 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:09:26.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:26 smithi052 ceph-mon[34997]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:09:26.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:26 smithi005 ceph-mon[31115]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:09:26.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:09:26 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0[47307]: 2024-09-10T22:09:26.167+0000 7f9b06357640 -1 osd.0 0 log_to_monitors true 2024-09-10T22:09:26.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:26 smithi189 ceph-mon[35784]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-10T22:09:27.484 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:27 smithi052 ceph-mon[34997]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:27.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:27 smithi052 ceph-mon[34997]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:09:27.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:27 smithi052 ceph-mon[34997]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:09:27.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:27 smithi052 ceph-mon[34997]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:09:27.485 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:27.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-mon[31115]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:27.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-mon[31115]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:09:27.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-mon[31115]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:09:27.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-mon[31115]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:09:27.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:27.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0[47307]: 2024-09-10T22:09:27.260+0000 7f9b022da640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T22:09:27.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:09:27 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0[47307]: 2024-09-10T22:09:27.265+0000 7f9afe101640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:09:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:27 smithi189 ceph-mon[35784]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:27 smithi189 ceph-mon[35784]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-10T22:09:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:27 smithi189 ceph-mon[35784]: osdmap e6: 1 total, 0 up, 1 in 2024-09-10T22:09:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:27 smithi189 ceph-mon[35784]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:09:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.429 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:28 smithi052 ceph-mon[34997]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:09:28.429 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:28 smithi052 ceph-mon[34997]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:09:28.430 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:28 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.430 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:28 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.432 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:09:28.461 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_4 2024-09-10T22:09:28.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:28 smithi005 ceph-mon[31115]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:09:28.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:28 smithi005 ceph-mon[31115]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:09:28.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:28 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:28 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:28 smithi189 ceph-mon[35784]: from='osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:09:28.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:28 smithi189 ceph-mon[35784]: osdmap e7: 1 total, 0 up, 1 in 2024-09-10T22:09:28.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:28 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:28 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:28.706 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:09:29.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 -- 172.21.15.52:0/3796481636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c406b6e0 msgr2=0x7fe0c41055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:29.175 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/3796481636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c406b6e0 0x7fe0c41055f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009900 tx=0x7fe0bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 -- 172.21.15.52:0/3796481636 shutdown_connections 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/3796481636 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c4108730 0x7fe0c410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/3796481636 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0c4105b80 0x7fe0c4107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/3796481636 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c406b6e0 0x7fe0c41055f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 -- 172.21.15.52:0/3796481636 >> 172.21.15.52:0/3796481636 conn(0x7fe0c40fd1e0 msgr2=0x7fe0c40ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 -- 172.21.15.52:0/3796481636 shutdown_connections 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 -- 172.21.15.52:0/3796481636 wait complete. 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 Processor -- start 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.156+0000 7fe0cc1de640 1 -- start start 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c406b6e0 0x7fe0c4198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0c4105b80 0x7fe0c4199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 0x7fe0c419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:29.176 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c410e6b0 con 0x7fe0c406b6e0 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c410e530 con 0x7fe0c4108730 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c410e830 con 0x7fe0c4105b80 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 0x7fe0c419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 0x7fe0c419a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:36316/0 (socket says 172.21.15.52:36316) 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 -- 172.21.15.52:0/1476656362 learned_addr learned my addr 172.21.15.52:0/1476656362 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0c9f7a640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c406b6e0 0x7fe0c4198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0c9779640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0c4105b80 0x7fe0c4199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 -- 172.21.15.52:0/1476656362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0c4105b80 msgr2=0x7fe0c4199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0c4105b80 0x7fe0c4199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 -- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c406b6e0 msgr2=0x7fe0c4198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c406b6e0 0x7fe0c4198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:29.177 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 -- 172.21.15.52:0/1476656362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c419a970 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0ca77b640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 0x7fe0c419a0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400eaa0 tx=0x7fe0b400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400cdb0 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0b4005020 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c419ac60 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40116d0 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.157+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c41a1340 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.159+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c40fecd0 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.160+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7fe0b400f040 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.161+0000 7fe0c2ffd640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe0ac0b5250 0x7fe0ac0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.161+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7fe0b40e42f0 con 0x7fe0c4108730 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.161+0000 7fe0c9f7a640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe0ac0b5250 0x7fe0ac0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.161+0000 7fe0c9f7a640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe0ac0b5250 0x7fe0ac0b7710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc000c00 tx=0x7fe0bc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:09:29.178 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.165+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe0b4016030 con 0x7fe0c4108730 2024-09-10T22:09:29.363 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:29.360+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe0c4063590 con 0x7fe0ac0b5250 2024-09-10T22:09:29.363 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:09:29.363 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:09:29.363 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:29.363 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:29.363 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] boot 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi005 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi005 to 17092M 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:29.364 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] boot 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi005 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi005 to 17092M 2024-09-10T22:09:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:29.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:29.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: osd.0 [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] boot 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: osdmap e8: 1 total, 1 up, 1 in 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi005 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:09:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi005 to 17092M 2024-09-10T22:09:29.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:29.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:29.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:29.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:30.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:30 smithi052 ceph-mon[34997]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:30.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:30.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:30.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:30.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:30 smithi052 ceph-mon[34997]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T22:09:30.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:30 smithi189 ceph-mon[35784]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:30.539 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:30.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:30.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:30.540 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:30 smithi189 ceph-mon[35784]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T22:09:30.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:30 smithi005 ceph-mon[31115]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:30.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:30.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:30.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:30.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:30 smithi005 ceph-mon[31115]: osdmap e9: 1 total, 1 up, 1 in 2024-09-10T22:09:31.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:31 smithi189 ceph-mon[35784]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:31.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:31 smithi052 ceph-mon[34997]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:31 smithi005 ceph-mon[31115]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:32.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:32 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/2991049799' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"} : dispatch 2024-09-10T22:09:32.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:32 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"} : dispatch 2024-09-10T22:09:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:32 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"}]': finished 2024-09-10T22:09:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:32 smithi189 ceph-mon[35784]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T22:09:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:32.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:32 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/3001704796' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:32.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:32 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/2991049799' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"} : dispatch 2024-09-10T22:09:32.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:32 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"} : dispatch 2024-09-10T22:09:32.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:32 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"}]': finished 2024-09-10T22:09:32.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:32 smithi052 ceph-mon[34997]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T22:09:32.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:32.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:32 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/3001704796' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:32.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:32 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/2991049799' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"} : dispatch 2024-09-10T22:09:32.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:32 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"} : dispatch 2024-09-10T22:09:32.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:32 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5a473b05-b36a-4011-91d0-e93a9190a8b9"}]': finished 2024-09-10T22:09:32.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:32 smithi005 ceph-mon[31115]: osdmap e10: 2 total, 1 up, 2 in 2024-09-10T22:09:32.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:32.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:32 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/3001704796' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:33.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:33 smithi189 ceph-mon[35784]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:33 smithi052 ceph-mon[34997]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:33.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:33 smithi005 ceph-mon[31115]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:35.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:35 smithi189 ceph-mon[35784]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:35 smithi052 ceph-mon[34997]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:35.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:35 smithi005 ceph-mon[31115]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:37.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:37 smithi052 ceph-mon[34997]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:37.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:37 smithi189 ceph-mon[35784]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:37.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:37 smithi005 ceph-mon[31115]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:39.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:39 smithi189 ceph-mon[35784]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:39 smithi052 ceph-mon[34997]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:39 smithi005 ceph-mon[31115]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:40.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:09:40.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:40.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:09:40.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:40.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-10T22:09:40.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:41.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:41 smithi189 ceph-mon[35784]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:41.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:41 smithi189 ceph-mon[35784]: Deploying daemon osd.1 on smithi052 2024-09-10T22:09:41.715 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:41 smithi052 ceph-mon[34997]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:41.715 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:41 smithi052 ceph-mon[34997]: Deploying daemon osd.1 on smithi052 2024-09-10T22:09:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:41 smithi005 ceph-mon[31115]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:41 smithi005 ceph-mon[31115]: Deploying daemon osd.1 on smithi052 2024-09-10T22:09:42.688 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:42 smithi052 ceph-mon[34997]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:42.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:42 smithi189 ceph-mon[35784]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:42.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:42 smithi005 ceph-mon[31115]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:45.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:44 smithi052 ceph-mon[34997]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:45.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:44 smithi005 ceph-mon[31115]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:44 smithi189 ceph-mon[35784]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:47.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:46 smithi052 ceph-mon[34997]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:47.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:47.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:47.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:47.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:46 smithi005 ceph-mon[31115]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:47.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:47.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:47.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:46 smithi189 ceph-mon[35784]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:48.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:48 smithi052 ceph-mon[34997]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:49.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:48 smithi005 ceph-mon[31115]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:49.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:48 smithi189 ceph-mon[35784]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:49.901 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 1 on host 'smithi052' 2024-09-10T22:09:49.901 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.899+0000 7fe0c2ffd640 1 -- 172.21.15.52:0/1476656362 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe0c4063590 con 0x7fe0ac0b5250 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe0ac0b5250 msgr2=0x7fe0ac0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe0ac0b5250 0x7fe0ac0b7710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc000c00 tx=0x7fe0bc0314a0 comp rx=0 tx=0).stop 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 msgr2=0x7fe0c419a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 0x7fe0c419a0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400eaa0 tx=0x7fe0b400ef60 comp rx=0 tx=0).stop 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 shutdown_connections 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe0ac0b5250 0x7fe0ac0b7710 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe0c4108730 0x7fe0c419a0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:49.903 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe0c4105b80 0x7fe0c4199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 --2- 172.21.15.52:0/1476656362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe0c406b6e0 0x7fe0c4198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.901+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 >> 172.21.15.52:0/1476656362 conn(0x7fe0c40fd1e0 msgr2=0x7fe0c4103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:09:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.902+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 shutdown_connections 2024-09-10T22:09:49.904 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:09:49.902+0000 7fe0cc1de640 1 -- 172.21.15.52:0/1476656362 wait complete. 2024-09-10T22:09:50.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:50.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:50.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:09:50.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:50.549 DEBUG:teuthology.orchestra.run.smithi052:osd.1> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.1.service 2024-09-10T22:09:50.551 INFO:tasks.cephadm:Deploying osd.2 on smithi189 with /dev/vg_nvme/lv_4... 2024-09-10T22:09:50.552 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-10T22:09:50.805 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:09:51.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:51 smithi189 ceph-mon[35784]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:51.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:51 smithi052 ceph-mon[34997]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:51.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:51 smithi005 ceph-mon[31115]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:52.500 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:09:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1[39410]: 2024-09-10T22:09:52.309+0000 7f2937700640 -1 osd.1 0 log_to_monitors true 2024-09-10T22:09:53.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:53 smithi189 ceph-mon[35784]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:53.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:53 smithi189 ceph-mon[35784]: from='osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:09:53.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:53 smithi189 ceph-mon[35784]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:09:53.238 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:09:53.265 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_4 2024-09-10T22:09:53.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:53 smithi005 ceph-mon[31115]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:53.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:53 smithi005 ceph-mon[31115]: from='osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:09:53.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:53 smithi005 ceph-mon[31115]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:09:53.387 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:53 smithi052 ceph-mon[34997]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:53.387 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:53 smithi052 ceph-mon[34997]: from='osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:09:53.387 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:53 smithi052 ceph-mon[34997]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-10T22:09:53.523 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:09:53.953 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.948+0000 7f3178474640 1 -- 172.21.15.189:0/1583042531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170105b90 msgr2=0x7f3170108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:53.955 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.948+0000 7f3178474640 1 --2- 172.21.15.189:0/1583042531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170105b90 0x7f3170108000 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3160009900 tx=0x7f316002a410 comp rx=0 tx=0).stop 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 -- 172.21.15.189:0/1583042531 shutdown_connections 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 --2- 172.21.15.189:0/1583042531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3170108740 0x7f317010ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 --2- 172.21.15.189:0/1583042531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170105b90 0x7f3170108000 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 --2- 172.21.15.189:0/1583042531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f317006c060 0x7f3170105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 -- 172.21.15.189:0/1583042531 >> 172.21.15.189:0/1583042531 conn(0x7f31700fd210 msgr2=0x7f31700ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 -- 172.21.15.189:0/1583042531 shutdown_connections 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 -- 172.21.15.189:0/1583042531 wait complete. 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 Processor -- start 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 -- start start 2024-09-10T22:09:53.956 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317006c060 0x7f3170102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3170105b90 0x7f31701015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.949+0000 7f3178474640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 0x7f3170101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3178474640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f317010e670 con 0x7f3170105b90 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3178474640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f317010e4f0 con 0x7f317006c060 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3178474640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f317010e7f0 con 0x7f3170108740 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 0x7f3170101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176210640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317006c060 0x7f3170102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 0x7f3170101ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:34900/0 (socket says 172.21.15.189:34900) 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176210640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317006c060 0x7f3170102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.189:58106/0 (socket says 172.21.15.189:58106) 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 -- 172.21.15.189:0/228108653 learned_addr learned my addr 172.21.15.189:0/228108653 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3175a0f640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3170105b90 0x7f31701015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 -- 172.21.15.189:0/228108653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317006c060 msgr2=0x7f3170102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:53.957 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317006c060 0x7f3170102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 -- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3170105b90 msgr2=0x7f31701015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3170105b90 0x7f31701015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 -- 172.21.15.189:0/228108653 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31701023a0 con 0x7f3170108740 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3175a0f640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3170105b90 0x7f31701015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3176a11640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 0x7f3170101ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f316800cce0 tx=0x7f316800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316800f450 con 0x7f3170108740 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f316800faa0 con 0x7f3170108740 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31701a2e90 con 0x7f3170108740 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3168018b70 con 0x7f3170108740 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.950+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701a3340 con 0x7f3170108740 2024-09-10T22:09:53.958 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.952+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31700fed00 con 0x7f3170108740 2024-09-10T22:09:53.959 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.953+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f316800f5f0 con 0x7f3170108740 2024-09-10T22:09:53.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.953+0000 7f31677fe640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f315c0b52d0 0x7f315c0b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:09:53.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.954+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f31680e4890 con 0x7f3170108740 2024-09-10T22:09:53.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.954+0000 7f3176210640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f315c0b52d0 0x7f315c0b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:09:53.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.954+0000 7f3176210640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f315c0b52d0 0x7f315c0b7790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f316c0058c0 tx=0x7f316c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:09:53.960 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:53.958+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3168014030 con 0x7f3170108740 2024-09-10T22:09:54.160 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:09:54.157+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3170063590 con 0x7f315c0b52d0 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi052 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:54.161 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:54.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:09:54.162 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:54 smithi189 ceph-mon[35784]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T22:09:54.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi052 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:09:54.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:54 smithi005 ceph-mon[31115]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T22:09:54.500 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1[39410]: 2024-09-10T22:09:54.053+0000 7f2933683640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T22:09:54.500 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1[39410]: 2024-09-10T22:09:54.057+0000 7f292f4aa640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: osdmap e11: 2 total, 1 up, 2 in 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi052 2024-09-10T22:09:54.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:09:54.501 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:54 smithi052 ceph-mon[34997]: osdmap e12: 2 total, 1 up, 2 in 2024-09-10T22:09:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-10T22:09:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:55.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:55.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi052 to 17092M 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:09:55.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:09:56.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:56 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:09:56.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:56 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:09:56.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:56 smithi005 ceph-mon[31115]: osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] boot 2024-09-10T22:09:56.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:56 smithi005 ceph-mon[31115]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T22:09:56.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:56.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:56 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:09:56.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:56 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:09:56.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:56 smithi189 ceph-mon[35784]: osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] boot 2024-09-10T22:09:56.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:56 smithi189 ceph-mon[35784]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T22:09:56.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:56.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:56 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:09:56.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:56 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:09:56.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:56 smithi052 ceph-mon[34997]: osd.1 [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] boot 2024-09-10T22:09:56.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:56 smithi052 ceph-mon[34997]: osdmap e13: 2 total, 2 up, 2 in 2024-09-10T22:09:56.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-10T22:09:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T22:09:57.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/183923436' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"} : dispatch 2024-09-10T22:09:57.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"} : dispatch 2024-09-10T22:09:57.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"}]': finished 2024-09-10T22:09:57.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T22:09:57.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:09:57.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:57 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/2991106772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/183923436' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"} : dispatch 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"} : dispatch 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"}]': finished 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:09:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:57 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/2991106772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: osdmap e14: 2 total, 2 up, 2 in 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/183923436' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"} : dispatch 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"} : dispatch 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "025f8eb8-11e9-4f44-a07e-bc09e476780d"}]': finished 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: osdmap e15: 3 total, 2 up, 3 in 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:09:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:57 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/2991106772' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:09:59.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:09:59 smithi005 ceph-mon[31115]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:09:59.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:09:59 smithi189 ceph-mon[35784]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:09:59.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:09:59 smithi052 ceph-mon[34997]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:00.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:00 smithi005 ceph-mon[31115]: overall HEALTH_OK 2024-09-10T22:10:00.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:00 smithi189 ceph-mon[35784]: overall HEALTH_OK 2024-09-10T22:10:00.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:00 smithi052 ceph-mon[34997]: overall HEALTH_OK 2024-09-10T22:10:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:01 smithi189 ceph-mon[35784]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:01.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:01 smithi005 ceph-mon[31115]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:01.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:01 smithi052 ceph-mon[34997]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:03.315 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:03 smithi189 ceph-mon[35784]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:03.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:03 smithi005 ceph-mon[31115]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:03.334 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:03 smithi052 ceph-mon[34997]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:10:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:04.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:10:04.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:04.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-10T22:10:04.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:05.362 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:05 smithi189 ceph-mon[35784]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:05.363 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:05 smithi189 ceph-mon[35784]: Deploying daemon osd.2 on smithi189 2024-09-10T22:10:05.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:05 smithi052 ceph-mon[34997]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:05.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:05 smithi052 ceph-mon[34997]: Deploying daemon osd.2 on smithi189 2024-09-10T22:10:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:05 smithi005 ceph-mon[31115]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:05 smithi005 ceph-mon[31115]: Deploying daemon osd.2 on smithi189 2024-09-10T22:10:07.167 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:07 smithi189 ceph-mon[35784]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:07.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:07 smithi052 ceph-mon[34997]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:07.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:07 smithi005 ceph-mon[31115]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:09.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:09 smithi189 ceph-mon[35784]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:09.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:09 smithi052 ceph-mon[34997]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:09.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:09 smithi005 ceph-mon[31115]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:10.434 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:10.434 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:10.434 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:10.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:10.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:10.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:10.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:10.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:10.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:11.375 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:11 smithi189 ceph-mon[35784]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:11.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:11 smithi052 ceph-mon[34997]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:11.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:11 smithi005 ceph-mon[31115]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:13.248 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:13 smithi189 ceph-mon[35784]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:13.248 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.248 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.248 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:13.248 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:13.248 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.287+0000 7f31677fe640 1 -- 172.21.15.189:0/228108653 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3170063590 con 0x7f315c0b52d0 2024-09-10T22:10:13.289 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 2 on host 'smithi189' 2024-09-10T22:10:13.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f315c0b52d0 msgr2=0x7f315c0b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:13.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f315c0b52d0 0x7f315c0b7790 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f316c0058c0 tx=0x7f316c00a2d0 comp rx=0 tx=0).stop 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 msgr2=0x7f3170101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 0x7f3170101ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f316800cce0 tx=0x7f316800a620 comp rx=0 tx=0).stop 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 shutdown_connections 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f315c0b52d0 0x7f315c0b7790 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3170108740 0x7f3170101ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3170105b90 0x7f31701015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 --2- 172.21.15.189:0/228108653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f317006c060 0x7f3170102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 >> 172.21.15.189:0/228108653 conn(0x7f31700fd210 msgr2=0x7f3170103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 shutdown_connections 2024-09-10T22:10:13.292 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:10:13.290+0000 7f3178474640 1 -- 172.21.15.189:0/228108653 wait complete. 2024-09-10T22:10:13.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:13 smithi052 ceph-mon[34997]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:13 smithi005 ceph-mon[31115]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:13.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:13.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:13.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:13.903 DEBUG:teuthology.orchestra.run.smithi189:osd.2> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.2.service 2024-09-10T22:10:13.905 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_3... 2024-09-10T22:10:13.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:10:14.126 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:14.127 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:14.127 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:14.173 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:10:14.292 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:14.293 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:14.293 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:14.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:14.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:14.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:15.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:15 smithi189 ceph-mon[35784]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:15.576 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:15 smithi005 ceph-mon[31115]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:15.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:15 smithi052 ceph-mon[34997]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:15.944 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2[40755]: 2024-09-10T22:10:15.442+0000 7f4ba8bb0640 -1 osd.2 0 log_to_monitors true 2024-09-10T22:10:16.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:16 smithi005 ceph-mon[31115]: from='osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:10:16.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:16 smithi005 ceph-mon[31115]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:10:16.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:16 smithi189 ceph-mon[35784]: from='osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:10:16.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:16 smithi189 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:10:16.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:16 smithi052 ceph-mon[34997]: from='osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:10:16.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:16 smithi052 ceph-mon[34997]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-10T22:10:16.767 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:10:16.804 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2024-09-10T22:10:17.059 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.510 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:17.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:17.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:17.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 -- 172.21.15.5:0/4285790073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8102ab0 msgr2=0x7f56e8102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 --2- 172.21.15.5:0/4285790073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8102ab0 0x7f56e8102f30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009930 tx=0x7f56dc02a420 comp rx=0 tx=0).stop 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 -- 172.21.15.5:0/4285790073 shutdown_connections 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 --2- 172.21.15.5:0/4285790073 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8103470 0x7f56e8109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 --2- 172.21.15.5:0/4285790073 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8102ab0 0x7f56e8102f30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 --2- 172.21.15.5:0/4285790073 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56e8101950 0x7f56e8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 -- 172.21.15.5:0/4285790073 >> 172.21.15.5:0/4285790073 conn(0x7f56e80fd200 msgr2=0x7f56e80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 -- 172.21.15.5:0/4285790073 shutdown_connections 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 -- 172.21.15.5:0/4285790073 wait complete. 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.594+0000 7f56ed267640 1 Processor -- start 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 -- start start 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 0x7f56e806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8102ab0 0x7f56e819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56e8103470 0x7f56e81a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f56e810d5d0 con 0x7f56e8101950 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f56e810d450 con 0x7f56e8103470 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56ed267640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f56e810d750 con 0x7f56e8102ab0 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 0x7f56e806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 0x7f56e806bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58782/0 (socket says 172.21.15.5:58782) 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 -- 172.21.15.5:0/4139279477 learned_addr learned my addr 172.21.15.5:0/4139279477 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e67fc640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8102ab0 0x7f56e819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e77fe640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56e8103470 0x7f56e81a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 -- 172.21.15.5:0/4139279477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8102ab0 msgr2=0x7f56e819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8102ab0 0x7f56e819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 -- 172.21.15.5:0/4139279477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56e8103470 msgr2=0x7f56e81a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56e8103470 0x7f56e81a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:17.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 -- 172.21.15.5:0/4139279477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e81a0a30 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.595+0000 7f56e6ffd640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 0x7f56e806bdd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56d800d950 tx=0x7f56d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.596+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d8017070 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.596+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e81a0d20 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.596+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56d8009c30 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.596+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d800f620 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.596+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e81a11a0 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.597+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56e8108cd0 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.598+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 15) ==== 153193+0+0 (secure 0 0 0) 0x7f56d8005030 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.599+0000 7f56cffff640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f56d00b5250 0x7f56d00b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.599+0000 7f56e67fc640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f56d00b5250 0x7f56d00b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.599+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f56d80e4110 con 0x7f56e8101950 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.599+0000 7f56e67fc640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f56d00b5250 0x7f56d00b7710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56dc006010 tx=0x7f56dc031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:10:17.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.602+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f56d80ac720 con 0x7f56e8101950 2024-09-10T22:10:17.693 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2[40755]: 2024-09-10T22:10:17.314+0000 7f4ba4b33640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T22:10:17.693 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2[40755]: 2024-09-10T22:10:17.317+0000 7f4ba095a640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:17.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-10T22:10:17.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: osdmap e16: 3 total, 2 up, 3 in 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:17.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:17.799+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f56e8063590 con 0x7f56d00b5250 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi189 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:10:18.563 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi189 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:10:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:10:18.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:18.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi189 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi189 to 17088M 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: osdmap e17: 3 total, 2 up, 3 in 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:10:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:19.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] boot 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T22:10:19.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:19 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] boot 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T22:10:19.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:19 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:10:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:10:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-10T22:10:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:10:19.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:19.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: osd.2 [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] boot 2024-09-10T22:10:19.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: osdmap e18: 3 total, 3 up, 3 in 2024-09-10T22:10:19.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:19 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-10T22:10:20.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 ceph-mon[31115]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T22:10:20.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52142]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52142]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52142]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52147]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52147]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.583 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52147]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 ceph-mon[35784]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T22:10:20.595 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:10:20.595 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44531]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:10:20.595 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.595 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.724 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 ceph-mon[34997]: osdmap e19: 3 total, 3 up, 3 in 2024-09-10T22:10:20.725 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43420]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43420]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43420]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43423]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43423]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.725 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43423]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.866 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44531]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.866 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44535]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:10:20.866 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44535]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.866 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.866 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44535]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44538]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:10:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44538]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44538]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.866 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44541]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:10:20.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44541]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.867 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:20 smithi189 sudo[44541]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52151]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:10:20.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52151]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52151]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52159]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:10:20.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52159]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.997 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:20 smithi005 sudo[52159]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:20.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43426]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-10T22:10:20.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43426]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:20.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:20.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43426]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:21.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43429]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-10T22:10:21.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43429]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-10T22:10:21.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-10T22:10:21.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:20 smithi052 sudo[43429]: pam_unix(sudo:session): session closed for user root 2024-09-10T22:10:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: pgmap v92: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:10:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T22:10:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:10:21.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/30343902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2de667c-2627-47c7-a890-837a819b62ff"} : dispatch 2024-09-10T22:10:21.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:10:21.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/30343902' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2de667c-2627-47c7-a890-837a819b62ff"}]': finished 2024-09-10T22:10:21.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T22:10:21.584 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:21.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.585 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.586 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.587 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:21 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/935719413' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:10:21.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: pgmap v92: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:21.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/30343902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2de667c-2627-47c7-a890-837a819b62ff"} : dispatch 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/30343902' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2de667c-2627-47c7-a890-837a819b62ff"}]': finished 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:21 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/935719413' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: pgmap v92: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: osdmap e20: 3 total, 3 up, 3 in 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/30343902' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d2de667c-2627-47c7-a890-837a819b62ff"} : dispatch 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/30343902' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d2de667c-2627-47c7-a890-837a819b62ff"}]': finished 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: osdmap e21: 4 total, 3 up, 4 in 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-10T22:10:21.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:21 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/935719413' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:10:22.418 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:22.414+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f56d80a8290 con 0x7f56e8101950 2024-09-10T22:10:22.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:22 smithi189 ceph-mon[35784]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T22:10:22.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:22.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:22 smithi052 ceph-mon[34997]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T22:10:22.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:22.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:22 smithi005 ceph-mon[31115]: osdmap e22: 4 total, 3 up, 4 in 2024-09-10T22:10:22.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:23 smithi189 ceph-mon[35784]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:23 smithi189 ceph-mon[35784]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T22:10:23.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:23 smithi052 ceph-mon[34997]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:23.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:23 smithi052 ceph-mon[34997]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T22:10:23.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:23 smithi005 ceph-mon[31115]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:23.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:23 smithi005 ceph-mon[31115]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-10T22:10:25.581 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:25 smithi005 ceph-mon[31115]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:25.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:25 smithi189 ceph-mon[35784]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:25.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:25 smithi052 ceph-mon[34997]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:27 smithi189 ceph-mon[35784]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:27.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:27 smithi052 ceph-mon[34997]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:27.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:27 smithi005 ceph-mon[31115]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:29 smithi189 ceph-mon[35784]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:10:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:29 smithi052 ceph-mon[34997]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:10:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:29.801 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:29 smithi005 ceph-mon[31115]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:29.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-10T22:10:29.802 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:30.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:30 smithi189 ceph-mon[35784]: Deploying daemon osd.3 on smithi005 2024-09-10T22:10:30.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:30 smithi052 ceph-mon[34997]: Deploying daemon osd.3 on smithi005 2024-09-10T22:10:30.792 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:30 smithi005 ceph-mon[31115]: Deploying daemon osd.3 on smithi005 2024-09-10T22:10:31.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:31 smithi189 ceph-mon[35784]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:31.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:31 smithi052 ceph-mon[34997]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:31.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:31 smithi005 ceph-mon[31115]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:33.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:33 smithi189 ceph-mon[35784]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:33 smithi052 ceph-mon[34997]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:33.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:33 smithi005 ceph-mon[31115]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:35.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:35 smithi005 ceph-mon[31115]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:35.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:35 smithi189 ceph-mon[35784]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:35 smithi052 ceph-mon[34997]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:36.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:36.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:36.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:36.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:36.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:36.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:36.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:36.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:36.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:37.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:37 smithi005 ceph-mon[31115]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:37.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:37 smithi189 ceph-mon[35784]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:37.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:37 smithi052 ceph-mon[34997]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:39.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:39 smithi005 ceph-mon[31115]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:39.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:39.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:39.528 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.568+0000 7f56cffff640 1 -- 172.21.15.5:0/4139279477 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f56e8063590 con 0x7f56d00b5250 2024-09-10T22:10:39.571 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f56d00b5250 msgr2=0x7f56d00b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f56d00b5250 0x7f56d00b7710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f56dc006010 tx=0x7f56dc031430 comp rx=0 tx=0).stop 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 msgr2=0x7f56e806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 0x7f56e806bdd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f56d800d950 tx=0x7f56d800de10 comp rx=0 tx=0).stop 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 shutdown_connections 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f56d00b5250 0x7f56d00b7710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f56e8103470 0x7f56e81a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f56e8102ab0 0x7f56e819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 --2- 172.21.15.5:0/4139279477 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f56e8101950 0x7f56e806bdd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:39.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.571+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 >> 172.21.15.5:0/4139279477 conn(0x7f56e80fd200 msgr2=0x7f56e8105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:10:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.572+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 shutdown_connections 2024-09-10T22:10:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:10:39.572+0000 7f56ed267640 1 -- 172.21.15.5:0/4139279477 wait complete. 2024-09-10T22:10:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:39 smithi189 ceph-mon[35784]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:39.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:39 smithi052 ceph-mon[34997]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:39.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:39.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:39.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:39.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:40.193 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.3.service 2024-09-10T22:10:40.196 INFO:tasks.cephadm:Deploying osd.4 on smithi052 with /dev/vg_nvme/lv_3... 2024-09-10T22:10:40.196 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:10:40.419 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:40.419 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:40.419 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:40.456 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:10:40.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:40.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:40.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:40.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:10:40.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:40.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:41.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:41 smithi005 ceph-mon[31115]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:41.622 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:41 smithi052 ceph-mon[34997]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:41.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:41 smithi189 ceph-mon[35784]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:42.083 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:10:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:10:41.738+0000 7f5de289b640 -1 osd.3 0 log_to_monitors true 2024-09-10T22:10:42.491 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:42 smithi052 ceph-mon[34997]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:10:42.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:42 smithi005 ceph-mon[31115]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:10:42.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:42 smithi189 ceph-mon[35784]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-10T22:10:43.296 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:10:43.322 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_3 2024-09-10T22:10:43.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:10:43.282+0000 7f5dde81e640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T22:10:43.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:10:43.286+0000 7f5dda645640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:10:43.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:43.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.573 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.666 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:43.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:43.667 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:43.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: osdmap e23: 4 total, 3 up, 4 in 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:10:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.020+0000 7f287bba4640 1 -- 172.21.15.52:0/508029615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 msgr2=0x7f287410a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.020+0000 7f287bba4640 1 --2- 172.21.15.52:0/508029615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287410a350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2864009900 tx=0x7f286402a410 comp rx=0 tx=0).stop 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 -- 172.21.15.52:0/508029615 shutdown_connections 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 --2- 172.21.15.52:0/508029615 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 0x7f287410ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 --2- 172.21.15.52:0/508029615 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287410a350 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 --2- 172.21.15.52:0/508029615 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f287406bdf0 0x7f2874107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 -- 172.21.15.52:0/508029615 >> 172.21.15.52:0/508029615 conn(0x7f28740fd210 msgr2=0x7f28740ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 -- 172.21.15.52:0/508029615 shutdown_connections 2024-09-10T22:10:44.055 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 -- 172.21.15.52:0/508029615 wait complete. 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 Processor -- start 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.021+0000 7f287bba4640 1 -- start start 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287bba4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f287406bdf0 0x7f287419b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287bba4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287419b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287bba4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 0x7f287419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287bba4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2874110910 con 0x7f287410a970 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287bba4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2874110790 con 0x7f2874107f60 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287bba4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2874110a90 con 0x7f287406bdf0 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287419b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287419b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:59146/0 (socket says 172.21.15.52:59146) 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 -- 172.21.15.52:0/1272628563 learned_addr learned my addr 172.21.15.52:0/1272628563 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T22:10:44.056 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f2879940640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f287406bdf0 0x7f287419b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287a141640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 0x7f287419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 -- 172.21.15.52:0/1272628563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f287406bdf0 msgr2=0x7f287419b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f287406bdf0 0x7f287419b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 -- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 msgr2=0x7f287419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 0x7f287419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 -- 172.21.15.52:0/1272628563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287419cb30 con 0x7f2874107f60 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287a141640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 0x7f287419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.022+0000 7f287913f640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287419b650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2864031500 tx=0x7f2864003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.023+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f286403f070 con 0x7f2874107f60 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.023+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2864031c50 con 0x7f2874107f60 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.023+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287419cdc0 con 0x7f2874107f60 2024-09-10T22:10:44.057 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.023+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2864035030 con 0x7f2874107f60 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.023+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28741a3500 con 0x7f2874107f60 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.024+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2874107a20 con 0x7f2874107f60 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.025+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f286403b460 con 0x7f2874107f60 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.026+0000 7f286affd640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f28600b5360 0x7f28600b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.026+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f28641058f0 con 0x7f2874107f60 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.027+0000 7f2879940640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f28600b5360 0x7f28600b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.027+0000 7f2879940640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f28600b5360 0x7f28600b7820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2870005fd0 tx=0x7f287000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:10:44.058 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.030+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28640cdaf0 con 0x7f2874107f60 2024-09-10T22:10:44.228 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:10:44.226+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f2874063590 con 0x7f28600b5360 2024-09-10T22:10:44.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi005 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi005 to 8546M 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:10:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:44.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi005 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi005 to 8546M 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:10:44.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi005 2024-09-10T22:10:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi005 to 8546M 2024-09-10T22:10:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: from='osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:10:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: osdmap e24: 4 total, 3 up, 4 in 2024-09-10T22:10:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:10:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:10:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:45.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] boot 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T22:10:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:45 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] boot 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T22:10:45.653 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:45 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:10:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:10:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-10T22:10:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: from='client.24308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:10:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: osd.3 [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] boot 2024-09-10T22:10:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: osdmap e25: 4 total, 4 up, 4 in 2024-09-10T22:10:45.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:45 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-10T22:10:46.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:46 smithi005 ceph-mon[31115]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T22:10:46.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:46 smithi189 ceph-mon[35784]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T22:10:46.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:46 smithi052 ceph-mon[34997]: osdmap e26: 4 total, 4 up, 4 in 2024-09-10T22:10:47.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:47.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T22:10:47.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/2535073777' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"} : dispatch 2024-09-10T22:10:47.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"} : dispatch 2024-09-10T22:10:47.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"}]': finished 2024-09-10T22:10:47.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:10:47.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:10:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T22:10:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/2535073777' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"} : dispatch 2024-09-10T22:10:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"} : dispatch 2024-09-10T22:10:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"}]': finished 2024-09-10T22:10:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:10:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: osdmap e27: 4 total, 4 up, 4 in 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/2535073777' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"} : dispatch 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"} : dispatch 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "adfeb2e3-b099-4406-8934-6cc24e759c0f"}]': finished 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: osdmap e28: 5 total, 4 up, 5 in 2024-09-10T22:10:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:10:48.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:48 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/20257321' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:10:48.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:48 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/20257321' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:10:48.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:48 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/20257321' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:10:49.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:49 smithi005 ceph-mon[31115]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:49.651 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:49 smithi052 ceph-mon[34997]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:49.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:49 smithi189 ceph-mon[35784]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:51 smithi005 ceph-mon[31115]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:51.584 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:51 smithi052 ceph-mon[34997]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:51.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:51 smithi189 ceph-mon[35784]: pgmap v116: 1 pgs: 1 peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:10:53.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:53 smithi005 ceph-mon[31115]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T22:10:53.676 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:53 smithi052 ceph-mon[34997]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T22:10:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:53 smithi189 ceph-mon[35784]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T22:10:55.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:55 smithi005 ceph-mon[31115]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:10:55.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:55 smithi189 ceph-mon[35784]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:10:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:55 smithi052 ceph-mon[34997]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:10:56.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:10:56.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:56.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:56 smithi005 ceph-mon[31115]: Deploying daemon osd.4 on smithi052 2024-09-10T22:10:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:10:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:56 smithi189 ceph-mon[35784]: Deploying daemon osd.4 on smithi052 2024-09-10T22:10:56.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-10T22:10:56.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:10:56.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:56 smithi052 ceph-mon[34997]: Deploying daemon osd.4 on smithi052 2024-09-10T22:10:57.388 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:57 smithi052 ceph-mon[34997]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:10:57.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:57 smithi005 ceph-mon[31115]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:10:57.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:57 smithi189 ceph-mon[35784]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:10:59.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:10:59 smithi052 ceph-mon[34997]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:10:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:10:59 smithi005 ceph-mon[31115]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:10:59.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:10:59 smithi189 ceph-mon[35784]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:11:01.476 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:01 smithi052 ceph-mon[34997]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:01 smithi005 ceph-mon[31115]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:01.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:01 smithi189 ceph-mon[35784]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:02.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:02 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:02.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:02 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:02.471 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:02 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:02.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:02 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:02.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:02 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:02.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:02 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:02.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:02 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:02.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:02 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:02.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:02 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:03.488 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:03 smithi052 ceph-mon[34997]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:03.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:03 smithi005 ceph-mon[31115]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:03.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:03 smithi189 ceph-mon[35784]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:05.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:05 smithi052 ceph-mon[34997]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:05.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:05 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:05 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:05 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:05.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:05 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:05.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:05 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:05 smithi005 ceph-mon[31115]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:05 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:05 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:05 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:05.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:05 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:05.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:05 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:05 smithi189 ceph-mon[35784]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:05 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:05 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:05 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:05 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:05 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:05.845 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 4 on host 'smithi052' 2024-09-10T22:11:05.845 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.843+0000 7f286affd640 1 -- 172.21.15.52:0/1272628563 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2874063590 con 0x7f28600b5360 2024-09-10T22:11:05.847 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f28600b5360 msgr2=0x7f28600b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f28600b5360 0x7f28600b7820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2870005fd0 tx=0x7f287000b390 comp rx=0 tx=0).stop 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 msgr2=0x7f287419b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287419b650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2864031500 tx=0x7f2864003c10 comp rx=0 tx=0).stop 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 shutdown_connections 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f28600b5360 0x7f28600b7820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f287410a970 0x7f287419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2874107f60 0x7f287419b650 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 --2- 172.21.15.52:0/1272628563 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f287406bdf0 0x7f287419b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:05.848 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 >> 172.21.15.52:0/1272628563 conn(0x7f28740fd210 msgr2=0x7f2874108b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:11:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 shutdown_connections 2024-09-10T22:11:05.849 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:11:05.846+0000 7f287bba4640 1 -- 172.21.15.52:0/1272628563 wait complete. 2024-09-10T22:11:06.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:06 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:06.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:06 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:06.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:06 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:06.574 DEBUG:teuthology.orchestra.run.smithi052:osd.4> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.4.service 2024-09-10T22:11:06.576 INFO:tasks.cephadm:Deploying osd.5 on smithi189 with /dev/vg_nvme/lv_3... 2024-09-10T22:11:06.577 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-10T22:11:06.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:06 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:06.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:06 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:06.605 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:06 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:06.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:06.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:06.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:06 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:06.833 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:11:07.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:07 smithi052 ceph-mon[34997]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:07.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:07 smithi189 ceph-mon[35784]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:07.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:07 smithi005 ceph-mon[31115]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:08.098 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:11:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:11:07.812+0000 7f6da77db640 -1 osd.4 0 log_to_monitors true 2024-09-10T22:11:08.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:08 smithi052 ceph-mon[34997]: from='osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:11:08.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:08 smithi052 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:11:08.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:08 smithi189 ceph-mon[35784]: from='osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:11:08.563 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:08 smithi189 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:11:08.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:08 smithi005 ceph-mon[31115]: from='osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:11:08.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:08 smithi005 ceph-mon[31115]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-10T22:11:09.218 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:11:09.244 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_3 2024-09-10T22:11:09.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:11:09.350+0000 7f6da375e640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T22:11:09.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:11:09.357+0000 7f6d9f585640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:11:09.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-mon[34997]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:09.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:11:09.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-mon[34997]: from='osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:11:09.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-mon[34997]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T22:11:09.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:09.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:09 smithi052 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:11:09.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:09 smithi189 ceph-mon[35784]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:09.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:09 smithi189 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:11:09.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:09 smithi189 ceph-mon[35784]: from='osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:11:09.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:09 smithi189 ceph-mon[35784]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T22:11:09.513 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:09 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:09.514 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:09 smithi189 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:11:09.537 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:11:09.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:09 smithi005 ceph-mon[31115]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:09.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:09 smithi005 ceph-mon[31115]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-10T22:11:09.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:09 smithi005 ceph-mon[31115]: from='osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:11:09.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:09 smithi005 ceph-mon[31115]: osdmap e29: 5 total, 4 up, 5 in 2024-09-10T22:11:09.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:09.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:09 smithi005 ceph-mon[31115]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:11:10.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 -- 172.21.15.189:0/1171933220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614102a50 msgr2=0x7fb614102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:10.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 --2- 172.21.15.189:0/1171933220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614102a50 0x7fb614102e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009960 tx=0x7fb60c02a460 comp rx=0 tx=0).stop 2024-09-10T22:11:10.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 -- 172.21.15.189:0/1171933220 shutdown_connections 2024-09-10T22:11:10.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 --2- 172.21.15.189:0/1171933220 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614104570 0x7fb61410aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:10.021 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 --2- 172.21.15.189:0/1171933220 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb614103bb0 0x7fb614104030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:10.022 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 --2- 172.21.15.189:0/1171933220 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614102a50 0x7fb614102e50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:10.022 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 -- 172.21.15.189:0/1171933220 >> 172.21.15.189:0/1171933220 conn(0x7fb6140fe320 msgr2=0x7fb614100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:11:10.022 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 -- 172.21.15.189:0/1171933220 shutdown_connections 2024-09-10T22:11:10.022 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.019+0000 7fb619056640 1 -- 172.21.15.189:0/1171933220 wait complete. 2024-09-10T22:11:10.022 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 Processor -- start 2024-09-10T22:11:10.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 -- start start 2024-09-10T22:11:10.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614102a50 0x7fb614198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:10.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 0x7fb614199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:10.024 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb614104570 0x7fb61419a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410e6d0 con 0x7fb614104570 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410e550 con 0x7fb614102a50 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb619056640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb61410e850 con 0x7fb614103bb0 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb61259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 0x7fb614199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb612d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614102a50 0x7fb614198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb61259c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 0x7fb614199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:38242/0 (socket says 172.21.15.189:38242) 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb612d9d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614102a50 0x7fb614198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.189:44010/0 (socket says 172.21.15.189:44010) 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.020+0000 7fb61259c640 1 -- 172.21.15.189:0/2195473018 learned_addr learned my addr 172.21.15.189:0/2195473018 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61359e640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb614104570 0x7fb61419a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61259c640 1 -- 172.21.15.189:0/2195473018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614102a50 msgr2=0x7fb614198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:10.025 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61259c640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614102a50 0x7fb614198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61259c640 1 -- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb614104570 msgr2=0x7fb61419a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61259c640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb614104570 0x7fb61419a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61259c640 1 -- 172.21.15.189:0/2195473018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61419aa10 con 0x7fb614103bb0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb61259c640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 0x7fb614199530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d950 tx=0x7fb5fc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc017070 con 0x7fb614103bb0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5fc009c30 con 0x7fb614103bb0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61419ad00 con 0x7fb614103bb0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc00f620 con 0x7fb614103bb0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.021+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6141a13e0 con 0x7fb614103bb0 2024-09-10T22:11:10.026 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.022+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb614109e70 con 0x7fb614103bb0 2024-09-10T22:11:10.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.025+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fb5fc010460 con 0x7fb614103bb0 2024-09-10T22:11:10.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.025+0000 7fb60bfff640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb6000b52e0 0x7fb6000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:10.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.025+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3821+0+0 (secure 0 0 0) 0x7fb5fc0e4630 con 0x7fb614103bb0 2024-09-10T22:11:10.027 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.026+0000 7fb612d9d640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb6000b52e0 0x7fb6000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:10.028 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.026+0000 7fb612d9d640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb6000b52e0 0x7fb6000b77a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb60c000c00 tx=0x7fb60c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:11:10.031 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.030+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb5fc009de0 con 0x7fb614103bb0 2024-09-10T22:11:10.222 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:10.220+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb614063590 con 0x7fb6000b52e0 2024-09-10T22:11:10.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.543 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:11:10.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:11:10.544 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:10.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:10.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:10.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:11:10.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:11:10.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: osdmap e30: 5 total, 4 up, 5 in 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:10.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:11:10.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:11:11.689 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi052 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] boot 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T22:11:11.690 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:11 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi052 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] boot 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T22:11:11.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:11 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:11.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi052 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi052 to 8546M 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: osd.4 [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] boot 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: osdmap e31: 5 total, 5 up, 5 in 2024-09-10T22:11:11.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:11 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-10T22:11:12.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:12 smithi189 ceph-mon[35784]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T22:11:12.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:12 smithi189 ceph-mon[35784]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:12.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:12 smithi052 ceph-mon[34997]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T22:11:13.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:12 smithi052 ceph-mon[34997]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:13.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:12 smithi005 ceph-mon[31115]: osdmap e32: 5 total, 5 up, 5 in 2024-09-10T22:11:13.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:12 smithi005 ceph-mon[31115]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:13.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:13 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/3842659348' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"} : dispatch 2024-09-10T22:11:13.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:13 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"} : dispatch 2024-09-10T22:11:13.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:13 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"}]': finished 2024-09-10T22:11:13.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:13 smithi189 ceph-mon[35784]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T22:11:13.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:13.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:13 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/935191579' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:11:13.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:13 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/3842659348' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"} : dispatch 2024-09-10T22:11:14.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:13 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"} : dispatch 2024-09-10T22:11:14.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:13 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"}]': finished 2024-09-10T22:11:14.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:13 smithi052 ceph-mon[34997]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T22:11:14.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:14.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:13 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/935191579' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:11:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:13 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/3842659348' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"} : dispatch 2024-09-10T22:11:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:13 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"} : dispatch 2024-09-10T22:11:14.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:13 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "496d4b82-cf16-4c60-98d4-904b66a06fe9"}]': finished 2024-09-10T22:11:14.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:13 smithi005 ceph-mon[31115]: osdmap e33: 6 total, 5 up, 6 in 2024-09-10T22:11:14.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:14.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:13 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/935191579' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:11:14.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:14 smithi189 ceph-mon[35784]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:14.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:14 smithi052 ceph-mon[34997]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:15.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:14 smithi005 ceph-mon[31115]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:16.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:16 smithi052 ceph-mon[34997]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:17.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:16 smithi005 ceph-mon[31115]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:17.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:16 smithi189 ceph-mon[35784]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:18.890 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:18 smithi189 ceph-mon[35784]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:18.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:18 smithi052 ceph-mon[34997]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:19.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:18 smithi005 ceph-mon[31115]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:20.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:20 smithi189 ceph-mon[35784]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:20.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:20 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:11:20.939 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:20 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:20.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:20 smithi052 ceph-mon[34997]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:20.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:20 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:11:21.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:20 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:21.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:20 smithi005 ceph-mon[31115]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:21.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:20 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-10T22:11:21.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:20 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:21.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:21 smithi052 ceph-mon[34997]: Deploying daemon osd.5 on smithi189 2024-09-10T22:11:22.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:21 smithi005 ceph-mon[31115]: Deploying daemon osd.5 on smithi189 2024-09-10T22:11:22.090 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:21 smithi189 ceph-mon[35784]: Deploying daemon osd.5 on smithi189 2024-09-10T22:11:22.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:22 smithi052 ceph-mon[34997]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:23.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:22 smithi005 ceph-mon[31115]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:23.137 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:22 smithi189 ceph-mon[35784]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:24.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:24 smithi052 ceph-mon[34997]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:25.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:24 smithi005 ceph-mon[31115]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:25.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:24 smithi189 ceph-mon[35784]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:26.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:26 smithi052 ceph-mon[34997]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:27.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:26 smithi005 ceph-mon[31115]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:27.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:26 smithi189 ceph-mon[35784]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:27.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:27.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:27.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:27.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:27.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:27.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:28.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:28.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:28.131 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:29.264 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:29 smithi189 ceph-mon[35784]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:29.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:29 smithi005 ceph-mon[31115]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:29.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:29 smithi052 ceph-mon[34997]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:30.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:30.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:30.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:30.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:30.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:30.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:30 smithi189 ceph-mon[35784]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:30.749 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.747+0000 7fb60bfff640 1 -- 172.21.15.189:0/2195473018 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb614063590 con 0x7fb6000b52e0 2024-09-10T22:11:30.749 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 5 on host 'smithi189' 2024-09-10T22:11:30.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb6000b52e0 msgr2=0x7fb6000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:30.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb6000b52e0 0x7fb6000b77a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb60c000c00 tx=0x7fb60c005d50 comp rx=0 tx=0).stop 2024-09-10T22:11:30.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 msgr2=0x7fb614199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:30.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 0x7fb614199530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00d950 tx=0x7fb5fc00de10 comp rx=0 tx=0).stop 2024-09-10T22:11:30.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 shutdown_connections 2024-09-10T22:11:30.751 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb6000b52e0 0x7fb6000b77a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:30.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb614104570 0x7fb61419a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:30.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb614103bb0 0x7fb614199530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:30.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 --2- 172.21.15.189:0/2195473018 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb614102a50 0x7fb614198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:30.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.749+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 >> 172.21.15.189:0/2195473018 conn(0x7fb6140fe320 msgr2=0x7fb614107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:11:30.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.750+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 shutdown_connections 2024-09-10T22:11:30.752 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:11:30.750+0000 7fb619056640 1 -- 172.21.15.189:0/2195473018 wait complete. 2024-09-10T22:11:30.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:30.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:30.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:30.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:30.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:30.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:30 smithi005 ceph-mon[31115]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:30 smithi052 ceph-mon[34997]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:31.541 DEBUG:teuthology.orchestra.run.smithi189:osd.5> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.5.service 2024-09-10T22:11:31.543 INFO:tasks.cephadm:Deploying osd.6 on smithi005 with /dev/vg_nvme/lv_2... 2024-09-10T22:11:31.543 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:11:31.809 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:11:31.812 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:31 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:31.812 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:31 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.812 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:31 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:31 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:31 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:31 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:31.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:31 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:32.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:31 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:32.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:31 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:32.779 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:32 smithi189 ceph-mon[35784]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:32.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:32 smithi005 ceph-mon[31115]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:32.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:32 smithi052 ceph-mon[34997]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:33.443 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:11:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:11:33.063+0000 7f141d43f640 -1 osd.5 0 log_to_monitors true 2024-09-10T22:11:33.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:33 smithi005 ceph-mon[31115]: from='osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:11:33.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:33 smithi005 ceph-mon[31115]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:11:33.935 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:33 smithi189 ceph-mon[35784]: from='osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:11:33.935 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:33 smithi189 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:11:33.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:33 smithi052 ceph-mon[34997]: from='osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:11:34.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:33 smithi052 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-10T22:11:34.371 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:11:34.410 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2024-09-10T22:11:34.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T22:11:34.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:11:34.555 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi189 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:34.556 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.670 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:11:34.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi189 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:34.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:34.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:34.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:34 smithi005 ceph-mon[31115]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: osdmap e34: 6 total, 5 up, 6 in 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi189 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:11:35.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi189 to 8544M 2024-09-10T22:11:35.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:35.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:35.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:35.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:35.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:34 smithi052 ceph-mon[34997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:11:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 -- 172.21.15.5:0/3547375121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c101910 msgr2=0x7f0b3c101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 --2- 172.21.15.5:0/3547375121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c101910 0x7f0b3c101d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009930 tx=0x7f0b2c02a420 comp rx=0 tx=0).stop 2024-09-10T22:11:35.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 -- 172.21.15.5:0/3547375121 shutdown_connections 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 --2- 172.21.15.5:0/3547375121 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 0x7f0b3c109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 --2- 172.21.15.5:0/3547375121 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c102a70 0x7f0b3c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 --2- 172.21.15.5:0/3547375121 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c101910 0x7f0b3c101d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 -- 172.21.15.5:0/3547375121 >> 172.21.15.5:0/3547375121 conn(0x7f0b3c0fd1e0 msgr2=0x7f0b3c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 -- 172.21.15.5:0/3547375121 shutdown_connections 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.157+0000 7f0b4263f640 1 -- 172.21.15.5:0/3547375121 wait complete. 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 Processor -- start 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 -- start start 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c101910 0x7f0b3c198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 0x7f0b3c1994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 0x7f0b3c19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:35.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c10e6c0 con 0x7f0b3c102a70 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c10e540 con 0x7f0b3c101910 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b4263f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c10e840 con 0x7f0b3c103430 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 0x7f0b3c1994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 0x7f0b3c1994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36784/0 (socket says 172.21.15.5:36784) 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 -- 172.21.15.5:0/4210383772 learned_addr learned my addr 172.21.15.5:0/4210383772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3bfff640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c101910 0x7f0b3c198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b40bdc640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 0x7f0b3c19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 -- 172.21.15.5:0/4210383772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 msgr2=0x7f0b3c19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 0x7f0b3c19a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 -- 172.21.15.5:0/4210383772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c101910 msgr2=0x7f0b3c198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c101910 0x7f0b3c198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.158+0000 7f0b3b7fe640 1 -- 172.21.15.5:0/4210383772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c19a980 con 0x7f0b3c102a70 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b40bdc640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 0x7f0b3c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:11:35.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b3b7fe640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 0x7f0b3c1994a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d950 tx=0x7f0b3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b30017070 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c19ac70 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b30009c30 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3000f620 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.159+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1a1350 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.160+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b3c108d10 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.161+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f0b30010460 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.162+0000 7f0b397fa640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0b240b52e0 0x7f0b240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.163+0000 7f0b3bfff640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0b240b52e0 0x7f0b240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.163+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4253+0+0 (secure 0 0 0) 0x7f0b300e4980 con 0x7f0b3c102a70 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.163+0000 7f0b3bfff640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0b240b52e0 0x7f0b240b77a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c006010 tx=0x7f0b2c031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:11:35.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.165+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0b300ac780 con 0x7f0b3c102a70 2024-09-10T22:11:35.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:35.364+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0b3c063590 con 0x7f0b240b52e0 2024-09-10T22:11:35.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-mon[35784]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:11:35.443 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:11:34.965+0000 7f1419bd6640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T22:11:35.444 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:11:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:11:34.971+0000 7f14111e1640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='osd.5 ' entity='osd.5' 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:11:35.623 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T22:11:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='osd.5 ' entity='osd.5' 2024-09-10T22:11:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:11:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:11:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:11:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:35.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: osdmap e35: 6 total, 5 up, 6 in 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='osd.5 ' entity='osd.5' 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='client.14493 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:11:36.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:36.779 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:11:36.780 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:11:36.780 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] boot 2024-09-10T22:11:36.780 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T22:11:36.780 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:36.780 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:36.780 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:36 smithi005 ceph-mon[31115]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T22:11:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:11:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:11:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] boot 2024-09-10T22:11:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T22:11:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:36.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:36.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:36 smithi189 ceph-mon[35784]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T22:11:36.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:11:36.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:11:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: osd.5 [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] boot 2024-09-10T22:11:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: osdmap e36: 6 total, 6 up, 6 in 2024-09-10T22:11:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-10T22:11:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:36 smithi052 ceph-mon[34997]: osdmap e37: 6 total, 6 up, 6 in 2024-09-10T22:11:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:38 smithi189 ceph-mon[35784]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T22:11:38.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3697266395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c454304c-d9fb-4962-b760-e10c257f6ea1"} : dispatch 2024-09-10T22:11:38.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3697266395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c454304c-d9fb-4962-b760-e10c257f6ea1"}]': finished 2024-09-10T22:11:38.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:38 smithi189 ceph-mon[35784]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T22:11:38.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:11:38.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:38 smithi052 ceph-mon[34997]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T22:11:38.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3697266395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c454304c-d9fb-4962-b760-e10c257f6ea1"} : dispatch 2024-09-10T22:11:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3697266395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c454304c-d9fb-4962-b760-e10c257f6ea1"}]': finished 2024-09-10T22:11:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:38 smithi052 ceph-mon[34997]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T22:11:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:11:38.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:38 smithi005 ceph-mon[31115]: osdmap e38: 6 total, 6 up, 6 in 2024-09-10T22:11:38.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3697266395' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c454304c-d9fb-4962-b760-e10c257f6ea1"} : dispatch 2024-09-10T22:11:38.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3697266395' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c454304c-d9fb-4962-b760-e10c257f6ea1"}]': finished 2024-09-10T22:11:38.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:38 smithi005 ceph-mon[31115]: osdmap e39: 7 total, 6 up, 7 in 2024-09-10T22:11:38.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:11:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:39 smithi189 ceph-mon[35784]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:39 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1264432062' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:11:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:39 smithi052 ceph-mon[34997]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:39 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1264432062' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:11:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:39 smithi005 ceph-mon[31115]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:39 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1264432062' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:11:41.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:41 smithi189 ceph-mon[35784]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:41.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:41 smithi052 ceph-mon[34997]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:41 smithi005 ceph-mon[31115]: pgmap v152: 1 pgs: 1 remapped+peering; 577 KiB data, 164 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:43.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:43 smithi189 ceph-mon[35784]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:11:43.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:43 smithi052 ceph-mon[34997]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:11:43.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:43 smithi005 ceph-mon[31115]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-10T22:11:45.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:45 smithi005 ceph-mon[31115]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T22:11:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:45 smithi189 ceph-mon[35784]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T22:11:45.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:45 smithi052 ceph-mon[34997]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-10T22:11:47.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:47 smithi005 ceph-mon[31115]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T22:11:47.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T22:11:47.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:47.537 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:47 smithi005 ceph-mon[31115]: Deploying daemon osd.6 on smithi005 2024-09-10T22:11:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:47 smithi189 ceph-mon[35784]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T22:11:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T22:11:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:47 smithi189 ceph-mon[35784]: Deploying daemon osd.6 on smithi005 2024-09-10T22:11:47.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:47 smithi052 ceph-mon[34997]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-10T22:11:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-10T22:11:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:47 smithi052 ceph-mon[34997]: Deploying daemon osd.6 on smithi005 2024-09-10T22:11:49.447 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:49 smithi005 ceph-mon[31115]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:11:49.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:49 smithi189 ceph-mon[35784]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:11:49.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:49 smithi052 ceph-mon[34997]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-10T22:11:51.453 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:51 smithi005 ceph-mon[31115]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T22:11:51.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:51 smithi189 ceph-mon[35784]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T22:11:51.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:51 smithi052 ceph-mon[34997]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-10T22:11:53.538 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:53 smithi005 ceph-mon[31115]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:53.538 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:53.538 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:53.538 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:53 smithi189 ceph-mon[35784]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:53.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:53.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:53 smithi052 ceph-mon[34997]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:11:53.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:55.684 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:55 smithi005 ceph-mon[31115]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:55.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:55 smithi189 ceph-mon[35784]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:55 smithi052 ceph-mon[34997]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:56.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.827+0000 7f0b397fa640 1 -- 172.21.15.5:0/4210383772 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0b3c063590 con 0x7f0b240b52e0 2024-09-10T22:11:56.828 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 6 on host 'smithi005' 2024-09-10T22:11:56.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0b240b52e0 msgr2=0x7f0b240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0b240b52e0 0x7f0b240b77a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c006010 tx=0x7f0b2c031430 comp rx=0 tx=0).stop 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 msgr2=0x7f0b3c1994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 0x7f0b3c1994a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0b3000d950 tx=0x7f0b3000de10 comp rx=0 tx=0).stop 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 shutdown_connections 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0b240b52e0 0x7f0b240b77a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0b3c103430 0x7f0b3c19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0b3c102a70 0x7f0b3c1994a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 --2- 172.21.15.5:0/4210383772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0b3c101910 0x7f0b3c198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 >> 172.21.15.5:0/4210383772 conn(0x7f0b3c0fd1e0 msgr2=0x7f0b3c105ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 shutdown_connections 2024-09-10T22:11:56.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:11:56.829+0000 7f0b4263f640 1 -- 172.21.15.5:0/4210383772 wait complete. 2024-09-10T22:11:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:57.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:57.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:57.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:56 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:57.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:57.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:57.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:56 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:56 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:11:57.615 DEBUG:teuthology.orchestra.run.smithi005:osd.6> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.6.service 2024-09-10T22:11:57.617 INFO:tasks.cephadm:Deploying osd.7 on smithi052 with /dev/vg_nvme/lv_2... 2024-09-10T22:11:57.617 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:11:57.881 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:11:59.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:58 smithi005 ceph-mon[31115]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:59.083 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:11:58 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:11:58.909+0000 7fb887c54640 -1 osd.6 0 log_to_monitors true 2024-09-10T22:11:59.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:58 smithi189 ceph-mon[35784]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:11:59.194 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:58 smithi052 ceph-mon[34997]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:00.101 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:11:59 smithi052 ceph-mon[34997]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T22:12:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:11:59 smithi189 ceph-mon[35784]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T22:12:00.234 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:11:59 smithi005 ceph-mon[31115]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-10T22:12:00.397 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:12:00.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_2 2024-09-10T22:12:00.694 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:12:00.969 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:00.969 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T22:12:00.969 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:00.970 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:00.971 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:00.971 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:00.971 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:00.971 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:00 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.082 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:12:00.890+0000 7fb883bd7640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T22:12:01.083 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:12:00.901+0000 7fb87f9fe640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:01.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:01.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:01.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:01.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:00 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-10T22:12:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: osdmap e40: 7 total, 6 up, 7 in 2024-09-10T22:12:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:01.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:00 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 -- 172.21.15.52:0/749903592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14105b80 msgr2=0x7f3e14107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 --2- 172.21.15.52:0/749903592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14105b80 0x7f3e14107ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3e08009900 tx=0x7f3e0802a410 comp rx=0 tx=0).stop 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 -- 172.21.15.52:0/749903592 shutdown_connections 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 --2- 172.21.15.52:0/749903592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14108730 0x7f3e1410abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 --2- 172.21.15.52:0/749903592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14105b80 0x7f3e14107ff0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 --2- 172.21.15.52:0/749903592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1406b6e0 0x7f3e141055f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 -- 172.21.15.52:0/749903592 >> 172.21.15.52:0/749903592 conn(0x7f3e140fd1e0 msgr2=0x7f3e140ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 -- 172.21.15.52:0/749903592 shutdown_connections 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.181+0000 7f3e1916b640 1 -- 172.21.15.52:0/749903592 wait complete. 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 Processor -- start 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 -- start start 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1406b6e0 0x7f3e14198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14105b80 0x7f3e14199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:01.198 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 0x7f3e1419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1410e660 con 0x7f3e1406b6e0 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1410e4e0 con 0x7f3e14108730 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1916b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1410e7e0 con 0x7f3e14105b80 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 0x7f3e1419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 0x7f3e1419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:52560/0 (socket says 172.21.15.52:52560) 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e1359e640 1 -- 172.21.15.52:0/1058209980 learned_addr learned my addr 172.21.15.52:0/1058209980 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.182+0000 7f3e12d9d640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1406b6e0 0x7f3e14198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1259c640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14105b80 0x7f3e14199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1359e640 1 -- 172.21.15.52:0/1058209980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14105b80 msgr2=0x7f3e14199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1359e640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14105b80 0x7f3e14199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1359e640 1 -- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1406b6e0 msgr2=0x7f3e14198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1359e640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1406b6e0 0x7f3e14198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1359e640 1 -- 172.21.15.52:0/1058209980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1419a920 con 0x7f3e14108730 2024-09-10T22:12:01.199 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1259c640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14105b80 0x7f3e14199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1359e640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 0x7f3e1419a080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00eaa0 tx=0x7f3e0c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00cdb0 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1419ac10 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e0c005020 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0116d0 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.183+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e141a12f0 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.184+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e140fecd0 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.185+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f3e0c00f040 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.186+0000 7f3dfbfff640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3dfc0b52e0 0x7f3dfc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.186+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7f3e0c0e50d0 con 0x7f3e14108730 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.186+0000 7f3e12d9d640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3dfc0b52e0 0x7f3dfc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:01.200 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.187+0000 7f3e12d9d640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3dfc0b52e0 0x7f3dfc0b77a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009bd0 tx=0x7f3e04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:12:01.201 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.189+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3e0c016030 con 0x7f3e14108730 2024-09-10T22:12:01.389 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:01.386+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f3e14063590 con 0x7f3dfc0b52e0 2024-09-10T22:12:01.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi005 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi005 to 5697M 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:02.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:02.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi005 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi005 to 5697M 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:02.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:02.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi005 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi005 to 5697M 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: osdmap e41: 7 total, 6 up, 7 in 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:02.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] boot 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T22:12:03.137 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:02 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:12:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:12:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] boot 2024-09-10T22:12:03.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T22:12:03.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:02 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:03.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:12:03.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:12:03.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 165 MiB used, 536 GiB / 536 GiB avail 2024-09-10T22:12:03.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:03.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: osd.6 [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] boot 2024-09-10T22:12:03.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: osdmap e42: 7 total, 7 up, 7 in 2024-09-10T22:12:03.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:02 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-10T22:12:04.183 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:03 smithi052 ceph-mon[34997]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T22:12:04.183 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:03 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/2546027365' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"} : dispatch 2024-09-10T22:12:04.184 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:03 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"} : dispatch 2024-09-10T22:12:04.184 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:03 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"}]': finished 2024-09-10T22:12:04.184 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:03 smithi052 ceph-mon[34997]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T22:12:04.184 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:03 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:03 smithi189 ceph-mon[35784]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T22:12:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:03 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/2546027365' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"} : dispatch 2024-09-10T22:12:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:03 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"} : dispatch 2024-09-10T22:12:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:03 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"}]': finished 2024-09-10T22:12:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:03 smithi189 ceph-mon[35784]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T22:12:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:03 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:04.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:03 smithi005 ceph-mon[31115]: osdmap e43: 7 total, 7 up, 7 in 2024-09-10T22:12:04.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:03 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/2546027365' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"} : dispatch 2024-09-10T22:12:04.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:03 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"} : dispatch 2024-09-10T22:12:04.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:03 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9f735c7-7b27-48ab-89e3-57076f0b2ee0"}]': finished 2024-09-10T22:12:04.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:03 smithi005 ceph-mon[31115]: osdmap e44: 8 total, 7 up, 8 in 2024-09-10T22:12:04.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:04 smithi189 ceph-mon[35784]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:04 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/1564148112' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:05.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:04 smithi052 ceph-mon[34997]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:04 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/1564148112' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:05.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:04 smithi005 ceph-mon[31115]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:05.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:04 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/1564148112' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:07.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:06 smithi189 ceph-mon[35784]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:07.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:06 smithi052 ceph-mon[34997]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:07.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:06 smithi005 ceph-mon[31115]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:09.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:08 smithi005 ceph-mon[31115]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:09.147 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:08 smithi052 ceph-mon[34997]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:09.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:08 smithi189 ceph-mon[35784]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:10 smithi189 ceph-mon[35784]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:11.206 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:10 smithi052 ceph-mon[34997]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:11.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:10 smithi005 ceph-mon[31115]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:13.134 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:12 smithi052 ceph-mon[34997]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:13.134 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T22:12:13.134 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:12 smithi189 ceph-mon[35784]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T22:12:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:13.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:12 smithi005 ceph-mon[31115]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:13.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-10T22:12:13.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:14.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:13 smithi189 ceph-mon[35784]: Deploying daemon osd.7 on smithi052 2024-09-10T22:12:14.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:13 smithi052 ceph-mon[34997]: Deploying daemon osd.7 on smithi052 2024-09-10T22:12:14.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:13 smithi005 ceph-mon[31115]: Deploying daemon osd.7 on smithi052 2024-09-10T22:12:15.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:14 smithi189 ceph-mon[35784]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:15.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:14 smithi052 ceph-mon[34997]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:15.341 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:14 smithi005 ceph-mon[31115]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:17.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:16 smithi189 ceph-mon[35784]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:17.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:16 smithi052 ceph-mon[34997]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:17.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:16 smithi005 ceph-mon[31115]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:19.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:18 smithi189 ceph-mon[35784]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:19.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:19.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:19.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:19.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:18 smithi052 ceph-mon[34997]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:19.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:19.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:19.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:19.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:18 smithi005 ceph-mon[31115]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:19.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:19.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:19.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:21.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:20 smithi052 ceph-mon[34997]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:21.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:20 smithi189 ceph-mon[35784]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:21.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:20 smithi005 ceph-mon[31115]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:22.128 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 7 on host 'smithi052' 2024-09-10T22:12:22.129 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.126+0000 7f3dfbfff640 1 -- 172.21.15.52:0/1058209980 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3e14063590 con 0x7f3dfc0b52e0 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3dfc0b52e0 msgr2=0x7f3dfc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3dfc0b52e0 0x7f3dfc0b77a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3e04009bd0 tx=0x7f3e04005f90 comp rx=0 tx=0).stop 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 msgr2=0x7f3e1419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 0x7f3e1419a080 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c00eaa0 tx=0x7f3e0c00ef60 comp rx=0 tx=0).stop 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 shutdown_connections 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3dfc0b52e0 0x7f3dfc0b77a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3e14108730 0x7f3e1419a080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3e14105b80 0x7f3e14199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 --2- 172.21.15.52:0/1058209980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3e1406b6e0 0x7f3e14198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 >> 172.21.15.52:0/1058209980 conn(0x7f3e140fd1e0 msgr2=0x7f3e14103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:12:22.131 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 shutdown_connections 2024-09-10T22:12:22.132 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:12:22.129+0000 7f3e1916b640 1 -- 172.21.15.52:0/1058209980 wait complete. 2024-09-10T22:12:22.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:22 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:22 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.883 DEBUG:teuthology.orchestra.run.smithi052:osd.7> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.7.service 2024-09-10T22:12:22.885 INFO:tasks.cephadm:Deploying osd.8 on smithi189 with /dev/vg_nvme/lv_2... 2024-09-10T22:12:22.885 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-10T22:12:22.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.913 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:22.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:22.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:22.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:22.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:22.914 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:22 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:23.145 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:12:24.329 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:12:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:12:24.181+0000 7fbef5a90640 -1 osd.7 0 log_to_monitors true 2024-09-10T22:12:25.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:24 smithi052 ceph-mon[34997]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:25.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:24 smithi052 ceph-mon[34997]: from='osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:12:25.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:24 smithi052 ceph-mon[34997]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:12:25.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:24 smithi005 ceph-mon[31115]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:25.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:24 smithi005 ceph-mon[31115]: from='osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:12:25.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:24 smithi005 ceph-mon[31115]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:12:25.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:24 smithi189 ceph-mon[35784]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:25.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:24 smithi189 ceph-mon[35784]: from='osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:12:25.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:24 smithi189 ceph-mon[35784]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-10T22:12:25.625 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:12:25.653 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_2 2024-09-10T22:12:25.927 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:25 smithi189 ceph-mon[35784]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T22:12:25.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:25 smithi189 ceph-mon[35784]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T22:12:25.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:25 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:25.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:25 smithi189 ceph-mon[35784]: from='osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:12:25.928 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:25 smithi189 ceph-mon[35784]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:12:25.954 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:12:25.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:25 smithi052 ceph-mon[34997]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T22:12:26.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:25 smithi052 ceph-mon[34997]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T22:12:26.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:25 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:26.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:25 smithi052 ceph-mon[34997]: from='osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:12:26.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:25 smithi052 ceph-mon[34997]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:12:26.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:25 smithi005 ceph-mon[31115]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-10T22:12:26.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:25 smithi005 ceph-mon[31115]: osdmap e45: 8 total, 7 up, 8 in 2024-09-10T22:12:26.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:25 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:26.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:25 smithi005 ceph-mon[31115]: from='osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:12:26.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:25 smithi005 ceph-mon[31115]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:12:26.475 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 -- 172.21.15.189:0/4180433112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c06b6e0 msgr2=0x7f210c1055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 --2- 172.21.15.189:0/4180433112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c06b6e0 0x7f210c1055f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009900 tx=0x7f20fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 -- 172.21.15.189:0/4180433112 shutdown_connections 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 --2- 172.21.15.189:0/4180433112 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f210c108730 0x7f210c10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 --2- 172.21.15.189:0/4180433112 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c105b80 0x7f210c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 --2- 172.21.15.189:0/4180433112 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c06b6e0 0x7f210c1055f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 -- 172.21.15.189:0/4180433112 >> 172.21.15.189:0/4180433112 conn(0x7f210c0fd1e0 msgr2=0x7f210c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 -- 172.21.15.189:0/4180433112 shutdown_connections 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.460+0000 7f21110b2640 1 -- 172.21.15.189:0/4180433112 wait complete. 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.461+0000 7f21110b2640 1 Processor -- start 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 -- start start 2024-09-10T22:12:26.476 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f210c06b6e0 0x7f210c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 0x7f210c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c108730 0x7f210c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10e6b0 con 0x7f210c108730 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10e530 con 0x7f210c06b6e0 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f21110b2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10e830 con 0x7f210c105b80 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 0x7f210c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 0x7f210c199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:47606/0 (socket says 172.21.15.189:47606) 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 -- 172.21.15.189:0/945497461 learned_addr learned my addr 172.21.15.189:0/945497461 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210ad9d640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f210c06b6e0 0x7f210c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210b59e640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c108730 0x7f210c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 -- 172.21.15.189:0/945497461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f210c06b6e0 msgr2=0x7f210c198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f210c06b6e0 0x7f210c198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:26.477 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 -- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c108730 msgr2=0x7f210c19a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c108730 0x7f210c19a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210a59c640 1 -- 172.21.15.189:0/945497461 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c19a910 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.462+0000 7f210b59e640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c108730 0x7f210c19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.463+0000 7f210a59c640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 0x7f210c199430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f210000e9c0 tx=0x7f210000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.463+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210000cd80 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.463+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21000054d0 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.463+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c19ac00 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.463+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2100010430 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.463+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c1a12e0 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.464+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c0fecd0 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.465+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f2100004fb0 con 0x7f210c105b80 2024-09-10T22:12:26.478 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.466+0000 7f20f3fff640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f20f40b52e0 0x7f20f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:26.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.467+0000 7f210ad9d640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f20f40b52e0 0x7f20f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:26.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.467+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5430+0+0 (secure 0 0 0) 0x7f21000e5800 con 0x7f210c105b80 2024-09-10T22:12:26.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.467+0000 7f210ad9d640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f20f40b52e0 0x7f20f40b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20fc000c00 tx=0x7f20fc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:12:26.479 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.469+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2100056220 con 0x7f210c105b80 2024-09-10T22:12:26.499 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:12:26.150+0000 7fbef1a13640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T22:12:26.500 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:12:26.158+0000 7fbee9832640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:12:26.662 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:26.660+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f210c063590 con 0x7f20f40b52e0 2024-09-10T22:12:26.936 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi052 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:26.937 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='osd.7 ' entity='osd.7' 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] boot 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:26.938 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:26 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi052 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='osd.7 ' entity='osd.7' 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] boot 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T22:12:27.001 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:27.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:27.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:27.002 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:26 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:27.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 192 MiB used, 626 GiB / 626 GiB avail 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: osdmap e46: 8 total, 7 up, 8 in 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi052 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:27.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi052 to 5697M 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='osd.7 ' entity='osd.7' 2024-09-10T22:12:27.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: osd.7 [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] boot 2024-09-10T22:12:27.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: osdmap e47: 8 total, 8 up, 8 in 2024-09-10T22:12:27.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-10T22:12:27.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:27.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:27.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:26 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:28.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:27 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:12:28.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:27 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:12:28.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:27 smithi052 ceph-mon[34997]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:28.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:27 smithi052 ceph-mon[34997]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T22:12:28.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:27 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:12:28.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:27 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:12:28.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:27 smithi005 ceph-mon[31115]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:28.003 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:27 smithi005 ceph-mon[31115]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T22:12:28.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:27 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:12:28.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:27 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:12:28.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:27 smithi189 ceph-mon[35784]: from='client.24388 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:28.082 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:27 smithi189 ceph-mon[35784]: osdmap e48: 8 total, 8 up, 8 in 2024-09-10T22:12:29.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T22:12:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/838406270' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"} : dispatch 2024-09-10T22:12:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"} : dispatch 2024-09-10T22:12:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"}]': finished 2024-09-10T22:12:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T22:12:29.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/838406270' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"} : dispatch 2024-09-10T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"} : dispatch 2024-09-10T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"}]': finished 2024-09-10T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T22:12:29.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:29.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: osdmap e49: 8 total, 8 up, 8 in 2024-09-10T22:12:29.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/838406270' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"} : dispatch 2024-09-10T22:12:29.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"} : dispatch 2024-09-10T22:12:29.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bf416f0-d03c-486d-98ff-7a40d2920d99"}]': finished 2024-09-10T22:12:29.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: osdmap e50: 9 total, 8 up, 9 in 2024-09-10T22:12:29.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:30.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:30 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/3028448552' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:30.772 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:30 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/3028448552' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:30.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:30 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/3028448552' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:31.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:31 smithi189 ceph-mon[35784]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:31.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:31 smithi052 ceph-mon[34997]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:31 smithi005 ceph-mon[31115]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:33.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:33 smithi189 ceph-mon[35784]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:33 smithi052 ceph-mon[34997]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:33.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:33 smithi005 ceph-mon[31115]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:35.669 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:35 smithi189 ceph-mon[35784]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T22:12:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:35 smithi052 ceph-mon[34997]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T22:12:35.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:35 smithi005 ceph-mon[31115]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-10T22:12:37.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:37 smithi189 ceph-mon[35784]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:12:37.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:37 smithi052 ceph-mon[34997]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:12:37.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:37 smithi005 ceph-mon[31115]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:12:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T22:12:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:38.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T22:12:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:38.773 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-10T22:12:38.773 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:39 smithi189 ceph-mon[35784]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:12:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:39 smithi189 ceph-mon[35784]: Deploying daemon osd.8 on smithi189 2024-09-10T22:12:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:39 smithi052 ceph-mon[34997]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:12:39.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:39 smithi052 ceph-mon[34997]: Deploying daemon osd.8 on smithi189 2024-09-10T22:12:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:39 smithi005 ceph-mon[31115]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:12:39.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:39 smithi005 ceph-mon[31115]: Deploying daemon osd.8 on smithi189 2024-09-10T22:12:41.474 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:41 smithi189 ceph-mon[35784]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T22:12:41.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:41 smithi052 ceph-mon[34997]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T22:12:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:41 smithi005 ceph-mon[31115]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-10T22:12:43.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:43 smithi052 ceph-mon[34997]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:12:43.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:43 smithi005 ceph-mon[31115]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:12:43.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:43 smithi189 ceph-mon[35784]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:12:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:44.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:44.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:44.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:44.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:44.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:45.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:45 smithi189 ceph-mon[35784]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:12:45.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:45 smithi052 ceph-mon[34997]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:12:45.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:45 smithi005 ceph-mon[31115]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:12:47.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:47 smithi189 ceph-mon[35784]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:47.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.609 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:47.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:47.610 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.650 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 8 on host 'smithi189' 2024-09-10T22:12:47.650 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.648+0000 7f20f3fff640 1 -- 172.21.15.189:0/945497461 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f210c063590 con 0x7f20f40b52e0 2024-09-10T22:12:47.652 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f20f40b52e0 msgr2=0x7f20f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f20f40b52e0 0x7f20f40b77a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f20fc000c00 tx=0x7f20fc0314a0 comp rx=0 tx=0).stop 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 msgr2=0x7f210c199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 0x7f210c199430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f210000e9c0 tx=0x7f210000ee80 comp rx=0 tx=0).stop 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 shutdown_connections 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f20f40b52e0 0x7f20f40b77a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f210c108730 0x7f210c19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f210c105b80 0x7f210c199430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 --2- 172.21.15.189:0/945497461 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f210c06b6e0 0x7f210c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 >> 172.21.15.189:0/945497461 conn(0x7f210c0fd1e0 msgr2=0x7f210c103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 shutdown_connections 2024-09-10T22:12:47.653 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:12:47.651+0000 7f21110b2640 1 -- 172.21.15.189:0/945497461 wait complete. 2024-09-10T22:12:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:47 smithi052 ceph-mon[34997]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:47 smithi005 ceph-mon[31115]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:48.307 DEBUG:teuthology.orchestra.run.smithi189:osd.8> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.8.service 2024-09-10T22:12:48.309 INFO:tasks.cephadm:Deploying osd.9 on smithi005 with /dev/vg_nvme/lv_1... 2024-09-10T22:12:48.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:12:48.531 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:48 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:48.531 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:48 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:48.531 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:48 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:48.580 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:12:48.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:48 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:48.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:48 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:48.700 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:48 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:48.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:48 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:12:48.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:48 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:48.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:48 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:49.587 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:49 smithi189 ceph-mon[35784]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:49.712 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:49 smithi005 ceph-mon[31115]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:49.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:49 smithi052 ceph-mon[34997]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:49.906 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:12:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:12:49.718+0000 7feb1e5df640 -1 osd.8 0 log_to_monitors true 2024-09-10T22:12:50.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:50 smithi005 ceph-mon[31115]: from='osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:12:50.570 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:50 smithi005 ceph-mon[31115]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:12:50.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:50 smithi052 ceph-mon[34997]: from='osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:12:50.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:50 smithi052 ceph-mon[34997]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:12:50.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:50 smithi189 ceph-mon[35784]: from='osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:12:50.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:50 smithi189 ceph-mon[35784]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-10T22:12:51.320 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:12:51.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2024-09-10T22:12:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T22:12:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:51.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.616 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:12:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T22:12:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T22:12:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:12:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:12:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:51.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:51.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.823 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: osdmap e51: 9 total, 8 up, 9 in 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:51.824 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:51.825 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:12:51.825 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 -- 172.21.15.5:0/2952721229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008102a90 msgr2=0x7f8008102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 --2- 172.21.15.5:0/2952721229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008102a90 0x7f8008102f10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0009930 tx=0x7f7ff002a420 comp rx=0 tx=0).stop 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 -- 172.21.15.5:0/2952721229 shutdown_connections 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 --2- 172.21.15.5:0/2952721229 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8008103450 0x7f8008109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 --2- 172.21.15.5:0/2952721229 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008102a90 0x7f8008102f10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 --2- 172.21.15.5:0/2952721229 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f8008101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 -- 172.21.15.5:0/2952721229 >> 172.21.15.5:0/2952721229 conn(0x7f80080fd200 msgr2=0x7f80080ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 -- 172.21.15.5:0/2952721229 shutdown_connections 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.088+0000 7f800def8640 1 -- 172.21.15.5:0/2952721229 wait complete. 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 Processor -- start 2024-09-10T22:12:52.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 -- start start 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f800806bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8008102a90 0x7f800819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 0x7f80081a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f800810d590 con 0x7f8008103450 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f800810d410 con 0x7f8008101930 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f800def8640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f800810d710 con 0x7f8008102a90 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f8007fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 0x7f80081a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f80077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f800806bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f80077fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f800806bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:60026/0 (socket says 172.21.15.5:60026) 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f8007fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 0x7f80081a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48000/0 (socket says 172.21.15.5:48000) 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f80077fe640 1 -- 172.21.15.5:0/26167045 learned_addr learned my addr 172.21.15.5:0/26167045 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:12:52.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.089+0000 7f7ffeffd640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8008102a90 0x7f800819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f8007fff640 1 -- 172.21.15.5:0/26167045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8008102a90 msgr2=0x7f800819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f8007fff640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8008102a90 0x7f800819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f8007fff640 1 -- 172.21.15.5:0/26167045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 msgr2=0x7f800806bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f8007fff640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f800806bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f8007fff640 1 -- 172.21.15.5:0/26167045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80081a09c0 con 0x7f8008103450 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f80077fe640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f800806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f8007fff640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 0x7f80081a0100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f800000da10 tx=0x7f800000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800000bd70 con 0x7f8008103450 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80081a0cb0 con 0x7f8008103450 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8000003e20 con 0x7f8008103450 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80081a11a0 con 0x7f8008103450 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.090+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000010660 con 0x7f8008103450 2024-09-10T22:12:52.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.091+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8008108cb0 con 0x7f8008103450 2024-09-10T22:12:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.093+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f8000004270 con 0x7f8008103450 2024-09-10T22:12:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.093+0000 7f80057fa640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7ff40b52e0 0x7f7ff40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:12:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.093+0000 7f80077fe640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7ff40b52e0 0x7f7ff40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:12:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.094+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5549+0+0 (secure 0 0 0) 0x7f80000e5700 con 0x7f8008103450 2024-09-10T22:12:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.094+0000 7f80077fe640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7ff40b52e0 0x7f7ff40b77a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800f4d0 tx=0x7f7ff800a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:12:52.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.096+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f80000ad090 con 0x7f8008103450 2024-09-10T22:12:52.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:12:51.821+0000 7feb1a562640 -1 osd.8 0 waiting for initial osdmap 2024-09-10T22:12:52.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:12:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:12:51.829+0000 7feb12381640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:12:52.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:12:52.292+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8008063590 con 0x7f7ff40b52e0 2024-09-10T22:12:52.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi189 2024-09-10T22:12:52.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T22:12:52.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:12:52.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='osd.8 ' entity='osd.8' 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:52.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:52 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:52.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi189 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='osd.8 ' entity='osd.8' 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:52 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi189 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi189 to 5696M 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: osdmap e52: 9 total, 8 up, 9 in 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='osd.8 ' entity='osd.8' 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='client.14559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:12:52.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:52 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:12:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:53 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:12:53.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:53 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:12:53.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:53 smithi189 ceph-mon[35784]: osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] boot 2024-09-10T22:12:53.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:53 smithi189 ceph-mon[35784]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T22:12:53.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:53.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:53 smithi189 ceph-mon[35784]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T22:12:53.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:53 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:12:53.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:53 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:12:53.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:53 smithi005 ceph-mon[31115]: osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] boot 2024-09-10T22:12:53.704 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:53 smithi005 ceph-mon[31115]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T22:12:53.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:53.705 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:53 smithi005 ceph-mon[31115]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T22:12:53.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:53 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:12:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:53 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:12:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:53 smithi052 ceph-mon[34997]: osd.8 [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] boot 2024-09-10T22:12:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:53 smithi052 ceph-mon[34997]: osdmap e53: 9 total, 9 up, 9 in 2024-09-10T22:12:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-10T22:12:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:53 smithi052 ceph-mon[34997]: osdmap e54: 9 total, 9 up, 9 in 2024-09-10T22:12:54.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:54 smithi005 ceph-mon[31115]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:12:54.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:54 smithi005 ceph-mon[31115]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T22:12:54.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:54 smithi052 ceph-mon[34997]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:12:54.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:54 smithi052 ceph-mon[34997]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T22:12:54.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:54 smithi189 ceph-mon[35784]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:12:54.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:54 smithi189 ceph-mon[35784]: osdmap e55: 9 total, 9 up, 9 in 2024-09-10T22:12:55.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:55 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1330927453' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9abfd78-d3e7-4506-8c2d-5c5050fd2913"} : dispatch 2024-09-10T22:12:55.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:55 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1330927453' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9abfd78-d3e7-4506-8c2d-5c5050fd2913"}]': finished 2024-09-10T22:12:55.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:55 smithi005 ceph-mon[31115]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T22:12:55.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:12:55.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:55 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2138702698' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:55.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:55 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1330927453' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9abfd78-d3e7-4506-8c2d-5c5050fd2913"} : dispatch 2024-09-10T22:12:55.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:55 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1330927453' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9abfd78-d3e7-4506-8c2d-5c5050fd2913"}]': finished 2024-09-10T22:12:55.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:55 smithi052 ceph-mon[34997]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T22:12:55.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:12:55.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:55 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2138702698' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:55.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:55 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1330927453' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d9abfd78-d3e7-4506-8c2d-5c5050fd2913"} : dispatch 2024-09-10T22:12:55.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:55 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1330927453' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9abfd78-d3e7-4506-8c2d-5c5050fd2913"}]': finished 2024-09-10T22:12:55.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:55 smithi189 ceph-mon[35784]: osdmap e56: 10 total, 9 up, 10 in 2024-09-10T22:12:55.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:12:55.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:55 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2138702698' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:12:56.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:56 smithi052 ceph-mon[34997]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:12:56.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:56 smithi005 ceph-mon[31115]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:12:56.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:56 smithi189 ceph-mon[35784]: pgmap v207: 1 pgs: 1 peering; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:12:58.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:12:58 smithi052 ceph-mon[34997]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T22:12:59.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:12:58 smithi005 ceph-mon[31115]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T22:12:59.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:12:58 smithi189 ceph-mon[35784]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-09-10T22:13:00.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:00 smithi052 ceph-mon[34997]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T22:13:01.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:00 smithi005 ceph-mon[31115]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T22:13:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:00 smithi189 ceph-mon[35784]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 93 KiB/s, 0 objects/s recovering 2024-09-10T22:13:02.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:02 smithi052 ceph-mon[34997]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:13:03.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:02 smithi005 ceph-mon[31115]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:13:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:02 smithi189 ceph-mon[35784]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:13:03.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T22:13:03.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:03 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:03.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:03 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T22:13:03.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:03 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:03 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-10T22:13:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:03 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:04.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:04 smithi052 ceph-mon[34997]: Deploying daemon osd.9 on smithi005 2024-09-10T22:13:04.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:04 smithi052 ceph-mon[34997]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:13:05.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:04 smithi005 ceph-mon[31115]: Deploying daemon osd.9 on smithi005 2024-09-10T22:13:05.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:04 smithi005 ceph-mon[31115]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:13:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:04 smithi189 ceph-mon[35784]: Deploying daemon osd.9 on smithi005 2024-09-10T22:13:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:04 smithi189 ceph-mon[35784]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:13:07.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:06 smithi005 ceph-mon[31115]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:13:07.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:06 smithi189 ceph-mon[35784]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:13:07.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:06 smithi052 ceph-mon[34997]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:13:08.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:08 smithi005 ceph-mon[31115]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:13:09.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:08 smithi189 ceph-mon[35784]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:13:09.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:08 smithi052 ceph-mon[34997]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-10T22:13:10.012 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:10.013 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:10.013 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:10.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:09 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:10.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:09 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:10.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:09 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:10.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:09 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:10.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:09 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:10.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:09 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:11.064 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:10 smithi005 ceph-mon[31115]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:10 smithi189 ceph-mon[35784]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:11.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:10 smithi052 ceph-mon[34997]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.234+0000 7f80057fa640 1 -- 172.21.15.5:0/26167045 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8008063590 con 0x7f7ff40b52e0 2024-09-10T22:13:13.236 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 9 on host 'smithi005' 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.236+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7ff40b52e0 msgr2=0x7f7ff40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.236+0000 7f800def8640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7ff40b52e0 0x7f7ff40b77a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800f4d0 tx=0x7f7ff800a380 comp rx=0 tx=0).stop 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.236+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 msgr2=0x7f80081a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.236+0000 7f800def8640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 0x7f80081a0100 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f800000da10 tx=0x7f800000ded0 comp rx=0 tx=0).stop 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 shutdown_connections 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7ff40b52e0 0x7f7ff40b77a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8008103450 0x7f80081a0100 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8008102a90 0x7f800819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:13.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 --2- 172.21.15.5:0/26167045 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8008101930 0x7f800806bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 >> 172.21.15.5:0/26167045 conn(0x7f80080fd200 msgr2=0x7f8008105e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:13:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 shutdown_connections 2024-09-10T22:13:13.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:13:13.237+0000 7f800def8640 1 -- 172.21.15.5:0/26167045 wait complete. 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.541 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:13.871 DEBUG:teuthology.orchestra.run.smithi005:osd.9> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.9.service 2024-09-10T22:13:13.874 INFO:tasks.cephadm:Deploying osd.10 on smithi052 with /dev/vg_nvme/lv_1... 2024-09-10T22:13:13.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:13:14.138 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:13:15.566 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:15 smithi052 ceph-mon[34997]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:15.613 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:15 smithi005 ceph-mon[31115]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:15.613 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:13:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:13:15.424+0000 7f46551f4640 -1 osd.9 0 log_to_monitors true 2024-09-10T22:13:15.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:15 smithi189 ceph-mon[35784]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:16.516 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:16 smithi005 ceph-mon[31115]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T22:13:16.519 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:16 smithi052 ceph-mon[34997]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T22:13:16.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:16 smithi189 ceph-mon[35784]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-10T22:13:17.087 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-09-10T22:13:17.111 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi052:vg_nvme/lv_1 2024-09-10T22:13:17.361 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:13:17.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:13:17.695 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:17.696 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:13:17.435+0000 7f4651177640 -1 osd.9 0 waiting for initial osdmap 2024-09-10T22:13:17.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:13:17.447+0000 7f464cf9e640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: osdmap e57: 10 total, 9 up, 10 in 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]} : dispatch 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:17.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:17.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:17.834 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:17.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 -- 172.21.15.52:0/1951460379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c101fb0 msgr2=0x7f9c7c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:17.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 --2- 172.21.15.52:0/1951460379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c101fb0 0x7f9c7c1023b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009900 tx=0x7f9c7802a410 comp rx=0 tx=0).stop 2024-09-10T22:13:17.921 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 -- 172.21.15.52:0/1951460379 shutdown_connections 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 --2- 172.21.15.52:0/1951460379 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c7c103460 0x7f9c7c109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 --2- 172.21.15.52:0/1951460379 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 0x7f9c7c102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 --2- 172.21.15.52:0/1951460379 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c101fb0 0x7f9c7c1023b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 -- 172.21.15.52:0/1951460379 >> 172.21.15.52:0/1951460379 conn(0x7f9c7c0fc9b0 msgr2=0x7f9c7c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 -- 172.21.15.52:0/1951460379 shutdown_connections 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.904+0000 7f9c84379640 1 -- 172.21.15.52:0/1951460379 wait complete. 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 Processor -- start 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 -- start start 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c7c101fb0 0x7f9c7c198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 0x7f9c7c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 0x7f9c7c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c10e6c0 con 0x7f9c7c1028f0 2024-09-10T22:13:17.922 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c10e540 con 0x7f9c7c103460 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c84379640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7c10e840 con 0x7f9c7c101fb0 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c82916640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 0x7f9c7c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c82916640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 0x7f9c7c19a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.52:48566/0 (socket says 172.21.15.52:48566) 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c82916640 1 -- 172.21.15.52:0/2531228494 learned_addr learned my addr 172.21.15.52:0/2531228494 (peer_addr_for_me v2:172.21.15.52:0/0) 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.905+0000 7f9c82115640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c7c101fb0 0x7f9c7c198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c82916640 1 -- 172.21.15.52:0/2531228494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c7c101fb0 msgr2=0x7f9c7c198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c81914640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 0x7f9c7c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c82916640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c7c101fb0 0x7f9c7c198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c82916640 1 -- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 msgr2=0x7f9c7c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c82916640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 0x7f9c7c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c82916640 1 -- 172.21.15.52:0/2531228494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7c19a910 con 0x7f9c7c103460 2024-09-10T22:13:17.923 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c81914640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 0x7f9c7c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c82916640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 0x7f9c7c19a070 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cce0 tx=0x7f9c7400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7400f450 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7c19ac00 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c7400faa0 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c74018b70 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.906+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7c1a12e0 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.907+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c7c108e30 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.909+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f9c7400f5f0 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.910+0000 7f9c737fe640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c680b52e0 0x7f9c680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.910+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5981+0+0 (secure 0 0 0) 0x7f9c740e5bb0 con 0x7f9c7c103460 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.910+0000 7f9c82115640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c680b52e0 0x7f9c680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:17.924 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.910+0000 7f9c82115640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c680b52e0 0x7f9c680b77a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c780096c0 tx=0x7f9c78031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:13:17.925 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:17.913+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9c74014030 con 0x7f9c7c103460 2024-09-10T22:13:18.110 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:18.109+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9c7c063590 con 0x7f9c680b52e0 2024-09-10T22:13:18.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:13:18.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi005 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi005 to 4273M 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:13:18.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi005 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi005 to 4273M 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:13:18.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:18.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:13:18.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:13:18.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi005 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi005 to 4273M 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: from='osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: osdmap e58: 10 total, 9 up, 10 in 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:13:18.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:19 smithi189 ceph-mon[35784]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:19 smithi189 ceph-mon[35784]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:13:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:19 smithi189 ceph-mon[35784]: osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] boot 2024-09-10T22:13:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:19 smithi189 ceph-mon[35784]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T22:13:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:19 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:19.746 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:19 smithi052 ceph-mon[34997]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:19.746 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:19 smithi052 ceph-mon[34997]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:13:19.746 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:19 smithi052 ceph-mon[34997]: osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] boot 2024-09-10T22:13:19.746 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:19 smithi052 ceph-mon[34997]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T22:13:19.746 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:19 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:19.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:19 smithi005 ceph-mon[31115]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-09-10T22:13:19.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:19 smithi005 ceph-mon[31115]: from='client.24446 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi052:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:13:19.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:19 smithi005 ceph-mon[31115]: osd.9 [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] boot 2024-09-10T22:13:19.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:19 smithi005 ceph-mon[31115]: osdmap e59: 10 total, 10 up, 10 in 2024-09-10T22:13:19.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:19 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-10T22:13:20.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:20 smithi052 ceph-mon[34997]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T22:13:20.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:20 smithi005 ceph-mon[31115]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T22:13:20.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:20 smithi189 ceph-mon[35784]: osdmap e60: 10 total, 10 up, 10 in 2024-09-10T22:13:21.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/955548223' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"} : dispatch 2024-09-10T22:13:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"} : dispatch 2024-09-10T22:13:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"}]': finished 2024-09-10T22:13:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T22:13:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:21.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:21 smithi052 ceph-mon[34997]: from='client.? 172.21.15.52:0/1316531434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:13:21.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:21.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/955548223' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"} : dispatch 2024-09-10T22:13:21.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"} : dispatch 2024-09-10T22:13:21.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"}]': finished 2024-09-10T22:13:21.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T22:13:21.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:21.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:21 smithi005 ceph-mon[31115]: from='client.? 172.21.15.52:0/1316531434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:13:21.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:21.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/955548223' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"} : dispatch 2024-09-10T22:13:21.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"} : dispatch 2024-09-10T22:13:21.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd4c7c17-9bb8-4f3c-951f-3482e24c16fa"}]': finished 2024-09-10T22:13:21.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: osdmap e61: 11 total, 10 up, 11 in 2024-09-10T22:13:21.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:21.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:21 smithi189 ceph-mon[35784]: from='client.? 172.21.15.52:0/1316531434' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:13:23.745 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:23 smithi189 ceph-mon[35784]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:23.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:23 smithi052 ceph-mon[34997]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:23.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:23 smithi005 ceph-mon[31115]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:24.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:24 smithi052 ceph-mon[34997]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:24.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:24 smithi005 ceph-mon[31115]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:24.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:24 smithi189 ceph-mon[35784]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:26.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:26 smithi052 ceph-mon[34997]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:27.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:26 smithi005 ceph-mon[31115]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:27.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:26 smithi189 ceph-mon[35784]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:28.785 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:28 smithi052 ceph-mon[34997]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:28 smithi005 ceph-mon[31115]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:29.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:28 smithi189 ceph-mon[35784]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:29.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T22:13:29.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:29 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:30.000 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T22:13:30.001 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:29 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:30.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-10T22:13:30.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:29 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:30 smithi005 ceph-mon[31115]: Deploying daemon osd.10 on smithi052 2024-09-10T22:13:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:30 smithi005 ceph-mon[31115]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:31.165 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:30 smithi052 ceph-mon[34997]: Deploying daemon osd.10 on smithi052 2024-09-10T22:13:31.165 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:30 smithi052 ceph-mon[34997]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:30 smithi189 ceph-mon[35784]: Deploying daemon osd.10 on smithi052 2024-09-10T22:13:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:30 smithi189 ceph-mon[35784]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:32.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:32 smithi052 ceph-mon[34997]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:33.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:32 smithi005 ceph-mon[31115]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:33.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:32 smithi189 ceph-mon[35784]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:34.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:34 smithi052 ceph-mon[34997]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:35.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:34 smithi005 ceph-mon[31115]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:35.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:34 smithi189 ceph-mon[35784]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:36.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:36 smithi052 ceph-mon[34997]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:36.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:36.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:37.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:36 smithi005 ceph-mon[31115]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:37.085 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:36 smithi189 ceph-mon[35784]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:37.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:38.977 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:38 smithi052 ceph-mon[34997]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:39.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:38 smithi005 ceph-mon[31115]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:38 smithi189 ceph-mon[35784]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:39.742 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.740+0000 7f9c737fe640 1 -- 172.21.15.52:0/2531228494 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9c7c063590 con 0x7f9c680b52e0 2024-09-10T22:13:39.742 INFO:teuthology.orchestra.run.smithi052.stdout:Created osd(s) 10 on host 'smithi052' 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c680b52e0 msgr2=0x7f9c680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c680b52e0 0x7f9c680b77a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c780096c0 tx=0x7f9c78031430 comp rx=0 tx=0).stop 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 msgr2=0x7f9c7c19a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 0x7f9c7c19a070 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9c7400cce0 tx=0x7f9c7400a620 comp rx=0 tx=0).stop 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 shutdown_connections 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9c680b52e0 0x7f9c680b77a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:39.745 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9c7c103460 0x7f9c7c19a070 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9c7c1028f0 0x7f9c7c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 --2- 172.21.15.52:0/2531228494 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9c7c101fb0 0x7f9c7c198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 >> 172.21.15.52:0/2531228494 conn(0x7f9c7c0fc9b0 msgr2=0x7f9c7c106000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:13:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 shutdown_connections 2024-09-10T22:13:39.746 INFO:teuthology.orchestra.run.smithi052.stderr:2024-09-10T22:13:39.742+0000 7f9c84379640 1 -- 172.21.15.52:0/2531228494 wait complete. 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:39 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:39 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:40.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:40.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:13:40.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:39 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:40.440 DEBUG:teuthology.orchestra.run.smithi052:osd.10> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.10.service 2024-09-10T22:13:40.442 INFO:tasks.cephadm:Deploying osd.11 on smithi189 with /dev/vg_nvme/lv_1... 2024-09-10T22:13:40.442 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-10T22:13:40.699 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:13:40.992 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:40 smithi052 ceph-mon[34997]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:41.072 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:40 smithi189 ceph-mon[35784]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:40 smithi005 ceph-mon[31115]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:42.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:41 smithi189 ceph-mon[35784]: from='osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:13:42.110 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:41 smithi189 ceph-mon[35784]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:13:42.133 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:41 smithi052 ceph-mon[34997]: from='osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:13:42.133 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:41 smithi052 ceph-mon[34997]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:13:42.133 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:13:41 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:13:41.821+0000 7f690925f640 -1 osd.10 0 log_to_monitors true 2024-09-10T22:13:42.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:41 smithi005 ceph-mon[31115]: from='osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:13:42.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:41 smithi005 ceph-mon[31115]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-10T22:13:43.171 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:42 smithi052 ceph-mon[34997]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:43.171 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:42 smithi052 ceph-mon[34997]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T22:13:43.171 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:42 smithi052 ceph-mon[34997]: from='osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:13:43.171 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:42 smithi052 ceph-mon[34997]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T22:13:43.172 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:42 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:43.172 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:42 smithi052 ceph-mon[34997]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:42 smithi189 ceph-mon[35784]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:43.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:42 smithi189 ceph-mon[35784]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T22:13:43.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:42 smithi189 ceph-mon[35784]: from='osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:13:43.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:42 smithi189 ceph-mon[35784]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T22:13:43.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:42 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:43.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:42 smithi189 ceph-mon[35784]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:13:43.200 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T22:13:43.225 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi189:vg_nvme/lv_1 2024-09-10T22:13:43.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:42 smithi005 ceph-mon[31115]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:43.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:42 smithi005 ceph-mon[31115]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-10T22:13:43.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:42 smithi005 ceph-mon[31115]: from='osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:13:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:42 smithi005 ceph-mon[31115]: osdmap e62: 11 total, 10 up, 11 in 2024-09-10T22:13:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:42 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:43.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:42 smithi005 ceph-mon[31115]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]} : dispatch 2024-09-10T22:13:43.478 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:13:43.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:13:43.350+0000 7f69051e2640 -1 osd.10 0 waiting for initial osdmap 2024-09-10T22:13:43.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:13:43.360+0000 7f68fd001640 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:13:43.993 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 -- 172.21.15.189:0/1562429097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6406b640 msgr2=0x7f0f64105690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 --2- 172.21.15.189:0/1562429097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6406b640 0x7f0f64105690 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009900 tx=0x7f0f5402a410 comp rx=0 tx=0).stop 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 -- 172.21.15.189:0/1562429097 shutdown_connections 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 --2- 172.21.15.189:0/1562429097 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64108720 0x7f0f6410abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 --2- 172.21.15.189:0/1562429097 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f64105bd0 0x7f0f64107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 --2- 172.21.15.189:0/1562429097 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f6406b640 0x7f0f64105690 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 -- 172.21.15.189:0/1562429097 >> 172.21.15.189:0/1562429097 conn(0x7f0f640fd1e0 msgr2=0x7f0f640ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 -- 172.21.15.189:0/1562429097 shutdown_connections 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.978+0000 7f0f689ad640 1 -- 172.21.15.189:0/1562429097 wait complete. 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 Processor -- start 2024-09-10T22:13:43.994 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 -- start start 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6406b640 0x7f0f64198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64105bd0 0x7f0f64199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 0x7f0f6419a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6410e750 con 0x7f0f6406b640 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6410e5d0 con 0x7f0f64105bd0 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f689ad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6410e8d0 con 0x7f0f64108720 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 0x7f0f6419a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 0x7f0f6419a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:56900/0 (socket says 172.21.15.189:56900) 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 -- 172.21.15.189:0/4153064329 learned_addr learned my addr 172.21.15.189:0/4153064329 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f6259c640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6406b640 0x7f0f64198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f61d9b640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64105bd0 0x7f0f64199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:43.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 -- 172.21.15.189:0/4153064329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64105bd0 msgr2=0x7f0f64199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64105bd0 0x7f0f64199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 -- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6406b640 msgr2=0x7f0f64198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6406b640 0x7f0f64198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f62d9d640 1 -- 172.21.15.189:0/4153064329 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6419aa60 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.979+0000 7f0f61d9b640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64105bd0 0x7f0f64199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.980+0000 7f0f62d9d640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 0x7f0f6419a1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b970 tx=0x7f0f5c00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.980+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c019070 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.980+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6419ad50 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.980+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f5c014440 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.980+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0075d0 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.980+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f641a1430 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.981+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f640fecd0 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.982+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f0f5c00cb40 con 0x7f0f64108720 2024-09-10T22:13:43.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.983+0000 7f0f537fe640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0f4c0b52e0 0x7f0f4c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:13:43.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.983+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6414+0+0 (secure 0 0 0) 0x7f0f5c0e4d30 con 0x7f0f64108720 2024-09-10T22:13:43.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.984+0000 7f0f6259c640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0f4c0b52e0 0x7f0f4c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:13:43.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.984+0000 7f0f6259c640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0f4c0b52e0 0x7f0f4c0b77a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000c00 tx=0x7f0f540314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:13:43.997 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:43.987+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0f5c0ac2c0 con 0x7f0f64108720 2024-09-10T22:13:44.183 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:13:44.181+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f0f64063590 con 0x7f0f4c0b52e0 2024-09-10T22:13:44.184 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:13:44.184 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T22:13:44.184 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:44.184 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:44.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='osd.10 ' entity='osd.10' 2024-09-10T22:13:44.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.185 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:44.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:44.186 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:43 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='osd.10 ' entity='osd.10' 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:44.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:44.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:43 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi052", "root=default"]}]': finished 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: osdmap e63: 11 total, 10 up, 11 in 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='osd.10 ' entity='osd.10' 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:44.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:44.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:13:44.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:43 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:13:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:13:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:13:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi052 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] boot 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T22:13:45.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:45.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:13:45.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi052 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] boot 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T22:13:45.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:45.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:13:45.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:13:45.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi052 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi052 to 4273M 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi189:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: osd.10 [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] boot 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: osdmap e64: 11 total, 11 up, 11 in 2024-09-10T22:13:45.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-10T22:13:46.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:46 smithi189 ceph-mon[35784]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T22:13:46.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:46 smithi052 ceph-mon[34997]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T22:13:46.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:46 smithi005 ceph-mon[31115]: osdmap e65: 11 total, 11 up, 11 in 2024-09-10T22:13:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:13:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T22:13:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/2900502263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"} : dispatch 2024-09-10T22:13:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"} : dispatch 2024-09-10T22:13:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"}]': finished 2024-09-10T22:13:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T22:13:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:13:47.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:47 smithi189 ceph-mon[35784]: from='client.? 172.21.15.189:0/260176754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:13:47.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/2900502263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"} : dispatch 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"} : dispatch 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"}]': finished 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:13:47.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:47 smithi052 ceph-mon[34997]: from='client.? 172.21.15.189:0/260176754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:13:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:13:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: osdmap e66: 11 total, 11 up, 11 in 2024-09-10T22:13:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/2900502263' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"} : dispatch 2024-09-10T22:13:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"} : dispatch 2024-09-10T22:13:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91aae414-bd19-4b39-a93f-d4705df0a491"}]': finished 2024-09-10T22:13:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: osdmap e67: 12 total, 11 up, 12 in 2024-09-10T22:13:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:13:47.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.189:0/260176754' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-10T22:13:49.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:49 smithi189 ceph-mon[35784]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T22:13:49.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:49 smithi052 ceph-mon[34997]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T22:13:49.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:49 smithi005 ceph-mon[31115]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-10T22:13:51.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:51 smithi189 ceph-mon[35784]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-10T22:13:51.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:51 smithi052 ceph-mon[34997]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-10T22:13:51.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:51 smithi005 ceph-mon[31115]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-10T22:13:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:53 smithi189 ceph-mon[35784]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T22:13:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:53 smithi052 ceph-mon[34997]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T22:13:53.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:53 smithi005 ceph-mon[31115]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-10T22:13:55.588 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:55 smithi189 ceph-mon[35784]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:13:55.588 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T22:13:55.588 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:55 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:55 smithi052 ceph-mon[34997]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:13:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T22:13:55.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:55 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:55.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:55 smithi005 ceph-mon[31115]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-10T22:13:55.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-10T22:13:55.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:55 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:13:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:56 smithi189 ceph-mon[35784]: Deploying daemon osd.11 on smithi189 2024-09-10T22:13:56.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:56 smithi052 ceph-mon[34997]: Deploying daemon osd.11 on smithi189 2024-09-10T22:13:56.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:56 smithi005 ceph-mon[31115]: Deploying daemon osd.11 on smithi189 2024-09-10T22:13:57.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:57 smithi189 ceph-mon[35784]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:13:57.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:57 smithi052 ceph-mon[34997]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:13:57.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:57 smithi005 ceph-mon[31115]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-10T22:13:59.635 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:13:59 smithi005 ceph-mon[31115]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:13:59.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:13:59 smithi189 ceph-mon[35784]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:13:59.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:13:59 smithi052 ceph-mon[34997]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-09-10T22:14:01.661 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:01 smithi189 ceph-mon[35784]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:01.661 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:01.661 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:01.662 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:01 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:01.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:01 smithi052 ceph-mon[34997]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:01.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:01.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:01.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:01 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:01.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:01 smithi005 ceph-mon[31115]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:01.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:01.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:01.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:01 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:03.598 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:03 smithi189 ceph-mon[35784]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:03.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:03 smithi052 ceph-mon[34997]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:03.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:03 smithi005 ceph-mon[31115]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:04.692 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.691+0000 7f0f537fe640 1 -- 172.21.15.189:0/4153064329 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f0f64063590 con 0x7f0f4c0b52e0 2024-09-10T22:14:04.692 INFO:teuthology.orchestra.run.smithi189.stdout:Created osd(s) 11 on host 'smithi189' 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0f4c0b52e0 msgr2=0x7f0f4c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0f4c0b52e0 0x7f0f4c0b77a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0f54000c00 tx=0x7f0f540314a0 comp rx=0 tx=0).stop 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 msgr2=0x7f0f6419a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 0x7f0f6419a1c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00b970 tx=0x7f0f5c00be30 comp rx=0 tx=0).stop 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 shutdown_connections 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0f4c0b52e0 0x7f0f4c0b77a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0f64108720 0x7f0f6419a1c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:04.695 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0f64105bd0 0x7f0f64199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:04.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 --2- 172.21.15.189:0/4153064329 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0f6406b640 0x7f0f64198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:04.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 >> 172.21.15.189:0/4153064329 conn(0x7f0f640fd1e0 msgr2=0x7f0f64103fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:04.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 shutdown_connections 2024-09-10T22:14:04.696 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:04.693+0000 7f0f689ad640 1 -- 172.21.15.189:0/4153064329 wait complete. 2024-09-10T22:14:05.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:04 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:04 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:05.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.338 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:05.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:05.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:05.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.339 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:04 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:05.366 DEBUG:teuthology.orchestra.run.smithi189:osd.11> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.11.service 2024-09-10T22:14:05.369 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-10T22:14:05.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T22:14:05.639 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 -- 172.21.15.5:0/3083589455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214105f50 msgr2=0x7ff214108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/3083589455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214105f50 0x7ff214108340 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff208009900 tx=0x7ff20802a410 comp rx=0 tx=0).stop 2024-09-10T22:14:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 -- 172.21.15.5:0/3083589455 shutdown_connections 2024-09-10T22:14:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/3083589455 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff214108880 0x7ff21410ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/3083589455 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214105f50 0x7ff214108340 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/3083589455 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff214100e80 0x7ff214101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 -- 172.21.15.5:0/3083589455 >> 172.21.15.5:0/3083589455 conn(0x7ff2140fc9b0 msgr2=0x7ff2140fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 -- 172.21.15.5:0/3083589455 shutdown_connections 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.120+0000 7ff21a9d4640 1 -- 172.21.15.5:0/3083589455 wait complete. 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 Processor -- start 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 -- start start 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff214100e80 0x7ff214198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff214105f50 0x7ff214199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 0x7ff21419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff21410e710 con 0x7ff214108880 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff21410e590 con 0x7ff214105f50 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff21a9d4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff21410e890 con 0x7ff214100e80 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff218f71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 0x7ff21419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:06.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff218f71640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 0x7ff21419a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53674/0 (socket says 172.21.15.5:53674) 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff218f71640 1 -- 172.21.15.5:0/1326370387 learned_addr learned my addr 172.21.15.5:0/1326370387 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff2137fe640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff214105f50 0x7ff214199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.121+0000 7ff213fff640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff214100e80 0x7ff214198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff218f71640 1 -- 172.21.15.5:0/1326370387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff214100e80 msgr2=0x7ff214198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff218f71640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff214100e80 0x7ff214198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff218f71640 1 -- 172.21.15.5:0/1326370387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff214105f50 msgr2=0x7ff214199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff218f71640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff214105f50 0x7ff214199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff218f71640 1 -- 172.21.15.5:0/1326370387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21419a960 con 0x7ff214108880 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff218f71640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 0x7ff21419a0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00b970 tx=0x7ff20c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c019070 con 0x7ff214108880 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff20c014440 con 0x7ff214108880 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21419ac50 con 0x7ff214108880 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0075d0 con 0x7ff214108880 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.122+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2141a1330 con 0x7ff214108880 2024-09-10T22:14:06.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.123+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff214101280 con 0x7ff214108880 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.125+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7ff20c00cb40 con 0x7ff214108880 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.125+0000 7ff2117fa640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1fc0b52e0 0x7ff1fc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.125+0000 7ff213fff640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1fc0b52e0 0x7ff1fc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.125+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6809+0+0 (secure 0 0 0) 0x7ff20c0e5270 con 0x7ff214108880 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.126+0000 7ff213fff640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1fc0b52e0 0x7ff1fc0b77a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff20400bbe0 tx=0x7ff20400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:06.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.128+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff20c0ac0c0 con 0x7ff214108880 2024-09-10T22:14:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.317+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7ff2140fe4a0 con 0x7ff214108880 2024-09-10T22:14:06.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.317+0000 7ff2117fa640 1 -- 172.21.15.5:0/1326370387 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7ff20c0b0af0 con 0x7ff214108880 2024-09-10T22:14:06.319 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.319+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1fc0b52e0 msgr2=0x7ff1fc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.319+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1fc0b52e0 0x7ff1fc0b77a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff20400bbe0 tx=0x7ff20400b390 comp rx=0 tx=0).stop 2024-09-10T22:14:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.319+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 msgr2=0x7ff21419a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:06.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.319+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 0x7ff21419a0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00b970 tx=0x7ff20c00be30 comp rx=0 tx=0).stop 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 shutdown_connections 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1fc0b52e0 0x7ff1fc0b77a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff214108880 0x7ff21419a0c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff214105f50 0x7ff214199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 --2- 172.21.15.5:0/1326370387 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff214100e80 0x7ff214198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 >> 172.21.15.5:0/1326370387 conn(0x7ff2140fc9b0 msgr2=0x7ff214106b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 shutdown_connections 2024-09-10T22:14:06.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:06.320+0000 7ff21a9d4640 1 -- 172.21.15.5:0/1326370387 wait complete. 2024-09-10T22:14:07.033 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726006424,"num_in_osds":12,"osd_in_since":1726006426,"num_remapped_pgs":0} 2024-09-10T22:14:07.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:06 smithi005 ceph-mon[31115]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:07.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:06 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1326370387' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:07.159 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:06 smithi189 ceph-mon[35784]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:07.159 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:06 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1326370387' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:07.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:06 smithi052 ceph-mon[34997]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:07.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:06 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1326370387' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:07.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:14:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:14:07.156+0000 7f3221bb5640 -1 osd.11 0 log_to_monitors true 2024-09-10T22:14:08.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T22:14:08.244 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:07 smithi189 ceph-mon[35784]: from='osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:14:08.244 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:07 smithi189 ceph-mon[35784]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:14:08.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:07 smithi052 ceph-mon[34997]: from='osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:14:08.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:07 smithi052 ceph-mon[34997]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:14:08.310 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:08.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:07 smithi005 ceph-mon[31115]: from='osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:14:08.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:07 smithi005 ceph-mon[31115]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-10T22:14:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 -- 172.21.15.5:0/3711958465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 msgr2=0x7f0060105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:08.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3711958465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060105630 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0050009900 tx=0x7f005002a410 comp rx=0 tx=0).stop 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 -- 172.21.15.5:0/3711958465 shutdown_connections 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3711958465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060108770 0x7f006010ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3711958465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060105bc0 0x7f0060108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3711958465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060105630 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.777+0000 7f0065fbd640 1 -- 172.21.15.5:0/3711958465 >> 172.21.15.5:0/3711958465 conn(0x7f00600fd200 msgr2=0x7f00600ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 -- 172.21.15.5:0/3711958465 shutdown_connections 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 -- 172.21.15.5:0/3711958465 wait complete. 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 Processor -- start 2024-09-10T22:14:08.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 -- start start 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060102d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060105bc0 0x7f00601015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060108770 0x7f0060101b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f006010e6f0 con 0x7f006006c0c0 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f006010e570 con 0x7f0060108770 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.778+0000 7f0065fbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f006010e870 con 0x7f0060105bc0 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060102d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060102d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53692/0 (socket says 172.21.15.5:53692) 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 -- 172.21.15.5:0/3718181979 learned_addr learned my addr 172.21.15.5:0/3718181979 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005effd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060105bc0 0x7f00601015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005ffff640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060108770 0x7f0060101b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:08.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 -- 172.21.15.5:0/3718181979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060105bc0 msgr2=0x7f00601015d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060105bc0 0x7f00601015d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 -- 172.21.15.5:0/3718181979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060108770 msgr2=0x7f0060101b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060108770 0x7f0060101b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 -- 172.21.15.5:0/3718181979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00601023d0 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005effd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060105bc0 0x7f00601015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005f7fe640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060102d60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0050005940 tx=0x7f0050031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005003f030 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0050003aa0 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00601a2ed0 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050035070 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.779+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00601a32d0 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.780+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00600fecf0 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.782+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f005003bbb0 con 0x7f006006c0c0 2024-09-10T22:14:08.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.783+0000 7f005cff9640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00480b5360 0x7f00480b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:08.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.783+0000 7f005effd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00480b5360 0x7f00480b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:08.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.783+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6831+0+0 (secure 0 0 0) 0x7f0050106480 con 0x7f006006c0c0 2024-09-10T22:14:08.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.783+0000 7f005effd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00480b5360 0x7f00480b7820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f006006c570 tx=0x7f005400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:08.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.786+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f00500cd220 con 0x7f006006c0c0 2024-09-10T22:14:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.974+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f006002e810 con 0x7f006006c0c0 2024-09-10T22:14:08.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.975+0000 7f005cff9640 1 -- 172.21.15.5:0/3718181979 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f00500d1c50 con 0x7f006006c0c0 2024-09-10T22:14:08.976 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.977+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00480b5360 msgr2=0x7f00480b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.977+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00480b5360 0x7f00480b7820 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f006006c570 tx=0x7f005400b390 comp rx=0 tx=0).stop 2024-09-10T22:14:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.977+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 msgr2=0x7f0060102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:08.979 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.977+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060102d60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0050005940 tx=0x7f0050031a50 comp rx=0 tx=0).stop 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 shutdown_connections 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00480b5360 0x7f00480b7820 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0060108770 0x7f0060101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0060105bc0 0x7f00601015d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 --2- 172.21.15.5:0/3718181979 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f006006c0c0 0x7f0060102d60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 >> 172.21.15.5:0/3718181979 conn(0x7f00600fd200 msgr2=0x7f0060103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 shutdown_connections 2024-09-10T22:14:08.980 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:08.978+0000 7f0065fbd640 1 -- 172.21.15.5:0/3718181979 wait complete. 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: Detected new or changed devices on smithi189 2024-09-10T22:14:09.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:08 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3718181979' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:09.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: Detected new or changed devices on smithi189 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T22:14:09.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:09.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:09.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:08 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3718181979' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-10T22:14:09.385 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: osdmap e68: 12 total, 11 up, 12 in 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: Detected new or changed devices on smithi189 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: Adjusting osd_memory_target on smithi189 to 4272M 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:09.386 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:09.387 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:08 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3718181979' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:09.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:14:09.383+0000 7f321db38640 -1 osd.11 0 waiting for initial osdmap 2024-09-10T22:14:09.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:14:09.394+0000 7f3215957640 -1 osd.11 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T22:14:09.775 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726006424,"num_in_osds":12,"osd_in_since":1726006426,"num_remapped_pgs":0} 2024-09-10T22:14:10.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:09 smithi005 ceph-mon[31115]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:14:10.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:09 smithi005 ceph-mon[31115]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T22:14:10.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:10.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:09 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:10.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:09 smithi005 ceph-mon[31115]: from='osd.11 ' entity='osd.11' 2024-09-10T22:14:10.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:09 smithi052 ceph-mon[34997]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:14:10.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:09 smithi052 ceph-mon[34997]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T22:14:10.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:09 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:10.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:09 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:10.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:09 smithi052 ceph-mon[34997]: from='osd.11 ' entity='osd.11' 2024-09-10T22:14:10.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-mon[35784]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi189", "root=default"]}]': finished 2024-09-10T22:14:10.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-mon[35784]: osdmap e69: 12 total, 11 up, 12 in 2024-09-10T22:14:10.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:10.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:10.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:09 smithi189 ceph-mon[35784]: from='osd.11 ' entity='osd.11' 2024-09-10T22:14:10.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-10T22:14:11.045 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: purged_snaps scrub starts 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: purged_snaps scrub ok 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] boot 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T22:14:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:11.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: purged_snaps scrub starts 2024-09-10T22:14:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: purged_snaps scrub ok 2024-09-10T22:14:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] boot 2024-09-10T22:14:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T22:14:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: purged_snaps scrub starts 2024-09-10T22:14:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: purged_snaps scrub ok 2024-09-10T22:14:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 322 MiB used, 983 GiB / 983 GiB avail 2024-09-10T22:14:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: osd.11 [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] boot 2024-09-10T22:14:11.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: osdmap e70: 12 total, 12 up, 12 in 2024-09-10T22:14:11.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 -- 172.21.15.5:0/2034680240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 msgr2=0x7f310c107a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 --2- 172.21.15.5:0/2034680240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c107a70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009900 tx=0x7f30fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 -- 172.21.15.5:0/2034680240 shutdown_connections 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 --2- 172.21.15.5:0/2034680240 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c10a960 0x7f310c10ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 --2- 172.21.15.5:0/2034680240 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c107fb0 0x7f310c10a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 --2- 172.21.15.5:0/2034680240 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c107a70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 -- 172.21.15.5:0/2034680240 >> 172.21.15.5:0/2034680240 conn(0x7f310c0fd1e0 msgr2=0x7f310c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 -- 172.21.15.5:0/2034680240 shutdown_connections 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.520+0000 7f3110c22640 1 -- 172.21.15.5:0/2034680240 wait complete. 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 Processor -- start 2024-09-10T22:14:11.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 -- start start 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c107fb0 0x7f310c19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c10a960 0x7f310c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f310c110890 con 0x7f310c06b550 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f310c110710 con 0x7f310c107fb0 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f3110c22640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f310c110a10 con 0x7f310c10a960 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f310a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f310a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c19af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53722/0 (socket says 172.21.15.5:53722) 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.521+0000 7f310a59c640 1 -- 172.21.15.5:0/3764569577 learned_addr learned my addr 172.21.15.5:0/3764569577 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f3109d9b640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c107fb0 0x7f310c19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310ad9d640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c10a960 0x7f310c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310a59c640 1 -- 172.21.15.5:0/3764569577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c10a960 msgr2=0x7f310c19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310a59c640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c10a960 0x7f310c19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310a59c640 1 -- 172.21.15.5:0/3764569577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c107fb0 msgr2=0x7f310c19b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310a59c640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c107fb0 0x7f310c19b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310a59c640 1 -- 172.21.15.5:0/3764569577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310c19ca80 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f3109d9b640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c107fb0 0x7f310c19b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310ad9d640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c10a960 0x7f310c19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f310a59c640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c19af50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f30fc031500 tx=0x7f30fc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc03f030 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f30fc003800 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc035070 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310c19cd10 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.522+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310c1a3450 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.523+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310c107a70 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.525+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f30fc003cd0 con 0x7f310c06b550 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.525+0000 7f31037fe640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f30f80b5360 0x7f30f80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.526+0000 7f3109d9b640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f30f80b5360 0x7f30f80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:11.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.526+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f30fc106870 con 0x7f310c06b550 2024-09-10T22:14:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.526+0000 7f3109d9b640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f30f80b5360 0x7f30f80b7820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f310c103630 tx=0x7f30f4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:11.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.528+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f30fc0cdb30 con 0x7f310c06b550 2024-09-10T22:14:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.717+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f310c0fecd0 con 0x7f310c06b550 2024-09-10T22:14:11.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.717+0000 7f31037fe640 1 -- 172.21.15.5:0/3764569577 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f30fc0cd430 con 0x7f310c06b550 2024-09-10T22:14:11.719 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f30f80b5360 msgr2=0x7f30f80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:11.721 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f30f80b5360 0x7f30f80b7820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f310c103630 tx=0x7f30f4005d90 comp rx=0 tx=0).stop 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 msgr2=0x7f310c19af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c19af50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f30fc031500 tx=0x7f30fc0043c0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 shutdown_connections 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f30f80b5360 0x7f30f80b7820 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f310c10a960 0x7f310c19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f310c107fb0 0x7f310c19b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 --2- 172.21.15.5:0/3764569577 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f310c06b550 0x7f310c19af50 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 >> 172.21.15.5:0/3764569577 conn(0x7f310c0fd1e0 msgr2=0x7f310c10b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:11.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 shutdown_connections 2024-09-10T22:14:11.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:11.720+0000 7f3110c22640 1 -- 172.21.15.5:0/3764569577 wait complete. 2024-09-10T22:14:12.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:11 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3764569577' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:12.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:11 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3764569577' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:12.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:11 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3764569577' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-10T22:14:12.525 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726006450,"num_in_osds":12,"osd_in_since":1726006426,"num_remapped_pgs":0} 2024-09-10T22:14:12.526 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:14:12.781 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:13.215 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:12 smithi005 ceph-mon[31115]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:13.215 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:12 smithi005 ceph-mon[31115]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.212+0000 7fda1d5ca640 1 -- 172.21.15.5:0/2240826143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18103ca0 msgr2=0x7fda18104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.212+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/2240826143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18103ca0 0x7fda18104080 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda08009ca0 tx=0x7fda0802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 -- 172.21.15.5:0/2240826143 shutdown_connections 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/2240826143 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda1810d100 0x7fda1810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/2240826143 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda181045c0 0x7fda1810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/2240826143 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda18103ca0 0x7fda18104080 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 -- 172.21.15.5:0/2240826143 >> 172.21.15.5:0/2240826143 conn(0x7fda180fd700 msgr2=0x7fda180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 -- 172.21.15.5:0/2240826143 shutdown_connections 2024-09-10T22:14:13.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 -- 172.21.15.5:0/2240826143 wait complete. 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.213+0000 7fda1d5ca640 1 Processor -- start 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 -- start start 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda18103ca0 0x7fda18101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 0x7fda18101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda1810d100 0x7fda181023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fda18112d70 con 0x7fda181045c0 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fda18112bf0 con 0x7fda1810d100 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda1d5ca640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fda18112ef0 con 0x7fda18103ca0 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 0x7fda18101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 0x7fda18101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35618/0 (socket says 172.21.15.5:35618) 2024-09-10T22:14:13.233 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 -- 172.21.15.5:0/3120100589 learned_addr learned my addr 172.21.15.5:0/3120100589 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda16ffd640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda18103ca0 0x7fda18101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda177fe640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda1810d100 0x7fda181023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 -- 172.21.15.5:0/3120100589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda18103ca0 msgr2=0x7fda18101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda18103ca0 0x7fda18101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 -- 172.21.15.5:0/3120100589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda1810d100 msgr2=0x7fda181023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda1810d100 0x7fda181023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda167fc640 1 -- 172.21.15.5:0/3120100589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda181a7620 con 0x7fda181045c0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.214+0000 7fda177fe640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda1810d100 0x7fda181023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.215+0000 7fda167fc640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 0x7fda18101e90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00c970 tx=0x7fda0c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.215+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c004220 con 0x7fda181045c0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.215+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda0c0043c0 con 0x7fda181045c0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.215+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda181a7910 con 0x7fda181045c0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.215+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c003e30 con 0x7fda181045c0 2024-09-10T22:14:13.234 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.215+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda181a7e50 con 0x7fda181045c0 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.216+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda18104080 con 0x7fda181045c0 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.217+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fda0c0079b0 con 0x7fda181045c0 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.218+0000 7fd9fffff640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fda000b52e0 0x7fda000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.218+0000 7fda16ffd640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fda000b52e0 0x7fda000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.218+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fda0c0e57f0 con 0x7fda181045c0 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.218+0000 7fda16ffd640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fda000b52e0 0x7fda000b77a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda080098d0 tx=0x7fda08009900 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:13.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.222+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fda0c014030 con 0x7fda181045c0 2024-09-10T22:14:13.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:12 smithi052 ceph-mon[34997]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:13.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:12 smithi052 ceph-mon[34997]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T22:14:13.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.410+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda181a8280 con 0x7fda181045c0 2024-09-10T22:14:13.412 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.410+0000 7fd9fffff640 1 -- 172.21.15.5:0/3120100589 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18386 (secure 0 0 0) 0x7fda0c0acab0 con 0x7fda181045c0 2024-09-10T22:14:13.412 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:13.412 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":71,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:14:11.985411+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:14:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fda000b52e0 msgr2=0x7fda000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fda000b52e0 0x7fda000b77a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda080098d0 tx=0x7fda08009900 comp rx=0 tx=0).stop 2024-09-10T22:14:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 msgr2=0x7fda18101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 0x7fda18101e90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00c970 tx=0x7fda0c00ce30 comp rx=0 tx=0).stop 2024-09-10T22:14:13.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 shutdown_connections 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fda000b52e0 0x7fda000b77a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fda1810d100 0x7fda181023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fda181045c0 0x7fda18101e90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 --2- 172.21.15.5:0/3120100589 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fda18103ca0 0x7fda18101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 >> 172.21.15.5:0/3120100589 conn(0x7fda180fd700 msgr2=0x7fda1810f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 shutdown_connections 2024-09-10T22:14:13.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:13.413+0000 7fda1d5ca640 1 -- 172.21.15.5:0/3120100589 wait complete. 2024-09-10T22:14:13.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:12 smithi189 ceph-mon[35784]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:13.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:12 smithi189 ceph-mon[35784]: osdmap e71: 12 total, 12 up, 12 in 2024-09-10T22:14:14.169 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:10:20.089426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:14:14.169 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-10T22:14:14.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:13 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3120100589' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:14:14.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:13 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3120100589' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:14:14.424 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:14.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:13 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3120100589' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:14:14.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 -- 172.21.15.5:0/995817776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b68108060 msgr2=0x7f9b6810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/995817776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b68108060 0x7f9b6810e860 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009ca0 tx=0x7f9b6002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 -- 172.21.15.5:0/995817776 shutdown_connections 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/995817776 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b68108060 0x7f9b6810e860 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/995817776 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b681076e0 0x7f9b68107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/995817776 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b68101cd0 0x7f9b681020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 -- 172.21.15.5:0/995817776 >> 172.21.15.5:0/995817776 conn(0x7f9b680fd700 msgr2=0x7f9b680ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 -- 172.21.15.5:0/995817776 shutdown_connections 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.909+0000 7f9b6ef62640 1 -- 172.21.15.5:0/995817776 wait complete. 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 Processor -- start 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 -- start start 2024-09-10T22:14:14.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b68101cd0 0x7f9b681980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 0x7f9b68198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b68108060 0x7f9b6819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68111ce0 con 0x7f9b681076e0 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68111b60 con 0x7f9b68108060 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ef62640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68111e60 con 0x7f9b68101cd0 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 0x7f9b68198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 0x7f9b68198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35648/0 (socket says 172.21.15.5:35648) 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b67fff640 1 -- 172.21.15.5:0/620294056 learned_addr learned my addr 172.21.15.5:0/620294056 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6d4ff640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b68108060 0x7f9b6819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.910+0000 7f9b6ccfe640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b68101cd0 0x7f9b681980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b67fff640 1 -- 172.21.15.5:0/620294056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b68101cd0 msgr2=0x7f9b681980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:14.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b67fff640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b68101cd0 0x7f9b681980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b67fff640 1 -- 172.21.15.5:0/620294056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b68108060 msgr2=0x7f9b6819d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b67fff640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b68108060 0x7f9b6819d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b67fff640 1 -- 172.21.15.5:0/620294056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6819e1a0 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b67fff640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 0x7f9b68198630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400e9f0 tx=0x7f9b5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400cd80 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b6819e490 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b540108e0 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b54018980 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.911+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b681a4b50 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.912+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b681020b0 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.914+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f9b54010430 con 0x7f9b681076e0 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.914+0000 7f9b65ffb640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b580b52e0 0x7f9b580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:14.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.915+0000 7f9b6ccfe640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b580b52e0 0x7f9b580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.915+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f9b540e6000 con 0x7f9b681076e0 2024-09-10T22:14:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.915+0000 7f9b6ccfe640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b580b52e0 0x7f9b580b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005d00 tx=0x7f9b5c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:14.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:14.917+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9b540ad360 con 0x7f9b681076e0 2024-09-10T22:14:15.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:14 smithi005 ceph-mon[31115]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.102+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9b681a4ed0 con 0x7f9b681076e0 2024-09-10T22:14:15.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.103+0000 7f9b65ffb640 1 -- 172.21.15.5:0/620294056 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f9b540acc60 con 0x7f9b681076e0 2024-09-10T22:14:15.104 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-10T22:14:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b580b52e0 msgr2=0x7f9b580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b580b52e0 0x7f9b580b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005d00 tx=0x7f9b5c005c50 comp rx=0 tx=0).stop 2024-09-10T22:14:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 msgr2=0x7f9b68198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 0x7f9b68198630 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b5400e9f0 tx=0x7f9b5400eeb0 comp rx=0 tx=0).stop 2024-09-10T22:14:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 shutdown_connections 2024-09-10T22:14:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b580b52e0 0x7f9b580b77a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9b68108060 0x7f9b6819d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9b681076e0 0x7f9b68198630 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 --2- 172.21.15.5:0/620294056 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9b68101cd0 0x7f9b681980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 >> 172.21.15.5:0/620294056 conn(0x7f9b680fd700 msgr2=0x7f9b680fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 shutdown_connections 2024-09-10T22:14:15.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:15.105+0000 7f9b6ef62640 1 -- 172.21.15.5:0/620294056 wait complete. 2024-09-10T22:14:15.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:14 smithi052 ceph-mon[34997]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:15.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:14 smithi189 ceph-mon[35784]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.a on smithi005 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.d on smithi005 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.g on smithi005 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.j on smithi005 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.b on smithi052 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.e on smithi052 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.h on smithi052 2024-09-10T22:14:15.949 INFO:tasks.cephadm:Adding mds.k on smithi052 2024-09-10T22:14:15.950 INFO:tasks.cephadm:Adding mds.c on smithi189 2024-09-10T22:14:15.950 INFO:tasks.cephadm:Adding mds.f on smithi189 2024-09-10T22:14:15.950 INFO:tasks.cephadm:Adding mds.i on smithi189 2024-09-10T22:14:15.950 INFO:tasks.cephadm:Adding mds.l on smithi189 2024-09-10T22:14:15.950 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l' 2024-09-10T22:14:16.215 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:14:16.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:16 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/620294056' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:14:16.336 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:16 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/620294056' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:14:16.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:16 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/620294056' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 -- 172.21.15.189:0/2724559878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 msgr2=0x7f4e48105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 --2- 172.21.15.189:0/2724559878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48105710 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009900 tx=0x7f4e3002a410 comp rx=0 tx=0).stop 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 -- 172.21.15.189:0/2724559878 shutdown_connections 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 --2- 172.21.15.189:0/2724559878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e48108780 0x7f4e4810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 --2- 172.21.15.189:0/2724559878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e48105c50 0x7f4e48108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 --2- 172.21.15.189:0/2724559878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48105710 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 -- 172.21.15.189:0/2724559878 >> 172.21.15.189:0/2724559878 conn(0x7f4e480fd240 msgr2=0x7f4e480ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.689+0000 7f4e4e757640 1 -- 172.21.15.189:0/2724559878 shutdown_connections 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 -- 172.21.15.189:0/2724559878 wait complete. 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 Processor -- start 2024-09-10T22:14:16.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 -- start start 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e48105c50 0x7f4e48199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e48108780 0x7f4e4819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.690+0000 7f4e4e757640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810e6d0 con 0x7f4e48108780 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e4e757640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810e550 con 0x7f4e48105c50 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e4e757640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810e850 con 0x7f4e4806bfe0 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.189:49242/0 (socket says 172.21.15.189:49242) 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 -- 172.21.15.189:0/232417646 learned_addr learned my addr 172.21.15.189:0/232417646 (peer_addr_for_me v2:172.21.15.189:0/0) 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e477fe640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e48105c50 0x7f4e48199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e4ccf4640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e48108780 0x7f4e4819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 -- 172.21.15.189:0/232417646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e48105c50 msgr2=0x7f4e48199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:16.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e48105c50 0x7f4e48199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 -- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e48108780 msgr2=0x7f4e4819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e48108780 0x7f4e4819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 -- 172.21.15.189:0/232417646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4819a930 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e47fff640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48198e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e30005940 tx=0x7f4e30004430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3003f030 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4819abc0 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e30003cb0 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e481016c0 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.691+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30035070 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.693+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e280052c0 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.695+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f4e3003b460 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.696+0000 7f4e457fa640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e340b52e0 0x7f4e340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.696+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f4e301064f0 con 0x7f4e4806bfe0 2024-09-10T22:14:16.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.696+0000 7f4e477fe640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e340b52e0 0x7f4e340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:16.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.697+0000 7f4e477fe640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e340b52e0 0x7f4e340b77a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e380092a0 tx=0x7f4e3800f7a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:16.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.698+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mon.1 v2:172.21.15.189:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e30003e60 con 0x7f4e4806bfe0 2024-09-10T22:14:16.887 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.886+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}) -- 0x7f4e28000cf0 con 0x7f4e340b52e0 2024-09-10T22:14:16.895 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.894+0000 7f4e457fa640 1 -- 172.21.15.189:0/232417646 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f4e28000cf0 con 0x7f4e340b52e0 2024-09-10T22:14:16.896 INFO:teuthology.orchestra.run.smithi189.stdout:Scheduled mds.all update... 2024-09-10T22:14:16.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.896+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e340b52e0 msgr2=0x7f4e340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:16.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.896+0000 7f4e4e757640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e340b52e0 0x7f4e340b77a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e380092a0 tx=0x7f4e3800f7a0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.896+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 msgr2=0x7f4e48198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:16.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.896+0000 7f4e4e757640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48198e00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4e30005940 tx=0x7f4e30004430 comp rx=0 tx=0).stop 2024-09-10T22:14:16.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.896+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 shutdown_connections 2024-09-10T22:14:16.898 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e340b52e0 0x7f4e340b77a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e48108780 0x7f4e4819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e48105c50 0x7f4e48199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 --2- 172.21.15.189:0/232417646 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e4806bfe0 0x7f4e48198e00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:16.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 >> 172.21.15.189:0/232417646 conn(0x7f4e480fd240 msgr2=0x7f4e48103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:16.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 shutdown_connections 2024-09-10T22:14:16.899 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T22:14:16.897+0000 7f4e4e757640 1 -- 172.21.15.189:0/232417646 wait complete. 2024-09-10T22:14:17.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:17 smithi189 ceph-mon[35784]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:17.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:17.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:17 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:17.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:17 smithi005 ceph-mon[31115]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:17.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:17.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:17 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:17.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:17 smithi052 ceph-mon[34997]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:17.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:17.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:17 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:17.615 DEBUG:teuthology.orchestra.run.smithi005:mds.a> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.a.service 2024-09-10T22:14:17.618 DEBUG:teuthology.orchestra.run.smithi005:mds.d> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.d.service 2024-09-10T22:14:17.662 DEBUG:teuthology.orchestra.run.smithi005:mds.g> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.g.service 2024-09-10T22:14:17.705 DEBUG:teuthology.orchestra.run.smithi005:mds.j> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.j.service 2024-09-10T22:14:17.748 DEBUG:teuthology.orchestra.run.smithi052:mds.b> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.b.service 2024-09-10T22:14:17.751 DEBUG:teuthology.orchestra.run.smithi052:mds.e> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.e.service 2024-09-10T22:14:17.794 DEBUG:teuthology.orchestra.run.smithi052:mds.h> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.h.service 2024-09-10T22:14:17.837 DEBUG:teuthology.orchestra.run.smithi052:mds.k> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.k.service 2024-09-10T22:14:17.880 DEBUG:teuthology.orchestra.run.smithi189:mds.c> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.c.service 2024-09-10T22:14:17.883 DEBUG:teuthology.orchestra.run.smithi189:mds.f> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.f.service 2024-09-10T22:14:17.925 DEBUG:teuthology.orchestra.run.smithi189:mds.i> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.i.service 2024-09-10T22:14:17.968 DEBUG:teuthology.orchestra.run.smithi189:mds.l> sudo journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.l.service 2024-09-10T22:14:18.012 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-10T22:14:18.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:18.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:14:18.170 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:18.171 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:18 smithi189 ceph-mon[35784]: Deploying daemon mds.l on smithi189 2024-09-10T22:14:18.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:18.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:18 smithi052 ceph-mon[34997]: Deploying daemon mds.l on smithi189 2024-09-10T22:14:18.273 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:18.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: Saving service mds.all spec with placement smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:18.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:18 smithi005 ceph-mon[31115]: Deploying daemon mds.l on smithi189 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 -- 172.21.15.5:0/1031747173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410a920 msgr2=0x7fa31410cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 --2- 172.21.15.5:0/1031747173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410a920 0x7fa31410cd10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009900 tx=0x7fa2fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 -- 172.21.15.5:0/1031747173 shutdown_connections 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 --2- 172.21.15.5:0/1031747173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31410d250 0x7fa31410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 --2- 172.21.15.5:0/1031747173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410a920 0x7fa31410cd10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 --2- 172.21.15.5:0/1031747173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa314101810 0x7fa314101bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 -- 172.21.15.5:0/1031747173 >> 172.21.15.5:0/1031747173 conn(0x7fa314076f50 msgr2=0x7fa314077360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:18.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 -- 172.21.15.5:0/1031747173 shutdown_connections 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.741+0000 7fa318870640 1 -- 172.21.15.5:0/1031747173 wait complete. 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 Processor -- start 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 -- start start 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa314101810 0x7fa314199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31410a920 0x7fa3141997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 0x7fa31419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa314112d90 con 0x7fa31410d250 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa314112c10 con 0x7fa314101810 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa318870640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa314112f10 con 0x7fa31410a920 2024-09-10T22:14:18.762 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa312d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 0x7fa31419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa30bfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31410a920 0x7fa3141997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.742+0000 7fa312d9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 0x7fa31419eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35672/0 (socket says 172.21.15.5:35672) 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 -- 172.21.15.5:0/3269385941 learned_addr learned my addr 172.21.15.5:0/3269385941 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa31259c640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa314101810 0x7fa314199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 -- 172.21.15.5:0/3269385941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31410a920 msgr2=0x7fa3141997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31410a920 0x7fa3141997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 -- 172.21.15.5:0/3269385941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa314101810 msgr2=0x7fa314199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa314101810 0x7fa314199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.763 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 -- 172.21.15.5:0/3269385941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31419f330 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa312d9d640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 0x7fa31419eb60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00cad0 tx=0x7fa30c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00ae20 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31419f620 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa30c005020 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00f6b0 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.743+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3141a5ce0 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.744+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa314101bf0 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.746+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fa30c0054f0 con 0x7fa31410d250 2024-09-10T22:14:18.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.747+0000 7fa30b7fe640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa3000b52e0 0x7fa3000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:18.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.747+0000 7fa31259c640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa3000b52e0 0x7fa3000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:18.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.747+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fa30c0e5b70 con 0x7fa31410d250 2024-09-10T22:14:18.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.747+0000 7fa31259c640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa3000b52e0 0x7fa3000b77a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3040058c0 tx=0x7fa30400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:18.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.750+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa30c014030 con 0x7fa31410d250 2024-09-10T22:14:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.970+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3141a60d0 con 0x7fa31410d250 2024-09-10T22:14:18.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.970+0000 7fa30b7fe640 1 -- 172.21.15.5:0/3269385941 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fa30c0aceb0 con 0x7fa31410d250 2024-09-10T22:14:18.972 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:18.972 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":1,"btime":"2024-09-10T22:06:46:142211+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-10T22:14:18.972 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 1 2024-09-10T22:14:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa3000b52e0 msgr2=0x7fa3000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa3000b52e0 0x7fa3000b77a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3040058c0 tx=0x7fa30400a4c0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 msgr2=0x7fa31419eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:18.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 0x7fa31419eb60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa30c00cad0 tx=0x7fa30c00cf90 comp rx=0 tx=0).stop 2024-09-10T22:14:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 shutdown_connections 2024-09-10T22:14:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa3000b52e0 0x7fa3000b77a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa31410d250 0x7fa31419eb60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa31410a920 0x7fa3141997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 --2- 172.21.15.5:0/3269385941 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa314101810 0x7fa314199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 >> 172.21.15.5:0/3269385941 conn(0x7fa314076f50 msgr2=0x7fa3141005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 shutdown_connections 2024-09-10T22:14:18.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:18.972+0000 7fa318870640 1 -- 172.21.15.5:0/3269385941 wait complete. 2024-09-10T22:14:19.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:19 smithi189 ceph-mon[35784]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:19.442 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3269385941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:19.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:19 smithi005 ceph-mon[31115]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:19.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3269385941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:19.693 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:19 smithi189 systemd[1]: Starting Ceph mds.l for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:19.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:19 smithi052 ceph-mon[34997]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:19.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:19 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3269385941' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:20.098 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:19 smithi189 podman[64825]: 2024-09-10 22:14:19.74225986 +0000 UTC m=+0.016177693 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:20.098 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:19 smithi189 podman[64825]: 2024-09-10 22:14:19.85172563 +0000 UTC m=+0.125643453 container create 549d5691079dc20f81ab36d1007b98a5187e8cf4a2edbcf881bcc671d8eb65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:14:20.098 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:20 smithi189 podman[64825]: 2024-09-10 22:14:20.070810101 +0000 UTC m=+0.344727925 container init 549d5691079dc20f81ab36d1007b98a5187e8cf4a2edbcf881bcc671d8eb65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T22:14:20.098 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:20 smithi189 podman[64825]: 2024-09-10 22:14:20.073701099 +0000 UTC m=+0.347618923 container start 549d5691079dc20f81ab36d1007b98a5187e8cf4a2edbcf881bcc671d8eb65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-10T22:14:20.443 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:20 smithi189 ceph-mds[64844]: -- 172.21.15.189:0/3977305746 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a17dd1860 con 0x561a17daf000 2024-09-10T22:14:20.443 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l[64840]: starting mds.l at 2024-09-10T22:14:20.443 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:20 smithi189 bash[64825]: 549d5691079dc20f81ab36d1007b98a5187e8cf4a2edbcf881bcc671d8eb65ef 2024-09-10T22:14:20.443 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:14:20 smithi189 systemd[1]: Started Ceph mds.l for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6832/1255852386,v1:172.21.15.189:6833/1255852386] up:boot 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: fsmap 1 up:standby 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:21.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:21 smithi052 ceph-mon[34997]: Deploying daemon mds.k on smithi052 2024-09-10T22:14:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6832/1255852386,v1:172.21.15.189:6833/1255852386] up:boot 2024-09-10T22:14:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: fsmap 1 up:standby 2024-09-10T22:14:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:21.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:21 smithi189 ceph-mon[35784]: Deploying daemon mds.k on smithi052 2024-09-10T22:14:21.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:21.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6832/1255852386,v1:172.21.15.189:6833/1255852386] up:boot 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: fsmap 1 up:standby 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:21.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:21 smithi005 ceph-mon[31115]: Deploying daemon mds.k on smithi052 2024-09-10T22:14:21.744 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:22.010 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:22.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 -- 172.21.15.5:0/1947535703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c103ce0 msgr2=0x7ffb7c1040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 --2- 172.21.15.5:0/1947535703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c103ce0 0x7ffb7c1040c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009900 tx=0x7ffb6c02a410 comp rx=0 tx=0).stop 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 -- 172.21.15.5:0/1947535703 shutdown_connections 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 --2- 172.21.15.5:0/1947535703 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c10d140 0x7ffb7c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 --2- 172.21.15.5:0/1947535703 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb7c104600 0x7ffb7c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 --2- 172.21.15.5:0/1947535703 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c103ce0 0x7ffb7c1040c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 -- 172.21.15.5:0/1947535703 >> 172.21.15.5:0/1947535703 conn(0x7ffb7c0fd700 msgr2=0x7ffb7c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 -- 172.21.15.5:0/1947535703 shutdown_connections 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.475+0000 7ffb82216640 1 -- 172.21.15.5:0/1947535703 wait complete. 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 Processor -- start 2024-09-10T22:14:22.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 -- start start 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb7c103ce0 0x7ffb7c101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c104600 0x7ffb7c101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 0x7ffb7c102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c112e10 con 0x7ffb7c10d140 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c112c90 con 0x7ffb7c104600 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.476+0000 7ffb82216640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffb7c112f90 con 0x7ffb7c103ce0 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 0x7ffb7c102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 0x7ffb7c102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45998/0 (socket says 172.21.15.5:45998) 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 -- 172.21.15.5:0/1708521506 learned_addr learned my addr 172.21.15.5:0/1708521506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7affd640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c104600 0x7ffb7c101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7b7fe640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb7c103ce0 0x7ffb7c101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:22.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 -- 172.21.15.5:0/1708521506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb7c103ce0 msgr2=0x7ffb7c101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb7c103ce0 0x7ffb7c101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 -- 172.21.15.5:0/1708521506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c104600 msgr2=0x7ffb7c101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c104600 0x7ffb7c101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 -- 172.21.15.5:0/1708521506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb7c1a7780 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb7bfff640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 0x7ffb7c102410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400eaa0 tx=0x7ffb7400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7400cdb0 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb7c1a7a70 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb74005020 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb740116d0 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.477+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb7c1a8030 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.478+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb7c1040c0 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.480+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7ffb7400f040 con 0x7ffb7c10d140 2024-09-10T22:14:22.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.481+0000 7ffb78ff9640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffb640b52e0 0x7ffb640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.481+0000 7ffb7b7fe640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffb640b52e0 0x7ffb640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.481+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7ffb740e5a30 con 0x7ffb7c10d140 2024-09-10T22:14:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.481+0000 7ffb7b7fe640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffb640b52e0 0x7ffb640b77a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c031440 tx=0x7ffb6c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:22.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.484+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffb74016030 con 0x7ffb7c10d140 2024-09-10T22:14:22.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.705+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb7c02e5c0 con 0x7ffb7c10d140 2024-09-10T22:14:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.705+0000 7ffb78ff9640 1 -- 172.21.15.5:0/1708521506 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7ffb740accf0 con 0x7ffb7c10d140 2024-09-10T22:14:22.707 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:22.707 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"btime":"2024-09-10T22:14:20:102116+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T22:14:22.707 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 2 2024-09-10T22:14:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffb640b52e0 msgr2=0x7ffb640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffb640b52e0 0x7ffb640b77a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c031440 tx=0x7ffb6c0095f0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 msgr2=0x7ffb7c102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 0x7ffb7c102410 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400eaa0 tx=0x7ffb7400ef60 comp rx=0 tx=0).stop 2024-09-10T22:14:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 shutdown_connections 2024-09-10T22:14:22.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffb640b52e0 0x7ffb640b77a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffb7c10d140 0x7ffb7c102410 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffb7c104600 0x7ffb7c101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 --2- 172.21.15.5:0/1708521506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffb7c103ce0 0x7ffb7c101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 >> 172.21.15.5:0/1708521506 conn(0x7ffb7c0fd700 msgr2=0x7ffb7c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 shutdown_connections 2024-09-10T22:14:22.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:22.708+0000 7ffb82216640 1 -- 172.21.15.5:0/1708521506 wait complete. 2024-09-10T22:14:22.750 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:22 smithi052 podman[64212]: 2024-09-10 22:14:22.521924671 +0000 UTC m=+0.015907679 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:23.046 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:22 smithi052 podman[64212]: 2024-09-10 22:14:22.773828845 +0000 UTC m=+0.267811843 container create ee82bd925b2fd81ac8fd985d93730b8d71dd1e7ff2e49b78143691efbe5c1106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T22:14:23.046 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:23 smithi052 podman[64212]: 2024-09-10 22:14:23.018245363 +0000 UTC m=+0.512228361 container init ee82bd925b2fd81ac8fd985d93730b8d71dd1e7ff2e49b78143691efbe5c1106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-10T22:14:23.046 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:23 smithi052 podman[64212]: 2024-09-10 22:14:23.021082691 +0000 UTC m=+0.515065691 container start ee82bd925b2fd81ac8fd985d93730b8d71dd1e7ff2e49b78143691efbe5c1106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:14:23.323 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:23 smithi052 ceph-mon[34997]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:23.323 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:23 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1708521506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:23.323 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:23 smithi052 ceph-mds[64231]: -- 172.21.15.52:0/817127187 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55826adab860 con 0x55826ad89000 2024-09-10T22:14:23.323 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k[64227]: starting mds.k at 2024-09-10T22:14:23.323 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:23 smithi052 bash[64212]: ee82bd925b2fd81ac8fd985d93730b8d71dd1e7ff2e49b78143691efbe5c1106 2024-09-10T22:14:23.323 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:14:23 smithi052 systemd[1]: Started Ceph mds.k for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:23.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:23 smithi189 ceph-mon[35784]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:23.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:23 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1708521506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:23.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:23 smithi005 ceph-mon[31115]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:23.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:23 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1708521506' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6832/3402874625,v1:172.21.15.52:6833/3402874625] up:boot 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: fsmap 2 up:standby 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.331 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:24.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:24.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:24.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:24 smithi005 ceph-mon[31115]: Deploying daemon mds.j on smithi005 2024-09-10T22:14:24.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6832/3402874625,v1:172.21.15.52:6833/3402874625] up:boot 2024-09-10T22:14:24.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: fsmap 2 up:standby 2024-09-10T22:14:24.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:24.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:24 smithi189 ceph-mon[35784]: Deploying daemon mds.j on smithi005 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6832/3402874625,v1:172.21.15.52:6833/3402874625] up:boot 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: fsmap 2 up:standby 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:24.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:24 smithi052 ceph-mon[34997]: Deploying daemon mds.j on smithi005 2024-09-10T22:14:25.391 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:25 smithi005 ceph-mon[31115]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:25.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:25 smithi189 ceph-mon[35784]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:25.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:25 smithi052 ceph-mon[34997]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:25.635 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:25.662 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:25 smithi005 systemd[1]: Starting Ceph mds.j for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:25.944 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:25 smithi005 podman[72830]: 2024-09-10 22:14:25.699318461 +0000 UTC m=+0.019788885 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:25.945 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:25 smithi005 podman[72830]: 2024-09-10 22:14:25.821492185 +0000 UTC m=+0.141962593 container create 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T22:14:26.257 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:26.332 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:26 smithi005 podman[72830]: 2024-09-10 22:14:26.066358883 +0000 UTC m=+0.386829294 container init 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:14:26.332 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:26 smithi005 podman[72830]: 2024-09-10 22:14:26.069741003 +0000 UTC m=+0.390211414 container start 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-10T22:14:26.332 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:26 smithi005 ceph-mds[72872]: -- 172.21.15.5:0/3121843407 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4a3631860 con 0x55e4a360f000 2024-09-10T22:14:26.332 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:26 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j[72856]: starting mds.j at 2024-09-10T22:14:26.332 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:26 smithi005 bash[72830]: 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c 2024-09-10T22:14:26.332 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:14:26 smithi005 systemd[1]: Started Ceph mds.j for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 -- 172.21.15.5:0/3500833889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c102d90 msgr2=0x7f040c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 --2- 172.21.15.5:0/3500833889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c102d90 0x7f040c103170 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f03fc009900 tx=0x7f03fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 -- 172.21.15.5:0/3500833889 shutdown_connections 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 --2- 172.21.15.5:0/3500833889 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f040c109120 0x7f040c10f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 --2- 172.21.15.5:0/3500833889 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040c1087a0 0x7f040c108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 --2- 172.21.15.5:0/3500833889 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c102d90 0x7f040c103170 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 -- 172.21.15.5:0/3500833889 >> 172.21.15.5:0/3500833889 conn(0x7f040c0fe820 msgr2=0x7f040c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:26.780 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 -- 172.21.15.5:0/3500833889 shutdown_connections 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.752+0000 7f0412ba9640 1 -- 172.21.15.5:0/3500833889 wait complete. 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 Processor -- start 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 -- start start 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040c102d90 0x7f040c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 0x7f040c199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f040c109120 0x7f040c19eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f040c112de0 con 0x7f040c1087a0 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f040c112c60 con 0x7f040c109120 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0412ba9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f040c112f60 con 0x7f040c102d90 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f040bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 0x7f040c199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f040bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 0x7f040c199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46042/0 (socket says 172.21.15.5:46042) 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f040bfff640 1 -- 172.21.15.5:0/2872211381 learned_addr learned my addr 172.21.15.5:0/2872211381 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0411146640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f040c109120 0x7f040c19eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:26.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.753+0000 7f0410945640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040c102d90 0x7f040c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f040bfff640 1 -- 172.21.15.5:0/2872211381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040c102d90 msgr2=0x7f040c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f040bfff640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040c102d90 0x7f040c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f040bfff640 1 -- 172.21.15.5:0/2872211381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f040c109120 msgr2=0x7f040c19eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f040bfff640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f040c109120 0x7f040c19eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f040bfff640 1 -- 172.21.15.5:0/2872211381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c19f300 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f040bfff640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 0x7f040c199790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f03f400d950 tx=0x7f03f400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4017070 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c19f5f0 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f4009c30 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f400f620 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.754+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c1a5e80 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.755+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c103170 con 0x7f040c1087a0 2024-09-10T22:14:26.782 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.756+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f03f4010460 con 0x7f040c1087a0 2024-09-10T22:14:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.758+0000 7f0409ffb640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03f80b52e0 0x7f03f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.758+0000 7f0410945640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03f80b52e0 0x7f03f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.758+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f03f40e5520 con 0x7f040c1087a0 2024-09-10T22:14:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.758+0000 7f0410945640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03f80b52e0 0x7f03f80b77a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03fc031440 tx=0x7f03fc0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:26.783 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.762+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f03f40ac7e0 con 0x7f040c1087a0 2024-09-10T22:14:26.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.995+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f040c10af00 con 0x7f040c1087a0 2024-09-10T22:14:26.998 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.996+0000 7f0409ffb640 1 -- 172.21.15.5:0/2872211381 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f03f4009de0 con 0x7f040c1087a0 2024-09-10T22:14:26.999 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:26.999 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":4,"btime":"2024-09-10T22:14:26:191545+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T22:14:26.999 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 4 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03f80b52e0 msgr2=0x7f03f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03f80b52e0 0x7f03f80b77a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f03fc031440 tx=0x7f03fc0095f0 comp rx=0 tx=0).stop 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 msgr2=0x7f040c199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 0x7f040c199790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f03f400d950 tx=0x7f03f400de10 comp rx=0 tx=0).stop 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 shutdown_connections 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03f80b52e0 0x7f03f80b77a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f040c109120 0x7f040c19eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f040c1087a0 0x7f040c199790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 --2- 172.21.15.5:0/2872211381 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f040c102d90 0x7f040c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:27.001 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.998+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 >> 172.21.15.5:0/2872211381 conn(0x7f040c0fe820 msgr2=0x7f040c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.999+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 shutdown_connections 2024-09-10T22:14:27.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:26.999+0000 7f0412ba9640 1 -- 172.21.15.5:0/2872211381 wait complete. 2024-09-10T22:14:27.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:27.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.5:6834/1828396706,v1:172.21.15.5:6835/1828396706] up:boot 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: fsmap 3 up:standby 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:27.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: Deploying daemon mds.d on smithi005 2024-09-10T22:14:27.334 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:27 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2872211381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:27.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.5:6834/1828396706,v1:172.21.15.5:6835/1828396706] up:boot 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: fsmap 3 up:standby 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: Deploying daemon mds.d on smithi005 2024-09-10T22:14:27.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:27 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2872211381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.5:6834/1828396706,v1:172.21.15.5:6835/1828396706] up:boot 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: fsmap 3 up:standby 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: Deploying daemon mds.d on smithi005 2024-09-10T22:14:27.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:27 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2872211381' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:29.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:29 smithi005 ceph-mon[31115]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:29.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:29 smithi052 ceph-mon[34997]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:29 smithi189 ceph-mon[35784]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:30.082 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:14:29 smithi005 systemd[1]: Started Ceph mds.d for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:30.262 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:30.524 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: Deploying daemon mds.e on smithi052 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.5:6836/2877300563,v1:172.21.15.5:6837/2877300563] up:boot 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: fsmap 4 up:standby 2024-09-10T22:14:31.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:30 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T22:14:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:31.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: Deploying daemon mds.e on smithi052 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.5:6836/2877300563,v1:172.21.15.5:6837/2877300563] up:boot 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: fsmap 4 up:standby 2024-09-10T22:14:31.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:30 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T22:14:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: Deploying daemon mds.e on smithi052 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.5:6836/2877300563,v1:172.21.15.5:6837/2877300563] up:boot 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: fsmap 4 up:standby 2024-09-10T22:14:31.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:30 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-10T22:14:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 -- 172.21.15.5:0/1473180293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314102190 msgr2=0x7f031410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 --2- 172.21.15.5:0/1473180293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314102190 0x7f031410eee0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0300009900 tx=0x7f030002a480 comp rx=0 tx=0).stop 2024-09-10T22:14:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 -- 172.21.15.5:0/1473180293 shutdown_connections 2024-09-10T22:14:31.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 --2- 172.21.15.5:0/1473180293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f031410f420 0x7f0314111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 --2- 172.21.15.5:0/1473180293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314102190 0x7f031410eee0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 --2- 172.21.15.5:0/1473180293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0314101870 0x7f0314101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 -- 172.21.15.5:0/1473180293 >> 172.21.15.5:0/1473180293 conn(0x7f03140fd720 msgr2=0x7f03140ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 -- 172.21.15.5:0/1473180293 shutdown_connections 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.173+0000 7f031ad28640 1 -- 172.21.15.5:0/1473180293 wait complete. 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 Processor -- start 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 -- start start 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 0x7f031419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0314102190 0x7f031419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031410f420 0x7f03141a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0314114fe0 con 0x7f0314101870 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0314114e60 con 0x7f031410f420 2024-09-10T22:14:31.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f031ad28640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0314115160 con 0x7f0314102190 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f0318ac4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 0x7f031419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f0318ac4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 0x7f031419b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46070/0 (socket says 172.21.15.5:46070) 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.174+0000 7f0318ac4640 1 -- 172.21.15.5:0/2257478638 learned_addr learned my addr 172.21.15.5:0/2257478638 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f03192c5640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031410f420 0x7f03141a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0318ac4640 1 -- 172.21.15.5:0/2257478638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0314102190 msgr2=0x7f031419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0318ac4640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0314102190 0x7f031419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0318ac4640 1 -- 172.21.15.5:0/2257478638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031410f420 msgr2=0x7f03141a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0318ac4640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031410f420 0x7f03141a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0318ac4640 1 -- 172.21.15.5:0/2257478638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03141a1510 con 0x7f0314101870 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f03192c5640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031410f420 0x7f03141a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0318ac4640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 0x7f031419b460 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f030800c920 tx=0x7f030800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:31.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308007c70 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0308007e10 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03141a1800 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0308018820 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.175+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03141a8090 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.176+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0314101c50 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.178+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f030800f450 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.178+0000 7f0311ffb640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03040b5360 0x7f03040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.178+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f03080e58a0 con 0x7f0314101870 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.178+0000 7f0313fff640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03040b5360 0x7f03040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.179+0000 7f0313fff640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03040b5360 0x7f03040b7820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03000096c0 tx=0x7f0300031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:31.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.182+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0308014030 con 0x7f0314101870 2024-09-10T22:14:31.410 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.408+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f031419c590 con 0x7f0314101870 2024-09-10T22:14:31.411 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.408+0000 7f0311ffb640 1 -- 172.21.15.5:0/2257478638 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f03080acc00 con 0x7f0314101870 2024-09-10T22:14:31.411 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:31.411 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":5,"btime":"2024-09-10T22:14:30:200997+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T22:14:31.412 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 5 2024-09-10T22:14:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03040b5360 msgr2=0x7f03040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03040b5360 0x7f03040b7820 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f03000096c0 tx=0x7f0300031400 comp rx=0 tx=0).stop 2024-09-10T22:14:31.413 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 msgr2=0x7f031419b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 0x7f031419b460 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f030800c920 tx=0x7f030800cde0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 shutdown_connections 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03040b5360 0x7f03040b7820 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f031410f420 0x7f03141a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0314102190 0x7f031419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 --2- 172.21.15.5:0/2257478638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0314101870 0x7f031419b460 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:31.414 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 >> 172.21.15.5:0/2257478638 conn(0x7f03140fd720 msgr2=0x7f0314111620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 shutdown_connections 2024-09-10T22:14:31.415 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:31.411+0000 7f031ad28640 1 -- 172.21.15.5:0/2257478638 wait complete. 2024-09-10T22:14:31.991 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:31 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2257478638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:31.992 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:31 smithi052 systemd[1]: Starting Ceph mds.e for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:32.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:31 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2257478638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:32.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:31 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2257478638' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:32.249 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 podman[64524]: 2024-09-10 22:14:32.103050001 +0000 UTC m=+0.015684678 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:32.591 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 podman[64524]: 2024-09-10 22:14:32.329227785 +0000 UTC m=+0.241862464 container create 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:14:32.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 podman[64524]: 2024-09-10 22:14:32.590706533 +0000 UTC m=+0.503341206 container init 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:14:33.000 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 podman[64524]: 2024-09-10 22:14:32.593510684 +0000 UTC m=+0.506145359 container start 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-10T22:14:33.001 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-mds[64543]: -- 172.21.15.52:0/787602204 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556850d41860 con 0x556850d1f400 2024-09-10T22:14:33.001 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e[64539]: starting mds.e at 2024-09-10T22:14:33.001 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 bash[64524]: 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b 2024-09-10T22:14:33.001 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:14:32 smithi052 systemd[1]: Started Ceph mds.e for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:33.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:33.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:33.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:33.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:32 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:33.175 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:32 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:34.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:34.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:33 smithi005 ceph-mon[31115]: Deploying daemon mds.f on smithi189 2024-09-10T22:14:34.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:33 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6834/4020193542,v1:172.21.15.52:6835/4020193542] up:boot 2024-09-10T22:14:34.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:33 smithi005 ceph-mon[31115]: fsmap 5 up:standby 2024-09-10T22:14:34.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:33 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:14:34.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:33 smithi189 ceph-mon[35784]: Deploying daemon mds.f on smithi189 2024-09-10T22:14:34.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:33 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6834/4020193542,v1:172.21.15.52:6835/4020193542] up:boot 2024-09-10T22:14:34.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:33 smithi189 ceph-mon[35784]: fsmap 5 up:standby 2024-09-10T22:14:34.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:33 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:14:34.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:33 smithi052 ceph-mon[34997]: Deploying daemon mds.f on smithi189 2024-09-10T22:14:34.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:33 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6834/4020193542,v1:172.21.15.52:6835/4020193542] up:boot 2024-09-10T22:14:34.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:33 smithi052 ceph-mon[34997]: fsmap 5 up:standby 2024-09-10T22:14:34.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:33 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:14:34.348 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:34.829 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:34 smithi189 systemd[1]: Starting Ceph mds.f for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.832+0000 7f2551e6d640 1 -- 172.21.15.5:0/469578448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c104590 msgr2=0x7f254c10cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.832+0000 7f2551e6d640 1 --2- 172.21.15.5:0/469578448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c104590 0x7f254c10cb70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2540009900 tx=0x7f254002a410 comp rx=0 tx=0).stop 2024-09-10T22:14:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 -- 172.21.15.5:0/469578448 shutdown_connections 2024-09-10T22:14:34.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 --2- 172.21.15.5:0/469578448 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c10d140 0x7f254c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 --2- 172.21.15.5:0/469578448 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c104590 0x7f254c10cb70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 --2- 172.21.15.5:0/469578448 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f254c103b90 0x7f254c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 -- 172.21.15.5:0/469578448 >> 172.21.15.5:0/469578448 conn(0x7f254c0fd700 msgr2=0x7f254c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 -- 172.21.15.5:0/469578448 shutdown_connections 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 -- 172.21.15.5:0/469578448 wait complete. 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 Processor -- start 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.833+0000 7f2551e6d640 1 -- start start 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c103b90 0x7f254c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f254c104590 0x7f254c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 0x7f254c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f254c112d60 con 0x7f254c10d140 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f254c112be0 con 0x7f254c103b90 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f254c112ee0 con 0x7f254c104590 2024-09-10T22:14:34.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 0x7f254c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 0x7f254c19ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45442/0 (socket says 172.21.15.5:45442) 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 -- 172.21.15.5:0/3739366750 learned_addr learned my addr 172.21.15.5:0/3739366750 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254b7fe640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c103b90 0x7f254c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254affd640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f254c104590 0x7f254c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 -- 172.21.15.5:0/3739366750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f254c104590 msgr2=0x7f254c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f254c104590 0x7f254c199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 -- 172.21.15.5:0/3739366750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c103b90 msgr2=0x7f254c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c103b90 0x7f254c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 -- 172.21.15.5:0/3739366750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254c19f3e0 con 0x7f254c10d140 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254b7fe640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c103b90 0x7f254c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f254bfff640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 0x7f254c19ec10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f254400eb40 tx=0x7f254400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544004b20 con 0x7f254c10d140 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544004cc0 con 0x7f254c10d140 2024-09-10T22:14:34.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f254c19f6d0 con 0x7f254c10d140 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544010720 con 0x7f254c10d140 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.834+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f254c1a5d90 con 0x7f254c10d140 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.835+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f254c103f70 con 0x7f254c10d140 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.837+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f2544005560 con 0x7f254c10d140 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.838+0000 7f2548ff9640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25340b52e0 0x7f25340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.838+0000 7f254b7fe640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25340b52e0 0x7f25340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.838+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f25440e5f80 con 0x7f254c10d140 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.838+0000 7f254b7fe640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25340b52e0 0x7f25340b77a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f253c009fc0 tx=0x7f253c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:34.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:34.841+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f25440ad240 con 0x7f254c10d140 2024-09-10T22:14:34.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:34 smithi052 ceph-mon[34997]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:35.068 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.066+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f254c19a460 con 0x7f254c10d140 2024-09-10T22:14:35.069 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:34 smithi005 ceph-mon[31115]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:35.069 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.066+0000 7f2548ff9640 1 -- 172.21.15.5:0/3739366750 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7f254c19a460 con 0x7f254c10d140 2024-09-10T22:14:35.069 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:35.069 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"btime":"2024-09-10T22:14:32:816229+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-10T22:14:35.070 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 6 2024-09-10T22:14:35.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25340b52e0 msgr2=0x7f25340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25340b52e0 0x7f25340b77a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f253c009fc0 tx=0x7f253c005f90 comp rx=0 tx=0).stop 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 msgr2=0x7f254c19ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 0x7f254c19ec10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f254400eb40 tx=0x7f254400c2d0 comp rx=0 tx=0).stop 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 shutdown_connections 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f25340b52e0 0x7f25340b77a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f254c10d140 0x7f254c19ec10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f254c104590 0x7f254c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 --2- 172.21.15.5:0/3739366750 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f254c103b90 0x7f254c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 >> 172.21.15.5:0/3739366750 conn(0x7f254c0fd700 msgr2=0x7f254c0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 shutdown_connections 2024-09-10T22:14:35.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:35.069+0000 7f2551e6d640 1 -- 172.21.15.5:0/3739366750 wait complete. 2024-09-10T22:14:35.080 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:34 smithi189 ceph-mon[35784]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:35.080 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:34 smithi189 podman[65128]: 2024-09-10 22:14:34.809327981 +0000 UTC m=+0.015769912 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:35.080 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:34 smithi189 podman[65128]: 2024-09-10 22:14:34.929697166 +0000 UTC m=+0.136139078 container create 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:14:35.443 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:35 smithi189 podman[65128]: 2024-09-10 22:14:35.157057394 +0000 UTC m=+0.363499314 container init 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T22:14:35.443 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:35 smithi189 podman[65128]: 2024-09-10 22:14:35.159905417 +0000 UTC m=+0.366347335 container start 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:14:35.444 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mds[65148]: -- 172.21.15.189:0/2541366442 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557997a8fc20 con 0x557997a6d000 2024-09-10T22:14:35.444 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f[65144]: starting mds.f at 2024-09-10T22:14:35.444 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:35 smithi189 bash[65128]: 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 2024-09-10T22:14:35.444 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:14:35 smithi189 systemd[1]: Started Ceph mds.f for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:35.977 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3739366750' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:35.978 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:35 smithi189 ceph-mon[35784]: Deploying daemon mds.c on smithi189 2024-09-10T22:14:36.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3739366750' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:36.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:36.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:36.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:36.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:36.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:36.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:36.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:35 smithi005 ceph-mon[31115]: Deploying daemon mds.c on smithi189 2024-09-10T22:14:36.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3739366750' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:36.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:36.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:36.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:36.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:36.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:36.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:36.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:35 smithi052 ceph-mon[34997]: Deploying daemon mds.c on smithi189 2024-09-10T22:14:37.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:36 smithi189 ceph-mon[35784]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:37.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:36 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6834/1432375899,v1:172.21.15.189:6835/1432375899] up:boot 2024-09-10T22:14:37.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:36 smithi189 ceph-mon[35784]: fsmap 6 up:standby 2024-09-10T22:14:37.036 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:36 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:14:37.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:36 smithi052 ceph-mon[34997]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:37.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:36 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6834/1432375899,v1:172.21.15.189:6835/1432375899] up:boot 2024-09-10T22:14:37.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:36 smithi052 ceph-mon[34997]: fsmap 6 up:standby 2024-09-10T22:14:37.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:36 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:14:37.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:36 smithi005 ceph-mon[31115]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:37.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:36 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6834/1432375899,v1:172.21.15.189:6835/1432375899] up:boot 2024-09-10T22:14:37.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:36 smithi005 ceph-mon[31115]: fsmap 6 up:standby 2024-09-10T22:14:37.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:36 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:14:37.435 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 systemd[1]: Starting Ceph mds.c for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:37.436 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 podman[65431]: 2024-09-10 22:14:37.336840064 +0000 UTC m=+0.015839694 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:37.693 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 podman[65431]: 2024-09-10 22:14:37.440230688 +0000 UTC m=+0.119230340 container create 6d4195475644a5efc2d09caa5f761ca7254ea5bbdbee72c09df21ad2c1065a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T22:14:37.693 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 podman[65431]: 2024-09-10 22:14:37.676082946 +0000 UTC m=+0.355082562 container init 6d4195475644a5efc2d09caa5f761ca7254ea5bbdbee72c09df21ad2c1065a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:14:37.694 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 podman[65431]: 2024-09-10 22:14:37.678914874 +0000 UTC m=+0.357914494 container start 6d4195475644a5efc2d09caa5f761ca7254ea5bbdbee72c09df21ad2c1065a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:14:37.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:38.046 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:38.193 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 ceph-mds[65450]: -- 172.21.15.189:0/1157994437 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56007069d860 con 0x56007067b000 2024-09-10T22:14:38.193 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c[65446]: starting mds.c at 2024-09-10T22:14:38.193 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 bash[65431]: 6d4195475644a5efc2d09caa5f761ca7254ea5bbdbee72c09df21ad2c1065a9c 2024-09-10T22:14:38.193 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:14:37 smithi189 systemd[1]: Started Ceph mds.c for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 -- 172.21.15.5:0/230446918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c103ca0 msgr2=0x7f0d5c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 --2- 172.21.15.5:0/230446918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c103ca0 0x7f0d5c104080 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009ca0 tx=0x7f0d4c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 -- 172.21.15.5:0/230446918 shutdown_connections 2024-09-10T22:14:38.527 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 --2- 172.21.15.5:0/230446918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d5c10d100 0x7f0d5c10f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 --2- 172.21.15.5:0/230446918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d5c1045c0 0x7f0d5c10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 --2- 172.21.15.5:0/230446918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c103ca0 0x7f0d5c104080 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 -- 172.21.15.5:0/230446918 >> 172.21.15.5:0/230446918 conn(0x7f0d5c0fd700 msgr2=0x7f0d5c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 -- 172.21.15.5:0/230446918 shutdown_connections 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 -- 172.21.15.5:0/230446918 wait complete. 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.508+0000 7f0d612b9640 1 Processor -- start 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 -- start start 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d5c103ca0 0x7f0d5c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d5c1045c0 0x7f0d5c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 0x7f0d5c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:38.528 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c112d70 con 0x7f0d5c10d100 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c112bf0 con 0x7f0d5c1045c0 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d612b9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c112ef0 con 0x7f0d5c103ca0 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 0x7f0d5c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 0x7f0d5c19eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:45462/0 (socket says 172.21.15.5:45462) 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 -- 172.21.15.5:0/4083167886 learned_addr learned my addr 172.21.15.5:0/4083167886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5affd640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d5c103ca0 0x7f0d5c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5a7fc640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d5c1045c0 0x7f0d5c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 -- 172.21.15.5:0/4083167886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d5c103ca0 msgr2=0x7f0d5c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d5c103ca0 0x7f0d5c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.529 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 -- 172.21.15.5:0/4083167886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d5c1045c0 msgr2=0x7f0d5c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d5c1045c0 0x7f0d5c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 -- 172.21.15.5:0/4083167886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c19f310 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.509+0000 7f0d5b7fe640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 0x7f0d5c19eb40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400e970 tx=0x7f0d5400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.510+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400ccc0 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.510+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d5400ce60 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.510+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c19f600 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.510+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d54010430 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.510+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c1a5cc0 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.511+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c104080 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.512+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f0d54004f70 con 0x7f0d5c10d100 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.513+0000 7f0d43fff640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0d440b52e0 0x7f0d440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.513+0000 7f0d5affd640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0d440b52e0 0x7f0d440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:38.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.513+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f0d540e5d90 con 0x7f0d5c10d100 2024-09-10T22:14:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.513+0000 7f0d5affd640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0d440b52e0 0x7f0d440b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009430 tx=0x7f0d4c009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:38.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.516+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0d54056220 con 0x7f0d5c10d100 2024-09-10T22:14:38.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.755+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5c1a60e0 con 0x7f0d5c10d100 2024-09-10T22:14:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.756+0000 7f0d43fff640 1 -- 172.21.15.5:0/4083167886 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6388 (secure 0 0 0) 0x7f0d540ad050 con 0x7f0d5c10d100 2024-09-10T22:14:38.758 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:38.758 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":8,"btime":"2024-09-10T22:14:37:835344+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-10T22:14:38.758 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 8 2024-09-10T22:14:38.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0d440b52e0 msgr2=0x7f0d440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:38.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0d440b52e0 0x7f0d440b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009430 tx=0x7f0d4c009360 comp rx=0 tx=0).stop 2024-09-10T22:14:38.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 msgr2=0x7f0d5c19eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:38.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 0x7f0d5c19eb40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400e970 tx=0x7f0d5400ed70 comp rx=0 tx=0).stop 2024-09-10T22:14:38.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 shutdown_connections 2024-09-10T22:14:38.760 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0d440b52e0 0x7f0d440b77a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0d5c10d100 0x7f0d5c19eb40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0d5c1045c0 0x7f0d5c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 --2- 172.21.15.5:0/4083167886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0d5c103ca0 0x7f0d5c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.758+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 >> 172.21.15.5:0/4083167886 conn(0x7f0d5c0fd700 msgr2=0x7f0d5c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.759+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 shutdown_connections 2024-09-10T22:14:38.761 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:38.759+0000 7f0d612b9640 1 -- 172.21.15.5:0/4083167886 wait complete. 2024-09-10T22:14:38.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: Deploying daemon mds.h on smithi052 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6836/2390982285,v1:172.21.15.189:6837/2390982285] up:boot 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: fsmap 7 up:standby 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:14:39.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/4083167886' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:39.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: Deploying daemon mds.h on smithi052 2024-09-10T22:14:39.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6836/2390982285,v1:172.21.15.189:6837/2390982285] up:boot 2024-09-10T22:14:39.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: fsmap 7 up:standby 2024-09-10T22:14:39.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:14:39.084 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4083167886' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: Deploying daemon mds.h on smithi052 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6836/2390982285,v1:172.21.15.189:6837/2390982285] up:boot 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: fsmap 7 up:standby 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:14:39.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/4083167886' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:40.821 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:14:40 smithi052 systemd[1]: Started Ceph mds.h for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:40 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:41.123 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:40 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:41.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:41.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:40 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:41.466 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:41.737 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:42.108 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:41 smithi189 ceph-mon[35784]: Deploying daemon mds.i on smithi189 2024-09-10T22:14:42.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:41 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] up:boot 2024-09-10T22:14:42.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:41 smithi189 ceph-mon[35784]: fsmap 8 up:standby 2024-09-10T22:14:42.109 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:41 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:14:42.228 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:41 smithi005 ceph-mon[31115]: Deploying daemon mds.i on smithi189 2024-09-10T22:14:42.228 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:41 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] up:boot 2024-09-10T22:14:42.228 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:41 smithi005 ceph-mon[31115]: fsmap 8 up:standby 2024-09-10T22:14:42.228 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:41 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:14:42.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:41 smithi052 ceph-mon[34997]: Deploying daemon mds.i on smithi189 2024-09-10T22:14:42.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:41 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] up:boot 2024-09-10T22:14:42.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:41 smithi052 ceph-mon[34997]: fsmap 8 up:standby 2024-09-10T22:14:42.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:41 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:14:42.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 -- 172.21.15.5:0/3364750400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424108040 msgr2=0x7f242410e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:42.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 --2- 172.21.15.5:0/3364750400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424108040 0x7f242410e840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f241c009ca0 tx=0x7f241c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 -- 172.21.15.5:0/3364750400 shutdown_connections 2024-09-10T22:14:42.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 --2- 172.21.15.5:0/3364750400 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424108040 0x7f242410e840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 --2- 172.21.15.5:0/3364750400 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24241076c0 0x7f2424107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 --2- 172.21.15.5:0/3364750400 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2424101cb0 0x7f2424102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 -- 172.21.15.5:0/3364750400 >> 172.21.15.5:0/3364750400 conn(0x7f24240fd700 msgr2=0x7f24240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:42.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 -- 172.21.15.5:0/3364750400 shutdown_connections 2024-09-10T22:14:42.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.309+0000 7f242abd5640 1 -- 172.21.15.5:0/3364750400 wait complete. 2024-09-10T22:14:42.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 Processor -- start 2024-09-10T22:14:42.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 -- start start 2024-09-10T22:14:42.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 0x7f2424199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:42.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24241076c0 0x7f24241998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:42.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2424108040 0x7f242419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2424112e40 con 0x7f2424101cb0 2024-09-10T22:14:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2424112cc0 con 0x7f2424108040 2024-09-10T22:14:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f242abd5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2424112fc0 con 0x7f24241076c0 2024-09-10T22:14:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f2428971640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 0x7f2424199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f2428971640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 0x7f2424199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39826/0 (socket says 172.21.15.5:39826) 2024-09-10T22:14:42.332 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.310+0000 7f2428971640 1 -- 172.21.15.5:0/3884002664 learned_addr learned my addr 172.21.15.5:0/3884002664 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2423fff640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24241076c0 0x7f24241998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2429172640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2424108040 0x7f242419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2428971640 1 -- 172.21.15.5:0/3884002664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24241076c0 msgr2=0x7f24241998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2428971640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24241076c0 0x7f24241998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2428971640 1 -- 172.21.15.5:0/3884002664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2424108040 msgr2=0x7f242419ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:42.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2428971640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2424108040 0x7f242419ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2428971640 1 -- 172.21.15.5:0/3884002664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242419f420 con 0x7f2424101cb0 2024-09-10T22:14:42.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2429172640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2424108040 0x7f242419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:14:42.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2428971640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 0x7f2424199370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f241400b4a0 tx=0x7f241400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:42.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414015020 con 0x7f2424101cb0 2024-09-10T22:14:42.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2414011ce0 con 0x7f2424101cb0 2024-09-10T22:14:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f242419f710 con 0x7f2424101cb0 2024-09-10T22:14:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2414010dc0 con 0x7f2424101cb0 2024-09-10T22:14:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.311+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24241a5e50 con 0x7f2424101cb0 2024-09-10T22:14:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.312+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2424102110 con 0x7f2424101cb0 2024-09-10T22:14:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.314+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f2414011830 con 0x7f2424101cb0 2024-09-10T22:14:42.335 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.314+0000 7f2421ffb640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f240c0b52e0 0x7f240c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.314+0000 7f2423fff640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f240c0b52e0 0x7f240c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.314+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f24140e5240 con 0x7f2424101cb0 2024-09-10T22:14:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.315+0000 7f2423fff640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f240c0b52e0 0x7f240c0b77a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2424104330 tx=0x7f2418009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:42.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.318+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f241401f020 con 0x7f2424101cb0 2024-09-10T22:14:42.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.540+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f242402e5c0 con 0x7f2424101cb0 2024-09-10T22:14:42.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.541+0000 7f2421ffb640 1 -- 172.21.15.5:0/3884002664 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f24140ac5a0 con 0x7f2424101cb0 2024-09-10T22:14:42.543 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:42.543 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":9,"btime":"2024-09-10T22:14:40:819404+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T22:14:42.543 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 9 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f240c0b52e0 msgr2=0x7f240c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f240c0b52e0 0x7f240c0b77a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2424104330 tx=0x7f2418009110 comp rx=0 tx=0).stop 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 msgr2=0x7f2424199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 0x7f2424199370 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f241400b4a0 tx=0x7f241400b8a0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 shutdown_connections 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f240c0b52e0 0x7f240c0b77a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2424108040 0x7f242419ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24241076c0 0x7f24241998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 --2- 172.21.15.5:0/3884002664 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2424101cb0 0x7f2424199370 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:42.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 >> 172.21.15.5:0/3884002664 conn(0x7f24240fd700 msgr2=0x7f24240ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:42.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 shutdown_connections 2024-09-10T22:14:42.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:42.543+0000 7f242abd5640 1 -- 172.21.15.5:0/3884002664 wait complete. 2024-09-10T22:14:42.694 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:42 smithi189 systemd[1]: Starting Ceph mds.i for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:43.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:42 smithi189 ceph-mon[35784]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:43.088 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:42 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3884002664' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:43.088 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:42 smithi189 podman[65733]: 2024-09-10 22:14:42.708756797 +0000 UTC m=+0.015786605 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:43.089 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:42 smithi189 podman[65733]: 2024-09-10 22:14:42.850403907 +0000 UTC m=+0.157433698 container create b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T22:14:43.089 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:43 smithi189 podman[65733]: 2024-09-10 22:14:43.087540465 +0000 UTC m=+0.394570266 container init b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T22:14:43.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:42 smithi005 ceph-mon[31115]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:43.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:42 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3884002664' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:42 smithi052 ceph-mon[34997]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:42 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3884002664' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:43.443 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:43 smithi189 podman[65733]: 2024-09-10 22:14:43.091171894 +0000 UTC m=+0.398201703 container start b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:14:43.443 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:43 smithi189 ceph-mds[65752]: -- 172.21.15.189:0/1981276021 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b2e4eb860 con 0x557b2e4c9400 2024-09-10T22:14:43.443 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:43 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i[65748]: starting mds.i at 2024-09-10T22:14:43.444 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:43 smithi189 bash[65733]: b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 2024-09-10T22:14:43.444 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:14:43 smithi189 systemd[1]: Started Ceph mds.i for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:44.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: Deploying daemon mds.g on smithi005 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] up:boot 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: fsmap 9 up:standby 2024-09-10T22:14:44.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:44 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:14:44.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.543 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: Deploying daemon mds.g on smithi005 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] up:boot 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: fsmap 9 up:standby 2024-09-10T22:14:44.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:44 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:14:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: Deploying daemon mds.g on smithi005 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] up:boot 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: fsmap 9 up:standby 2024-09-10T22:14:44.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:44 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:14:45.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:45.536 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:45 smithi005 ceph-mon[31115]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:45.537 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 systemd[1]: Starting Ceph mds.g for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:45 smithi189 ceph-mon[35784]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:45.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:45 smithi052 ceph-mon[34997]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:45.800 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 podman[74016]: 2024-09-10 22:14:45.438257336 +0000 UTC m=+0.016466325 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:45.800 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 podman[74016]: 2024-09-10 22:14:45.563021977 +0000 UTC m=+0.141230964 container create add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-10T22:14:45.800 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 podman[74016]: 2024-09-10 22:14:45.7995745 +0000 UTC m=+0.377783491 container init add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:14:45.940 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:46.062 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 podman[74016]: 2024-09-10 22:14:45.80267554 +0000 UTC m=+0.380884528 container start add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T22:14:46.062 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 ceph-mds[74062]: -- 172.21.15.5:0/2045651708 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d829c5b860 con 0x55d829c39000 2024-09-10T22:14:46.062 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g[74051]: starting mds.g at 2024-09-10T22:14:46.062 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 bash[74016]: add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 2024-09-10T22:14:46.062 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:14:45 smithi005 systemd[1]: Started Ceph mds.g for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 -- 172.21.15.5:0/2690366296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 msgr2=0x7fa0ac107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 --2- 172.21.15.5:0/2690366296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac107b20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0009900 tx=0x7fa0a002a410 comp rx=0 tx=0).stop 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 -- 172.21.15.5:0/2690366296 shutdown_connections 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 --2- 172.21.15.5:0/2690366296 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0ac108060 0x7fa0ac10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 --2- 172.21.15.5:0/2690366296 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac107b20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 --2- 172.21.15.5:0/2690366296 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac101cd0 0x7fa0ac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 -- 172.21.15.5:0/2690366296 >> 172.21.15.5:0/2690366296 conn(0x7fa0ac0fd700 msgr2=0x7fa0ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 -- 172.21.15.5:0/2690366296 shutdown_connections 2024-09-10T22:14:46.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.447+0000 7fa0b231e640 1 -- 172.21.15.5:0/2690366296 wait complete. 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 Processor -- start 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 -- start start 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0ac101cd0 0x7fa0ac198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac108060 0x7fa0ac19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac111d20 con 0x7fa0ac1076e0 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac111ba0 con 0x7fa0ac101cd0 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.448+0000 7fa0b231e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ac111ea0 con 0x7fa0ac108060 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac1986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39856/0 (socket says 172.21.15.5:39856) 2024-09-10T22:14:46.464 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 -- 172.21.15.5:0/1813494680 learned_addr learned my addr 172.21.15.5:0/1813494680 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0b08bb640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac108060 0x7fa0ac19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0abfff640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0ac101cd0 0x7fa0ac198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 -- 172.21.15.5:0/1813494680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac108060 msgr2=0x7fa0ac19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac108060 0x7fa0ac19da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 -- 172.21.15.5:0/1813494680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0ac101cd0 msgr2=0x7fa0ac198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0ac101cd0 0x7fa0ac198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 -- 172.21.15.5:0/1813494680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ac19e220 con 0x7fa0ac1076e0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0ab7fe640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac1986b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0005940 tx=0x7fa0a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a003f030 con 0x7fa0ac1076e0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a0003cb0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ac19e4b0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0035070 con 0x7fa0ac1076e0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.449+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ac1a4bd0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.465 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.451+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ac1020b0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.452+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fa0a003bbf0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.453+0000 7fa0a97fa640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa0940b52e0 0x7fa0940b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.453+0000 7fa0abfff640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa0940b52e0 0x7fa0940b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.453+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fa0a0106480 con 0x7fa0ac1076e0 2024-09-10T22:14:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.454+0000 7fa0abfff640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa0940b52e0 0x7fa0940b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005fd0 tx=0x7fa09c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:46.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.456+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa0a00cd190 con 0x7fa0ac1076e0 2024-09-10T22:14:46.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.687+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0ac1992a0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.687+0000 7fa0a97fa640 1 -- 172.21.15.5:0/1813494680 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8860 (secure 0 0 0) 0x7fa0ac1992a0 con 0x7fa0ac1076e0 2024-09-10T22:14:46.689 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:46.689 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":11,"btime":"2024-09-10T22:14:46:250111+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T22:14:46.689 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 11 2024-09-10T22:14:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa0940b52e0 msgr2=0x7fa0940b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa0940b52e0 0x7fa0940b77a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005fd0 tx=0x7fa09c00b390 comp rx=0 tx=0).stop 2024-09-10T22:14:46.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 msgr2=0x7fa0ac1986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac1986b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa0a0005940 tx=0x7fa0a00042f0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 shutdown_connections 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa0940b52e0 0x7fa0940b77a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa0ac108060 0x7fa0ac19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa0ac1076e0 0x7fa0ac1986b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 --2- 172.21.15.5:0/1813494680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa0ac101cd0 0x7fa0ac198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 >> 172.21.15.5:0/1813494680 conn(0x7fa0ac0fd700 msgr2=0x7fa0ac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 shutdown_connections 2024-09-10T22:14:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:46.690+0000 7fa0b231e640 1 -- 172.21.15.5:0/1813494680 wait complete. 2024-09-10T22:14:47.211 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:47.211 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: Deploying daemon mds.a on smithi005 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.5:6838/738059047,v1:172.21.15.5:6839/738059047] up:boot 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: fsmap 10 up:standby 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:14:47.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:46 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1813494680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:47.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:47.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:47.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:47.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:47.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: Deploying daemon mds.a on smithi005 2024-09-10T22:14:47.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.5:6838/738059047,v1:172.21.15.5:6839/738059047] up:boot 2024-09-10T22:14:47.251 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: fsmap 10 up:standby 2024-09-10T22:14:47.252 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:14:47.252 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:46 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1813494680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:47.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:47.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: Deploying daemon mds.a on smithi005 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.5:6838/738059047,v1:172.21.15.5:6839/738059047] up:boot 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: fsmap 10 up:standby 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-10T22:14:47.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:46 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1813494680' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:49.218 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:48 smithi005 ceph-mon[31115]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:49.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:48 smithi052 ceph-mon[34997]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:49.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:48 smithi189 ceph-mon[35784]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:49.474 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:14:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a[74427]: starting mds.a at 2024-09-10T22:14:49.474 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:14:49 smithi005 bash[74412]: b62c411c72053ae2682f973cafa1c81df86e07c7d5ed1178b9324536e07f5bac 2024-09-10T22:14:49.832 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:14:49 smithi005 systemd[1]: Started Ceph mds.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:49.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:50.218 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:50.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:50.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:50.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:50.596 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: Deploying daemon mds.b on smithi052 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.5:6840/4233870863,v1:172.21.15.5:6841/4233870863] up:boot 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: fsmap 11 up:standby 2024-09-10T22:14:50.597 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:50 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:14:50.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 -- 172.21.15.5:0/4227041473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 msgr2=0x7f95a0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 --2- 172.21.15.5:0/4227041473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0107ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9594009900 tx=0x7f959402a410 comp rx=0 tx=0).stop 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 -- 172.21.15.5:0/4227041473 shutdown_connections 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 --2- 172.21.15.5:0/4227041473 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0108020 0x7f95a010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 --2- 172.21.15.5:0/4227041473 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0107ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 --2- 172.21.15.5:0/4227041473 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95a0101c90 0x7f95a0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 -- 172.21.15.5:0/4227041473 >> 172.21.15.5:0/4227041473 conn(0x7f95a00fd700 msgr2=0x7f95a00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:50.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 -- 172.21.15.5:0/4227041473 shutdown_connections 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.678+0000 7f95a6015640 1 -- 172.21.15.5:0/4227041473 wait complete. 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.679+0000 7f95a6015640 1 Processor -- start 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.679+0000 7f95a6015640 1 -- start start 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f95a6015640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0101c90 0x7f95a0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f95a6015640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f95a6015640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95a0108020 0x7f95a019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f95a6015640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0111d30 con 0x7f95a01076a0 2024-09-10T22:14:50.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f95a6015640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0111bb0 con 0x7f95a0101c90 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f95a6015640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0111eb0 con 0x7f95a0108020 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39888/0 (socket says 172.21.15.5:39888) 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 -- 172.21.15.5:0/2251094788 learned_addr learned my addr 172.21.15.5:0/2251094788 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959f7fe640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0101c90 0x7f95a0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959ffff640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95a0108020 0x7f95a019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 -- 172.21.15.5:0/2251094788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95a0108020 msgr2=0x7f95a019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:50.707 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95a0108020 0x7f95a019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 -- 172.21.15.5:0/2251094788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0101c90 msgr2=0x7f95a0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0101c90 0x7f95a0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 -- 172.21.15.5:0/2251094788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a019f300 con 0x7f95a01076a0 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959f7fe640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0101c90 0x7f95a0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959effd640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0199790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9594005ab0 tx=0x7f9594003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.680+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959403f070 con 0x7f95a01076a0 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.681+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a019f590 con 0x7f95a01076a0 2024-09-10T22:14:50.708 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.681+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9594031d60 con 0x7f95a01076a0 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.681+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594035030 con 0x7f95a01076a0 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.681+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a5cb0 con 0x7f95a01076a0 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.682+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0102070 con 0x7f95a01076a0 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.683+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f959403b560 con 0x7f95a01076a0 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.684+0000 7f959cff9640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f95880b52e0 0x7f95880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.684+0000 7f959f7fe640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f95880b52e0 0x7f95880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:50.709 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.684+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f9594106b70 con 0x7f95a01076a0 2024-09-10T22:14:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.685+0000 7f959f7fe640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f95880b52e0 0x7f95880b77a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9590005fd0 tx=0x7f9590005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:50.710 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.687+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f95940cde30 con 0x7f95a01076a0 2024-09-10T22:14:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.911+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95a019a380 con 0x7f95a01076a0 2024-09-10T22:14:50.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.912+0000 7f959cff9640 1 -- 172.21.15.5:0/2251094788 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9683 (secure 0 0 0) 0x7f95a019a380 con 0x7f95a01076a0 2024-09-10T22:14:50.914 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:50.914 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":12,"btime":"2024-09-10T22:14:49:962329+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-10T22:14:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 12 2024-09-10T22:14:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.914+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f95880b52e0 msgr2=0x7f95880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.914+0000 7f95a6015640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f95880b52e0 0x7f95880b77a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9590005fd0 tx=0x7f9590005ea0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.914+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 msgr2=0x7f95a0199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.914+0000 7f95a6015640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0199790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9594005ab0 tx=0x7f9594003d50 comp rx=0 tx=0).stop 2024-09-10T22:14:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 shutdown_connections 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f95880b52e0 0x7f95880b77a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f95a0108020 0x7f95a019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f95a01076a0 0x7f95a0199790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 --2- 172.21.15.5:0/2251094788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f95a0101c90 0x7f95a0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 >> 172.21.15.5:0/2251094788 conn(0x7f95a00fd700 msgr2=0x7f95a006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 shutdown_connections 2024-09-10T22:14:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:50.915+0000 7f95a6015640 1 -- 172.21.15.5:0/2251094788 wait complete. 2024-09-10T22:14:50.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:50.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:50.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:50.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: Deploying daemon mds.b on smithi052 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.5:6840/4233870863,v1:172.21.15.5:6841/4233870863] up:boot 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: fsmap 11 up:standby 2024-09-10T22:14:50.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:50 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:14:50.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: Deploying daemon mds.b on smithi052 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.5:6840/4233870863,v1:172.21.15.5:6841/4233870863] up:boot 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: fsmap 11 up:standby 2024-09-10T22:14:51.000 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:50 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-10T22:14:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:51 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2251094788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:51.750 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:51 smithi052 systemd[1]: Starting Ceph mds.b for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:14:51.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:51 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2251094788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:51 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2251094788' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:52.137 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:51 smithi052 podman[65128]: 2024-09-10 22:14:51.781986567 +0000 UTC m=+0.016129596 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:14:52.137 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:51 smithi052 podman[65128]: 2024-09-10 22:14:51.900674652 +0000 UTC m=+0.134817712 container create 1ad476cfd7f0c4631f424cd25214a9b9d6e23ed6dbfb37edd940306c26daecdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-10T22:14:52.138 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:52 smithi052 podman[65128]: 2024-09-10 22:14:52.136735517 +0000 UTC m=+0.370878535 container init 1ad476cfd7f0c4631f424cd25214a9b9d6e23ed6dbfb37edd940306c26daecdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-10T22:14:52.499 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:52 smithi052 podman[65128]: 2024-09-10 22:14:52.139683854 +0000 UTC m=+0.373826872 container start 1ad476cfd7f0c4631f424cd25214a9b9d6e23ed6dbfb37edd940306c26daecdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:14:52.499 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:52 smithi052 ceph-mds[65148]: -- 172.21.15.52:0/1768075314 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559e8e8a5860 con 0x559e8e883400 2024-09-10T22:14:52.500 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: starting mds.b at 2024-09-10T22:14:52.500 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:52 smithi052 bash[65128]: 1ad476cfd7f0c4631f424cd25214a9b9d6e23ed6dbfb37edd940306c26daecdc 2024-09-10T22:14:52.500 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:14:52 smithi052 systemd[1]: Started Ceph mds.b for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:14:53.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] up:boot 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: fsmap 12 up:standby 2024-09-10T22:14:53.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:53 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:14:53.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:53.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] up:boot 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: fsmap 12 up:standby 2024-09-10T22:14:53.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:53 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:14:53.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:53.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] up:boot 2024-09-10T22:14:53.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: fsmap 12 up:standby 2024-09-10T22:14:53.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:53 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:14:53.863 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 -- 172.21.15.5:0/3618844627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee30102de0 msgr2=0x7fee301031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:54.404 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 --2- 172.21.15.5:0/3618844627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee30102de0 0x7fee301031c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009900 tx=0x7fee2c02a410 comp rx=0 tx=0).stop 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 -- 172.21.15.5:0/3618844627 shutdown_connections 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 --2- 172.21.15.5:0/3618844627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee30109170 0x7fee3010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 --2- 172.21.15.5:0/3618844627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee301087f0 0x7fee30108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 --2- 172.21.15.5:0/3618844627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee30102de0 0x7fee301031c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 -- 172.21.15.5:0/3618844627 >> 172.21.15.5:0/3618844627 conn(0x7fee300fe830 msgr2=0x7fee30100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 -- 172.21.15.5:0/3618844627 shutdown_connections 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 -- 172.21.15.5:0/3618844627 wait complete. 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 Processor -- start 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.378+0000 7fee38486640 1 -- start start 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee38486640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30102de0 0x7fee30199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee38486640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 0x7fee301998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:54.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee38486640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee30109170 0x7fee3019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee38486640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fee30112e30 con 0x7fee301087f0 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee38486640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fee30112cb0 con 0x7fee30109170 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee38486640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fee30112fb0 con 0x7fee30102de0 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 0x7fee301998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 0x7fee301998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55126/0 (socket says 172.21.15.5:55126) 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 -- 172.21.15.5:0/2343514276 learned_addr learned my addr 172.21.15.5:0/2343514276 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee36222640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30102de0 0x7fee30199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee36a23640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee30109170 0x7fee3019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 -- 172.21.15.5:0/2343514276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30102de0 msgr2=0x7fee30199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30102de0 0x7fee30199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 -- 172.21.15.5:0/2343514276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee30109170 msgr2=0x7fee3019ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee30109170 0x7fee3019ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.406 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 -- 172.21.15.5:0/2343514276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3019f410 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.379+0000 7fee35a21640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 0x7fee301998a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fee2000d950 tx=0x7fee2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.380+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20017070 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.380+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee20009c30 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.380+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3019f700 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.380+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2000f620 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.380+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee301a5dc0 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.381+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee301031c0 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.382+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fee20010460 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.383+0000 7fee277fe640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fee1c0b52e0 0x7fee1c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.383+0000 7fee36222640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fee1c0b52e0 0x7fee1c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.383+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fee200e5320 con 0x7fee301087f0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.383+0000 7fee36222640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fee1c0b52e0 0x7fee1c0b77a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee2c031440 tx=0x7fee2c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:54.407 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.387+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fee20009de0 con 0x7fee301087f0 2024-09-10T22:14:54.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.613+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee3002e5c0 con 0x7fee301087f0 2024-09-10T22:14:54.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.614+0000 7fee277fe640 1 -- 172.21.15.5:0/2343514276 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10509 (secure 0 0 0) 0x7fee200ac030 con 0x7fee301087f0 2024-09-10T22:14:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:54.617 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":13,"btime":"2024-09-10T22:14:52:536454+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24536,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24544,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24562,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24563,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-10T22:14:54.617 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 13 2024-09-10T22:14:54.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fee1c0b52e0 msgr2=0x7fee1c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fee1c0b52e0 0x7fee1c0b77a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fee2c031440 tx=0x7fee2c005b50 comp rx=0 tx=0).stop 2024-09-10T22:14:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 msgr2=0x7fee301998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 0x7fee301998a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fee2000d950 tx=0x7fee2000de10 comp rx=0 tx=0).stop 2024-09-10T22:14:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 shutdown_connections 2024-09-10T22:14:54.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fee1c0b52e0 0x7fee1c0b77a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fee30109170 0x7fee3019ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fee301087f0 0x7fee301998a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 --2- 172.21.15.5:0/2343514276 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fee30102de0 0x7fee30199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 >> 172.21.15.5:0/2343514276 conn(0x7fee300fe830 msgr2=0x7fee30100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 shutdown_connections 2024-09-10T22:14:54.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:54.616+0000 7fee38486640 1 -- 172.21.15.5:0/2343514276 wait complete. 2024-09-10T22:14:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2343514276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:55.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:54 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:55.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2343514276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:55.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:54 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.302 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:55.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:55.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:55.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2343514276' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:14:55.303 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:54 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:14:55.330 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-10T22:14:56.335 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 -- 172.21.15.5:0/3812738564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b8102190 msgr2=0x7f43b810eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 --2- 172.21.15.5:0/3812738564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b8102190 0x7f43b810eee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f43a8009900 tx=0x7f43a802a410 comp rx=0 tx=0).stop 2024-09-10T22:14:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 -- 172.21.15.5:0/3812738564 shutdown_connections 2024-09-10T22:14:56.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 --2- 172.21.15.5:0/3812738564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b810f420 0x7f43b8111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 --2- 172.21.15.5:0/3812738564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b8102190 0x7f43b810eee0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 --2- 172.21.15.5:0/3812738564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b8101870 0x7f43b8101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 -- 172.21.15.5:0/3812738564 >> 172.21.15.5:0/3812738564 conn(0x7f43b80fd700 msgr2=0x7f43b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 -- 172.21.15.5:0/3812738564 shutdown_connections 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 -- 172.21.15.5:0/3812738564 wait complete. 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 Processor -- start 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.791+0000 7f43bf95d640 1 -- start start 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b8101870 0x7f43b819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:56.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b8102190 0x7f43b819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 0x7f43b81a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8114f90 con 0x7f43b810f420 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8114e10 con 0x7f43b8101870 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8115110 con 0x7f43b8102190 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 0x7f43b81a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 0x7f43b81a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55150/0 (socket says 172.21.15.5:55150) 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 -- 172.21.15.5:0/255162806 learned_addr learned my addr 172.21.15.5:0/255162806 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bd6f9640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b8101870 0x7f43b819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bcef8640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b8102190 0x7f43b819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 -- 172.21.15.5:0/255162806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b8102190 msgr2=0x7f43b819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b8102190 0x7f43b819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:56.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 -- 172.21.15.5:0/255162806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b8101870 msgr2=0x7f43b819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b8101870 0x7f43b819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 -- 172.21.15.5:0/255162806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b81a1510 con 0x7f43b810f420 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bdefa640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 0x7f43b81a0d40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c970 tx=0x7f43b000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0004230 con 0x7f43b810f420 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b81a1800 con 0x7f43b810f420 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43b00043d0 con 0x7f43b810f420 2024-09-10T22:14:56.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.792+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b000f450 con 0x7f43b810f420 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.793+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81a7ec0 con 0x7f43b810f420 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.793+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b8101c50 con 0x7f43b810f420 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.795+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f43b00079b0 con 0x7f43b810f420 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.796+0000 7f43ae7fc640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f43a40b52e0 0x7f43a40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.796+0000 7f43bd6f9640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f43a40b52e0 0x7f43a40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.796+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f43b00e5a50 con 0x7f43b810f420 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.796+0000 7f43bd6f9640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f43a40b52e0 0x7f43a40b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43b4005fd0 tx=0x7f43b4009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:56.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:56.799+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43b0014070 con 0x7f43b810f420 2024-09-10T22:14:57.004 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.003+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f43b819c590 con 0x7f43b810f420 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.003+0000 7f43ae7fc640 1 -- 172.21.15.5:0/255162806 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7f43b819c590 con 0x7f43b810f420 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout:[ 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "poolnum": 1, 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: "poolname": ".mgr" 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:14:57.005 INFO:teuthology.orchestra.run.smithi005.stdout:] 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.005+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f43a40b52e0 msgr2=0x7f43a40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.005+0000 7f43bf95d640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f43a40b52e0 0x7f43a40b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f43b4005fd0 tx=0x7f43b4009870 comp rx=0 tx=0).stop 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.005+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 msgr2=0x7f43b81a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.005+0000 7f43bf95d640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 0x7f43b81a0d40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f43b000c970 tx=0x7f43b000ce30 comp rx=0 tx=0).stop 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 shutdown_connections 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f43a40b52e0 0x7f43a40b77a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f43b810f420 0x7f43b81a0d40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f43b8102190 0x7f43b819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 --2- 172.21.15.5:0/255162806 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f43b8101870 0x7f43b819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 >> 172.21.15.5:0/255162806 conn(0x7f43b80fd700 msgr2=0x7f43b81115b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 shutdown_connections 2024-09-10T22:14:57.008 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:57.006+0000 7f43bf95d640 1 -- 172.21.15.5:0/255162806 wait complete. 2024-09-10T22:14:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:57 smithi005 ceph-mon[31115]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:57 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/255162806' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T22:14:57.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:57 smithi189 ceph-mon[35784]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:57 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:57 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:57 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:57 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.444 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:57 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/255162806' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T22:14:57.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:57 smithi052 ceph-mon[34997]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:57 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:57 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:57 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:57 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:57.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:57 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/255162806' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-10T22:14:57.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T22:14:57.686 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T22:14:57.943 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:14:58.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:58 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:58 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:58 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:58.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:58 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:58.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:58 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 -- 172.21.15.5:0/2377131133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714102dc0 msgr2=0x7f67141031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 --2- 172.21.15.5:0/2377131133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714102dc0 0x7f67141031a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6710009900 tx=0x7f671002a410 comp rx=0 tx=0).stop 2024-09-10T22:14:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 -- 172.21.15.5:0/2377131133 shutdown_connections 2024-09-10T22:14:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 --2- 172.21.15.5:0/2377131133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714109150 0x7f671410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 --2- 172.21.15.5:0/2377131133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67141087d0 0x7f6714108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:58.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 --2- 172.21.15.5:0/2377131133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714102dc0 0x7f67141031a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 -- 172.21.15.5:0/2377131133 >> 172.21.15.5:0/2377131133 conn(0x7f67140fe850 msgr2=0x7f6714100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 -- 172.21.15.5:0/2377131133 shutdown_connections 2024-09-10T22:14:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.442+0000 7f671c525640 1 -- 172.21.15.5:0/2377131133 wait complete. 2024-09-10T22:14:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 Processor -- start 2024-09-10T22:14:58.445 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 -- start start 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714102dc0 0x7f67141992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67141087d0 0x7f67141997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 0x7f671419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6714112dd0 con 0x7f6714109150 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6714112c50 con 0x7f67141087d0 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671c525640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6714112f50 con 0x7f6714102dc0 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671aac2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 0x7f671419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:58.447 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671aac2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 0x7f671419eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55166/0 (socket says 172.21.15.5:55166) 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671aac2640 1 -- 172.21.15.5:0/2826581436 learned_addr learned my addr 172.21.15.5:0/2826581436 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671a2c1640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714102dc0 0x7f67141992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f6719ac0640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67141087d0 0x7f67141997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671aac2640 1 -- 172.21.15.5:0/2826581436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714102dc0 msgr2=0x7f67141992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.443+0000 7f671aac2640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714102dc0 0x7f67141992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671aac2640 1 -- 172.21.15.5:0/2826581436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67141087d0 msgr2=0x7f67141997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671aac2640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67141087d0 0x7f67141997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:58.448 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671aac2640 1 -- 172.21.15.5:0/2826581436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671419f350 con 0x7f6714109150 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671a2c1640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714102dc0 0x7f67141992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671aac2640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 0x7f671419eb80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f670c009fd0 tx=0x7f670c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c017070 con 0x7f6714109150 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f670c003e20 con 0x7f6714109150 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671419f640 con 0x7f6714109150 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c010460 con 0x7f6714109150 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.444+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67141a5d00 con 0x7f6714109150 2024-09-10T22:14:58.449 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.445+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67141031a0 con 0x7f6714109150 2024-09-10T22:14:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.447+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f670c003970 con 0x7f6714109150 2024-09-10T22:14:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.448+0000 7f670b7fe640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67000b52e0 0x7f67000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:14:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.448+0000 7f671a2c1640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67000b52e0 0x7f67000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:14:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.448+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f670c0e5560 con 0x7f6714109150 2024-09-10T22:14:58.451 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.449+0000 7f671a2c1640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67000b52e0 0x7f67000b77a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6710031440 tx=0x7f6710005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:14:58.452 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.451+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f670c0ac8c0 con 0x7f6714109150 2024-09-10T22:14:58.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:58.639+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f671419a3d0 con 0x7f6714109150 2024-09-10T22:14:58.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:58 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:58 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:58 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:58.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:58 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:58.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:58 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.752 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:58 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:58 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:58.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:58 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:14:58.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:58 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:14:58.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:58 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:14:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.320+0000 7f670b7fe640 1 -- 172.21.15.5:0/2826581436 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f671419a3d0 con 0x7f6714109150 2024-09-10T22:14:59.322 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' created 2024-09-10T22:14:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67000b52e0 msgr2=0x7f67000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67000b52e0 0x7f67000b77a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6710031440 tx=0x7f6710005a20 comp rx=0 tx=0).stop 2024-09-10T22:14:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 msgr2=0x7f671419eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:14:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 0x7f671419eb80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f670c009fd0 tx=0x7f670c00b260 comp rx=0 tx=0).stop 2024-09-10T22:14:59.326 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 shutdown_connections 2024-09-10T22:14:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67000b52e0 0x7f67000b77a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6714109150 0x7f671419eb80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67141087d0 0x7f67141997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 --2- 172.21.15.5:0/2826581436 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6714102dc0 0x7f67141992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:14:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.324+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 >> 172.21.15.5:0/2826581436 conn(0x7f67140fe850 msgr2=0x7f6714100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:14:59.327 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.326+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 shutdown_connections 2024-09-10T22:14:59.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:14:59.327+0000 7f671c525640 1 -- 172.21.15.5:0/2826581436 wait complete. 2024-09-10T22:14:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:59 smithi005 ceph-mon[31115]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:14:59 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2826581436' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T22:14:59.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:59 smithi189 ceph-mon[35784]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:59.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:14:59 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2826581436' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T22:14:59.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:59 smithi052 ceph-mon[34997]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:14:59.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:14:59 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2826581436' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-10T22:15:00.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T22:15:00.297 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:00.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:00 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2826581436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T22:15:00.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:00 smithi005 ceph-mon[31115]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T22:15:00.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:00 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2826581436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T22:15:00.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:00 smithi189 ceph-mon[35784]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T22:15:00.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:00 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2826581436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-10T22:15:00.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:00 smithi052 ceph-mon[34997]: osdmap e72: 12 total, 12 up, 12 in 2024-09-10T22:15:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.785+0000 7f76b9743640 1 -- 172.21.15.5:0/1405560616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4103ce0 msgr2=0x7f76b41040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.785+0000 7f76b9743640 1 --2- 172.21.15.5:0/1405560616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4103ce0 0x7f76b41040c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009ca0 tx=0x7f76a402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 -- 172.21.15.5:0/1405560616 shutdown_connections 2024-09-10T22:15:00.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 --2- 172.21.15.5:0/1405560616 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76b410d140 0x7f76b410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 --2- 172.21.15.5:0/1405560616 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b4104600 0x7f76b410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 --2- 172.21.15.5:0/1405560616 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4103ce0 0x7f76b41040c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 -- 172.21.15.5:0/1405560616 >> 172.21.15.5:0/1405560616 conn(0x7f76b40fd700 msgr2=0x7f76b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 -- 172.21.15.5:0/1405560616 shutdown_connections 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 -- 172.21.15.5:0/1405560616 wait complete. 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 Processor -- start 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.786+0000 7f76b9743640 1 -- start start 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b4103ce0 0x7f76b4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 0x7f76b4199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76b410d140 0x7f76b419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4112df0 con 0x7f76b4104600 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4112c70 con 0x7f76b4103ce0 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4112f70 con 0x7f76b410d140 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 0x7f76b4199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:00.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 0x7f76b4199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:55184/0 (socket says 172.21.15.5:55184) 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 -- 172.21.15.5:0/3400964360 learned_addr learned my addr 172.21.15.5:0/3400964360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b2ffd640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b4103ce0 0x7f76b4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b37fe640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76b410d140 0x7f76b419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 -- 172.21.15.5:0/3400964360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76b410d140 msgr2=0x7f76b419ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76b410d140 0x7f76b419ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 -- 172.21.15.5:0/3400964360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b4103ce0 msgr2=0x7f76b4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b4103ce0 0x7f76b4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 -- 172.21.15.5:0/3400964360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b419f3b0 con 0x7f76b4104600 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b27fc640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 0x7f76b4199840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f76a800d750 tx=0x7f76a800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8017070 con 0x7f76b4104600 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76a8004020 con 0x7f76b4104600 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b419f6a0 con 0x7f76b4104600 2024-09-10T22:15:00.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a8003c00 con 0x7f76b4104600 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.787+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b41a5f30 con 0x7f76b4104600 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.788+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b41040c0 con 0x7f76b4104600 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.790+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f76a8009a30 con 0x7f76b4104600 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.791+0000 7f769bfff640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f769c0b5360 0x7f769c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.791+0000 7f76b2ffd640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f769c0b5360 0x7f769c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.791+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7497+0+0 (secure 0 0 0) 0x7f76a80e55e0 con 0x7f76b4104600 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.791+0000 7f76b2ffd640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f769c0b5360 0x7f769c0b7820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009430 tx=0x7f76a4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:00.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.794+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76a80ac7b0 con 0x7f76b4104600 2024-09-10T22:15:00.982 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:00.981+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f76b41a6160 con 0x7f76b4104600 2024-09-10T22:15:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.332+0000 7f769bfff640 1 -- 172.21.15.5:0/3400964360 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) ==== 170+0+0 (secure 0 0 0) 0x7f76a80ac0b0 con 0x7f76b4104600 2024-09-10T22:15:01.334 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' created 2024-09-10T22:15:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f769c0b5360 msgr2=0x7f769c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f769c0b5360 0x7f769c0b7820 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009430 tx=0x7f76a4009360 comp rx=0 tx=0).stop 2024-09-10T22:15:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 msgr2=0x7f76b4199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 0x7f76b4199840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f76a800d750 tx=0x7f76a800dc10 comp rx=0 tx=0).stop 2024-09-10T22:15:01.336 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 shutdown_connections 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f769c0b5360 0x7f769c0b7820 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76b410d140 0x7f76b419ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f76b4104600 0x7f76b4199840 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 --2- 172.21.15.5:0/3400964360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f76b4103ce0 0x7f76b4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 >> 172.21.15.5:0/3400964360 conn(0x7f76b40fd700 msgr2=0x7f76b40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 shutdown_connections 2024-09-10T22:15:01.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:01.335+0000 7f76b9743640 1 -- 172.21.15.5:0/3400964360 wait complete. 2024-09-10T22:15:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:01 smithi005 ceph-mon[31115]: pgmap v285: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:01 smithi005 ceph-mon[31115]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:15:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:01 smithi005 ceph-mon[31115]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T22:15:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:01 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3400964360' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T22:15:01.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:01 smithi189 ceph-mon[35784]: pgmap v285: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:01.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:01 smithi189 ceph-mon[35784]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:15:01.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:01 smithi189 ceph-mon[35784]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T22:15:01.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:01 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3400964360' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T22:15:01.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:01 smithi052 ceph-mon[34997]: pgmap v285: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:01.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:01 smithi052 ceph-mon[34997]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-10T22:15:01.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:01 smithi052 ceph-mon[34997]: osdmap e73: 12 total, 12 up, 12 in 2024-09-10T22:15:01.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:01 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3400964360' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-10T22:15:02.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T22:15:02.298 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:02.591 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:02 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3400964360' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T22:15:02.591 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:02 smithi005 ceph-mon[31115]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:15:02.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:02 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3400964360' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T22:15:02.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:02 smithi189 ceph-mon[35784]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:15:02.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:02 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3400964360' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-10T22:15:02.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:02 smithi052 ceph-mon[34997]: osdmap e74: 12 total, 12 up, 12 in 2024-09-10T22:15:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/3654573826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df8101c90 msgr2=0x7f4df8102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/3654573826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df8101c90 0x7f4df8102070 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4de8009900 tx=0x7f4de802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/3654573826 shutdown_connections 2024-09-10T22:15:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/3654573826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 0x7f4df810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/3654573826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4df81076a0 0x7f4df8107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:02.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/3654573826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df8101c90 0x7f4df8102070 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/3654573826 >> 172.21.15.5:0/3654573826 conn(0x7f4df80fd700 msgr2=0x7f4df80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/3654573826 shutdown_connections 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/3654573826 wait complete. 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.811+0000 7f4dfe5a5640 1 Processor -- start 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 -- start start 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4df8101c90 0x7f4df81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 0x7f4df8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 0x7f4df819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4df8111d20 con 0x7f4df81076a0 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4df8111ba0 con 0x7f4df8101c90 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfe5a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4df8111ea0 con 0x7f4df8108020 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 0x7f4df8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 0x7f4df8199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33828/0 (socket says 172.21.15.5:33828) 2024-09-10T22:15:02.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 -- 172.21.15.5:0/1603382955 learned_addr learned my addr 172.21.15.5:0/1603382955 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfcb42640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 0x7f4df819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df7fff640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4df8101c90 0x7f4df81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 -- 172.21.15.5:0/1603382955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 msgr2=0x7f4df819ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 0x7f4df819ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 -- 172.21.15.5:0/1603382955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4df8101c90 msgr2=0x7f4df81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4df8101c90 0x7f4df81993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4df77fe640 1 -- 172.21.15.5:0/1603382955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df819f480 con 0x7f4df81076a0 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.812+0000 7f4dfcb42640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 0x7f4df819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.813+0000 7f4df77fe640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 0x7f4df8199910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b4a0 tx=0x7f4dec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.813+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec014070 con 0x7f4df81076a0 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.813+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dec010ac0 con 0x7f4df81076a0 2024-09-10T22:15:02.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.813+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df819f770 con 0x7f4df81076a0 2024-09-10T22:15:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.813+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec017c30 con 0x7f4df81076a0 2024-09-10T22:15:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.813+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df81a5e30 con 0x7f4df81076a0 2024-09-10T22:15:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.814+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df81020f0 con 0x7f4df81076a0 2024-09-10T22:15:02.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.816+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f4dec010610 con 0x7f4df81076a0 2024-09-10T22:15:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.816+0000 7f4df57fa640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4de00b5360 0x7f4de00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.816+0000 7f4df7fff640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4de00b5360 0x7f4de00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.817+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7879+0+0 (secure 0 0 0) 0x7f4dec0e5320 con 0x7f4df81076a0 2024-09-10T22:15:02.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.817+0000 7f4df7fff640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4de00b5360 0x7f4de00b7820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4de8031440 tx=0x7f4de80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:02.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:02.820+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4dec0ac390 con 0x7f4df81076a0 2024-09-10T22:15:03.043 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.042+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4df802e5c0 con 0x7f4df81076a0 2024-09-10T22:15:03.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.339+0000 7f4df57fa640 1 -- 172.21.15.5:0/1603382955 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f4dec0abc90 con 0x7f4df81076a0 2024-09-10T22:15:03.340 INFO:teuthology.orchestra.run.smithi005.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T22:15:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4de00b5360 msgr2=0x7f4de00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4de00b5360 0x7f4de00b7820 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4de8031440 tx=0x7f4de80095f0 comp rx=0 tx=0).stop 2024-09-10T22:15:03.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 msgr2=0x7f4df8199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 0x7f4df8199910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00b4a0 tx=0x7f4dec00b960 comp rx=0 tx=0).stop 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 shutdown_connections 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4de00b5360 0x7f4de00b7820 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4df8108020 0x7f4df819ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4df81076a0 0x7f4df8199910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 --2- 172.21.15.5:0/1603382955 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4df8101c90 0x7f4df81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 >> 172.21.15.5:0/1603382955 conn(0x7f4df80fd700 msgr2=0x7f4df806adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 shutdown_connections 2024-09-10T22:15:03.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:03.342+0000 7f4dfe5a5640 1 -- 172.21.15.5:0/1603382955 wait complete. 2024-09-10T22:15:03.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:03 smithi189 ceph-mon[35784]: pgmap v288: 97 pgs: 13 creating+peering, 74 unknown, 10 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:03.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:03 smithi189 ceph-mon[35784]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:15:03.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:03 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1603382955' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T22:15:03.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:03 smithi189 ceph-mon[35784]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T22:15:03.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:03 smithi005 ceph-mon[31115]: pgmap v288: 97 pgs: 13 creating+peering, 74 unknown, 10 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:03.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:03 smithi005 ceph-mon[31115]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:15:03.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:03 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1603382955' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T22:15:03.714 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:03 smithi005 ceph-mon[31115]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T22:15:03.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:03 smithi052 ceph-mon[34997]: pgmap v288: 97 pgs: 13 creating+peering, 74 unknown, 10 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:03.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:03 smithi052 ceph-mon[34997]: osdmap e75: 12 total, 12 up, 12 in 2024-09-10T22:15:03.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:03 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1603382955' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-10T22:15:03.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:03 smithi052 ceph-mon[34997]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-10T22:15:04.014 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:15:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:04.666 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:04 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1603382955' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T22:15:04.666 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:04 smithi005 ceph-mon[31115]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:15:04.666 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:04 smithi005 ceph-mon[31115]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T22:15:04.666 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:04 smithi005 ceph-mon[31115]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T22:15:04.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:04 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1603382955' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T22:15:04.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:04 smithi189 ceph-mon[35784]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:15:04.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:04 smithi189 ceph-mon[35784]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T22:15:04.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:04 smithi189 ceph-mon[35784]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T22:15:04.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:04 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1603382955' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-10T22:15:04.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:04 smithi052 ceph-mon[34997]: osdmap e76: 12 total, 12 up, 12 in 2024-09-10T22:15:04.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:04 smithi052 ceph-mon[34997]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-10T22:15:04.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:04 smithi052 ceph-mon[34997]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-10T22:15:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 -- 172.21.15.5:0/2503115958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 msgr2=0x7fd2a41020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 --2- 172.21.15.5:0/2503115958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a41020b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd294009900 tx=0x7fd29402a410 comp rx=0 tx=0).stop 2024-09-10T22:15:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 -- 172.21.15.5:0/2503115958 shutdown_connections 2024-09-10T22:15:04.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 --2- 172.21.15.5:0/2503115958 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2a4108060 0x7fd2a410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 --2- 172.21.15.5:0/2503115958 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a41076e0 0x7fd2a4107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 --2- 172.21.15.5:0/2503115958 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a41020b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 -- 172.21.15.5:0/2503115958 >> 172.21.15.5:0/2503115958 conn(0x7fd2a40fd700 msgr2=0x7fd2a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 -- 172.21.15.5:0/2503115958 shutdown_connections 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 -- 172.21.15.5:0/2503115958 wait complete. 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 Processor -- start 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.882+0000 7fd2aae99640 1 -- start start 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2aae99640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a4199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:04.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2aae99640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a41076e0 0x7fd2a41998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2aae99640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2a4108060 0x7fd2a419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2aae99640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4111d20 con 0x7fd2a4101cd0 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2aae99640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4111ba0 con 0x7fd2a41076e0 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2aae99640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd2a4111ea0 con 0x7fd2a4108060 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a4199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a4199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33848/0 (socket says 172.21.15.5:33848) 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 -- 172.21.15.5:0/3059967957 learned_addr learned my addr 172.21.15.5:0/3059967957 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a9436640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2a4108060 0x7fd2a419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a3fff640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a41076e0 0x7fd2a41998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 -- 172.21.15.5:0/3059967957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2a4108060 msgr2=0x7fd2a419ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2a4108060 0x7fd2a419ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 -- 172.21.15.5:0/3059967957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a41076e0 msgr2=0x7fd2a41998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:04.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a41076e0 0x7fd2a41998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 -- 172.21.15.5:0/3059967957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2a419f410 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a8c35640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a4199360 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd294005940 tx=0x7fd2940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.883+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd29403f030 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.884+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd294003cb0 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.884+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2a419f6a0 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.884+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd294035070 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.884+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2a41a5dc0 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.885+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2a41020b0 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.886+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fd29403bbf0 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.887+0000 7fd2a1ffb640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd2900b52e0 0x7fd2900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.887+0000 7fd2a3fff640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd2900b52e0 0x7fd2900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.887+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7fd2941067d0 con 0x7fd2a4101cd0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.888+0000 7fd2a3fff640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd2900b52e0 0x7fd2900b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4106fe0 tx=0x7fd28c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:04.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:04.890+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd2940cd190 con 0x7fd2a4101cd0 2024-09-10T22:15:05.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.076+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2a41a6020 con 0x7fd2a4101cd0 2024-09-10T22:15:05.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.078+0000 7fd2a1ffb640 1 -- 172.21.15.5:0/3059967957 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22197 (secure 0 0 0) 0x7fd2940d1bc0 con 0x7fd2a4101cd0 2024-09-10T22:15:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:03.043266+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:15:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd2900b52e0 msgr2=0x7fd2900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd2900b52e0 0x7fd2900b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4106fe0 tx=0x7fd28c00b390 comp rx=0 tx=0).stop 2024-09-10T22:15:05.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 msgr2=0x7fd2a4199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a4199360 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd294005940 tx=0x7fd2940042f0 comp rx=0 tx=0).stop 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 shutdown_connections 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd2900b52e0 0x7fd2900b77a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd2a4108060 0x7fd2a419ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd2a41076e0 0x7fd2a41998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 --2- 172.21.15.5:0/3059967957 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd2a4101cd0 0x7fd2a4199360 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 >> 172.21.15.5:0/3059967957 conn(0x7fd2a40fd700 msgr2=0x7fd2a406b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 shutdown_connections 2024-09-10T22:15:05.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:05.080+0000 7fd2aae99640 1 -- 172.21.15.5:0/3059967957 wait complete. 2024-09-10T22:15:05.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: pgmap v291: 97 pgs: 21 creating+peering, 44 unknown, 32 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:05.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T22:15:05.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: Cluster is now healthy 2024-09-10T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] up:active 2024-09-10T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:05.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:05 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3059967957' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:05.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: pgmap v291: 97 pgs: 21 creating+peering, 44 unknown, 32 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:05.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T22:15:05.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: Cluster is now healthy 2024-09-10T22:15:05.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] up:active 2024-09-10T22:15:05.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:05.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:05.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:05 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3059967957' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:05.775 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: pgmap v291: 97 pgs: 21 creating+peering, 44 unknown, 32 active+clean; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:15:05.776 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-10T22:15:05.776 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: Cluster is now healthy 2024-09-10T22:15:05.776 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] up:active 2024-09-10T22:15:05.776 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:05.776 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:05.776 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:05 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3059967957' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:05.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:15:06.073 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 -- 172.21.15.5:0/146792729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 msgr2=0x7fbc0c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/146792729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c108c10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009900 tx=0x7fbc0002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 -- 172.21.15.5:0/146792729 shutdown_connections 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/146792729 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc0c109150 0x7fbc0c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/146792729 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c108c10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/146792729 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc0c102dc0 0x7fbc0c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 -- 172.21.15.5:0/146792729 >> 172.21.15.5:0/146792729 conn(0x7fbc0c0fe830 msgr2=0x7fbc0c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 -- 172.21.15.5:0/146792729 shutdown_connections 2024-09-10T22:15:06.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.519+0000 7fbc11ae1640 1 -- 172.21.15.5:0/146792729 wait complete. 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 Processor -- start 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 -- start start 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc0c102dc0 0x7fbc0c19b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc0c109150 0x7fbc0c1a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c112dd0 con 0x7fbc0c1087d0 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c112c50 con 0x7fbc0c102dc0 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc11ae1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0c112f50 con 0x7fbc0c109150 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc0affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c19bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33872/0 (socket says 172.21.15.5:33872) 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.520+0000 7fbc0affd640 1 -- 172.21.15.5:0/4094431154 learned_addr learned my addr 172.21.15.5:0/4094431154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0bfff640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc0c109150 0x7fbc0c1a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:06.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0b7fe640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc0c102dc0 0x7fbc0c19b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0affd640 1 -- 172.21.15.5:0/4094431154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc0c109150 msgr2=0x7fbc0c1a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0affd640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc0c109150 0x7fbc0c1a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0affd640 1 -- 172.21.15.5:0/4094431154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc0c102dc0 msgr2=0x7fbc0c19b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0affd640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc0c102dc0 0x7fbc0c19b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0affd640 1 -- 172.21.15.5:0/4094431154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c1a1650 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc0affd640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c19bae0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005940 tx=0x7fbc000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0003f030 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc00003cb0 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0c1a18e0 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc00035070 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.521+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc0c1a8000 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.522+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc0c1031a0 con 0x7fbc0c1087d0 2024-09-10T22:15:06.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.524+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fbc0003bbf0 con 0x7fbc0c1087d0 2024-09-10T22:15:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.524+0000 7fbc08ff9640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbbf40b5360 0x7fbbf40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.524+0000 7fbc0b7fe640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbbf40b5360 0x7fbbf40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.525+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7fbc00106850 con 0x7fbc0c1087d0 2024-09-10T22:15:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.525+0000 7fbc0b7fe640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbbf40b5360 0x7fbbf40b7820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0058c0 tx=0x7fbbfc00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:06.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.527+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbc000cd860 con 0x7fbc0c1087d0 2024-09-10T22:15:06.718 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.717+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc0c19c6d0 con 0x7fbc0c1087d0 2024-09-10T22:15:06.719 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.718+0000 7fbc08ff9640 1 -- 172.21.15.5:0/4094431154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22197 (secure 0 0 0) 0x7fbc000cd160 con 0x7fbc0c1087d0 2024-09-10T22:15:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:06.720 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:03.043266+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbbf40b5360 msgr2=0x7fbbf40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbbf40b5360 0x7fbbf40b7820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc0058c0 tx=0x7fbbfc00a4c0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 msgr2=0x7fbc0c19bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c19bae0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005940 tx=0x7fbc000042f0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 shutdown_connections 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbbf40b5360 0x7fbbf40b7820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbc0c109150 0x7fbc0c1a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbc0c1087d0 0x7fbc0c19bae0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 --2- 172.21.15.5:0/4094431154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbc0c102dc0 0x7fbc0c19b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.720+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 >> 172.21.15.5:0/4094431154 conn(0x7fbc0c0fe830 msgr2=0x7fbc0c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:06.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.721+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 shutdown_connections 2024-09-10T22:15:06.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:06.721+0000 7fbc11ae1640 1 -- 172.21.15.5:0/4094431154 wait complete. 2024-09-10T22:15:07.450 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-10T22:15:07.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:07 smithi189 ceph-mon[35784]: pgmap v292: 97 pgs: 10 creating+peering, 13 unknown, 74 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2024-09-10T22:15:07.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:07 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/4094431154' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:07.708 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:07.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:07 smithi052 ceph-mon[34997]: pgmap v292: 97 pgs: 10 creating+peering, 13 unknown, 74 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2024-09-10T22:15:07.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:07 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/4094431154' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:07.750 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:15:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: 2024-09-10T22:15:07.548+0000 7fd6bbd36640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T22:15:07.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:07 smithi005 ceph-mon[31115]: pgmap v292: 97 pgs: 10 creating+peering, 13 unknown, 74 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 3 op/s 2024-09-10T22:15:07.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:07 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4094431154' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:08.299 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 -- 172.21.15.5:0/1534351067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b81076e0 msgr2=0x7f32b8107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 --2- 172.21.15.5:0/1534351067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b81076e0 0x7f32b8107b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009900 tx=0x7f32ac02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 -- 172.21.15.5:0/1534351067 shutdown_connections 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 --2- 172.21.15.5:0/1534351067 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b8108060 0x7f32b810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 --2- 172.21.15.5:0/1534351067 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b81076e0 0x7f32b8107b20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 --2- 172.21.15.5:0/1534351067 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b8101cd0 0x7f32b81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 -- 172.21.15.5:0/1534351067 >> 172.21.15.5:0/1534351067 conn(0x7f32b80fd700 msgr2=0x7f32b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 -- 172.21.15.5:0/1534351067 shutdown_connections 2024-09-10T22:15:08.300 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.298+0000 7f32be381640 1 -- 172.21.15.5:0/1534351067 wait complete. 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.299+0000 7f32be381640 1 Processor -- start 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.299+0000 7f32be381640 1 -- start start 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b8101cd0 0x7f32b819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b81076e0 0x7f32b819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 0x7f32b819ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8111d20 con 0x7f32b8108060 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8111ba0 con 0x7f32b81076e0 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8111ea0 con 0x7f32b8101cd0 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 0x7f32b819ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 0x7f32b819ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33888/0 (socket says 172.21.15.5:33888) 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 -- 172.21.15.5:0/14491623 learned_addr learned my addr 172.21.15.5:0/14491623 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32b7fff640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b8101cd0 0x7f32b819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32b77fe640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b81076e0 0x7f32b819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 -- 172.21.15.5:0/14491623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b8101cd0 msgr2=0x7f32b819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b8101cd0 0x7f32b819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 -- 172.21.15.5:0/14491623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b81076e0 msgr2=0x7f32b819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b81076e0 0x7f32b819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 -- 172.21.15.5:0/14491623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b81a5490 con 0x7f32b8108060 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32bc91e640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 0x7f32b819ab50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f32b000eaa0 tx=0x7f32b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b000cdb0 con 0x7f32b8108060 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32b0005020 con 0x7f32b8108060 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b81a5780 con 0x7f32b8108060 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.300+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b00116d0 con 0x7f32b8108060 2024-09-10T22:15:08.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.301+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b81a5c90 con 0x7f32b8108060 2024-09-10T22:15:08.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.301+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b81020b0 con 0x7f32b8108060 2024-09-10T22:15:08.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.304+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f32b000f040 con 0x7f32b8108060 2024-09-10T22:15:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.304+0000 7f32b57fa640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f32a00b52e0 0x7f32a00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.305+0000 7f32b7fff640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f32a00b52e0 0x7f32a00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.305+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f32b00e5cc0 con 0x7f32b8108060 2024-09-10T22:15:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.305+0000 7f32b7fff640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f32a00b52e0 0x7f32a00b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f32a80058c0 tx=0x7f32a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:08.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.308+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f32b0016030 con 0x7f32b8108060 2024-09-10T22:15:08.535 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:08.534+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f32b81a60f0 con 0x7f32b8108060 2024-09-10T22:15:09.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.356+0000 7f32b57fa640 1 -- 172.21.15.5:0/14491623 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f32b00accb0 con 0x7f32b8108060 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f32a00b52e0 msgr2=0x7f32a00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f32a00b52e0 0x7f32a00b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f32a80058c0 tx=0x7f32a800a2d0 comp rx=0 tx=0).stop 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 msgr2=0x7f32b819ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 0x7f32b819ab50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f32b000eaa0 tx=0x7f32b000ef60 comp rx=0 tx=0).stop 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 shutdown_connections 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f32a00b52e0 0x7f32a00b77a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:09.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f32b8108060 0x7f32b819ab50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32b81076e0 0x7f32b819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.359+0000 7f32be381640 1 --2- 172.21.15.5:0/14491623 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32b8101cd0 0x7f32b819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.360+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 >> 172.21.15.5:0/14491623 conn(0x7f32b80fd700 msgr2=0x7f32b80ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.360+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 shutdown_connections 2024-09-10T22:15:09.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:09.360+0000 7f32be381640 1 -- 172.21.15.5:0/14491623 wait complete. 2024-09-10T22:15:09.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:09 smithi005 ceph-mon[31115]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T22:15:09.669 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:09 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/14491623' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T22:15:09.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:09 smithi189 ceph-mon[35784]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T22:15:09.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:09 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/14491623' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T22:15:09.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:09 smithi052 ceph-mon[34997]: pgmap v293: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 6 op/s 2024-09-10T22:15:09.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:09 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/14491623' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-10T22:15:10.022 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-10T22:15:10.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-10T22:15:10.287 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:10.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:10 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/14491623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T22:15:10.649 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:10 smithi005 ceph-mon[31115]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:10.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:10 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/14491623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T22:15:10.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:10 smithi189 ceph-mon[35784]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:10.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:10 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/14491623' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-10T22:15:10.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:10 smithi052 ceph-mon[34997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 -- 172.21.15.5:0/2458193272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 msgr2=0x7fed2c10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2458193272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c10f950 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fed24009ca0 tx=0x7fed2402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:10.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 -- 172.21.15.5:0/2458193272 shutdown_connections 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2458193272 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c10f950 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2458193272 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c1087d0 0x7fed2c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2458193272 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed2c102dc0 0x7fed2c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 -- 172.21.15.5:0/2458193272 >> 172.21.15.5:0/2458193272 conn(0x7fed2c0fe830 msgr2=0x7fed2c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 -- 172.21.15.5:0/2458193272 shutdown_connections 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.733+0000 7fed31ae5640 1 -- 172.21.15.5:0/2458193272 wait complete. 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 Processor -- start 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 -- start start 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c102dc0 0x7fed2c199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed2c1087d0 0x7fed2c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c19eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c112e10 con 0x7fed2c109150 2024-09-10T22:15:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c112c90 con 0x7fed2c1087d0 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.734+0000 7fed31ae5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fed2c112f90 con 0x7fed2c102dc0 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c19eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c19eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:33904/0 (socket says 172.21.15.5:33904) 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 -- 172.21.15.5:0/2481233154 learned_addr learned my addr 172.21.15.5:0/2481233154 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2b7fe640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c102dc0 0x7fed2c199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed22ffd640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed2c1087d0 0x7fed2c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 -- 172.21.15.5:0/2481233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c102dc0 msgr2=0x7fed2c199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c102dc0 0x7fed2c199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 -- 172.21.15.5:0/2481233154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed2c1087d0 msgr2=0x7fed2c199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed2c1087d0 0x7fed2c199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 -- 172.21.15.5:0/2481233154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed2c19f2d0 con 0x7fed2c109150 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2b7fe640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c102dc0 0x7fed2c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:10.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed2bfff640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c19eb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fed24005cc0 tx=0x7fed2402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed24003cf0 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed240044f0 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2402fc30 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed2c19f560 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.735+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed2c1a5d00 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.736+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed2c1031a0 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.739+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fed24004040 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.739+0000 7fed297fa640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fed180b5360 0x7fed180b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.739+0000 7fed2b7fe640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fed180b5360 0x7fed180b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.740+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7fed24107090 con 0x7fed2c109150 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.740+0000 7fed2b7fe640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fed180b5360 0x7fed180b7820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00abe0 tx=0x7fed1c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:10.753 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.743+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fed240ce0a0 con 0x7fed2c109150 2024-09-10T22:15:10.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:10.969+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fed2c02e5c0 con 0x7fed2c109150 2024-09-10T22:15:11.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.372+0000 7fed297fa640 1 -- 172.21.15.5:0/2481233154 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fed240cd9a0 con 0x7fed2c109150 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fed180b5360 msgr2=0x7fed180b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fed180b5360 0x7fed180b7820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00abe0 tx=0x7fed1c00a5c0 comp rx=0 tx=0).stop 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 msgr2=0x7fed2c19eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c19eb00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fed24005cc0 tx=0x7fed2402f470 comp rx=0 tx=0).stop 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 shutdown_connections 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fed180b5360 0x7fed180b7820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fed2c109150 0x7fed2c19eb00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fed2c1087d0 0x7fed2c199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 --2- 172.21.15.5:0/2481233154 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fed2c102dc0 0x7fed2c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 >> 172.21.15.5:0/2481233154 conn(0x7fed2c0fe830 msgr2=0x7fed2c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 shutdown_connections 2024-09-10T22:15:11.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:11.375+0000 7fed31ae5640 1 -- 172.21.15.5:0/2481233154 wait complete. 2024-09-10T22:15:11.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:11 smithi189 ceph-mon[35784]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T22:15:11.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:11 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2481233154' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T22:15:11.713 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:11 smithi005 ceph-mon[31115]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T22:15:11.713 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:11 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2481233154' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T22:15:11.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:11 smithi052 ceph-mon[34997]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-10T22:15:11.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:11 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2481233154' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-10T22:15:12.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-10T22:15:12.315 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:12.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:12 smithi189 ceph-mon[35784]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T22:15:12.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:12 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2481233154' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T22:15:12.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:12 smithi189 ceph-mon[35784]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T22:15:12.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:12 smithi189 ceph-mon[35784]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:12.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:12 smithi189 ceph-mon[35784]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T22:15:12.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:12 smithi189 ceph-mon[35784]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T22:15:12.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:12 smithi005 ceph-mon[31115]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T22:15:12.720 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:12 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2481233154' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T22:15:12.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:12 smithi005 ceph-mon[31115]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T22:15:12.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:12 smithi005 ceph-mon[31115]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:12.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:12 smithi005 ceph-mon[31115]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T22:15:12.721 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:12 smithi005 ceph-mon[31115]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T22:15:12.749 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: 2024-09-10T22:15:12.548+0000 7fd6bbd36640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-10T22:15:12.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-mon[34997]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-10T22:15:12.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2481233154' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-10T22:15:12.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-mon[34997]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-10T22:15:12.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-mon[34997]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-10T22:15:12.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-mon[34997]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-10T22:15:12.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:12 smithi052 ceph-mon[34997]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-10T22:15:12.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 -- 172.21.15.5:0/2895023080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc104600 msgr2=0x7fa8fc10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2895023080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc104600 0x7fa8fc10caf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009900 tx=0x7fa8f002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 -- 172.21.15.5:0/2895023080 shutdown_connections 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2895023080 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc10d140 0x7fa8fc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2895023080 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc104600 0x7fa8fc10caf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2895023080 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 -- 172.21.15.5:0/2895023080 >> 172.21.15.5:0/2895023080 conn(0x7fa8fc0fd720 msgr2=0x7fa8fc0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.804+0000 7fa9028fd640 1 -- 172.21.15.5:0/2895023080 shutdown_connections 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.805+0000 7fa9028fd640 1 -- 172.21.15.5:0/2895023080 wait complete. 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.805+0000 7fa9028fd640 1 Processor -- start 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.805+0000 7fa9028fd640 1 -- start start 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa9028fd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa9028fd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc104600 0x7fa8fc199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:12.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa9028fd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc10d140 0x7fa8fc19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa9028fd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc112df0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa9028fd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc112c70 con 0x7fa8fc10d140 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa9028fd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8fc112f70 con 0x7fa8fc104600 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60224/0 (socket says 172.21.15.5:60224) 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 -- 172.21.15.5:0/2798094144 learned_addr learned my addr 172.21.15.5:0/2798094144 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fb7fe640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc104600 0x7fa8fc199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa900e9a640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc10d140 0x7fa8fc19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 -- 172.21.15.5:0/2798094144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc104600 msgr2=0x7fa8fc199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc104600 0x7fa8fc199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 -- 172.21.15.5:0/2798094144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc10d140 msgr2=0x7fa8fc19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc10d140 0x7fa8fc19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 -- 172.21.15.5:0/2798094144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8fc19f3f0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fb7fe640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc104600 0x7fa8fc199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa900e9a640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc10d140 0x7fa8fc19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.806+0000 7fa8fbfff640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc199340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00c890 tx=0x7fa8ec00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.807+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec004220 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.807+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8ec0043c0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.807+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8fc19f6e0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.807+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ec004a00 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.807+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8fc1a5e20 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.808+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8fc1040c0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.809+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fa8ec0079b0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.810+0000 7fa8f97fa640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8e40b52e0 0x7fa8e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.810+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7fa8ec0e5cd0 con 0x7fa8fc103ce0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.810+0000 7fa8fb7fe640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8e40b52e0 0x7fa8e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.810+0000 7fa8fb7fe640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8e40b52e0 0x7fa8e40b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0005ab0 tx=0x7fa8f0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:12.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:12.813+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa8ec014030 con 0x7fa8fc103ce0 2024-09-10T22:15:13.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.039+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fa8fc02e5c0 con 0x7fa8fc103ce0 2024-09-10T22:15:13.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.392+0000 7fa8f97fa640 1 -- 172.21.15.5:0/2798094144 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fa8ec0acce0 con 0x7fa8fc103ce0 2024-09-10T22:15:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.394+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8e40b52e0 msgr2=0x7fa8e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:13.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.394+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8e40b52e0 0x7fa8e40b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0005ab0 tx=0x7fa8f0031400 comp rx=0 tx=0).stop 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.394+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 msgr2=0x7fa8fc199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.394+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc199340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec00c890 tx=0x7fa8ec00cd50 comp rx=0 tx=0).stop 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 shutdown_connections 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8e40b52e0 0x7fa8e40b77a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8fc10d140 0x7fa8fc19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8fc104600 0x7fa8fc199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 --2- 172.21.15.5:0/2798094144 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8fc103ce0 0x7fa8fc199340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 >> 172.21.15.5:0/2798094144 conn(0x7fa8fc0fd720 msgr2=0x7fa8fc0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 shutdown_connections 2024-09-10T22:15:13.397 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:13.395+0000 7fa9028fd640 1 -- 172.21.15.5:0/2798094144 wait complete. 2024-09-10T22:15:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-10T22:15:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] up:active 2024-09-10T22:15:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T22:15:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: Cluster is now healthy 2024-09-10T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T22:15:13.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:13 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2798094144' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] up:active 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: Cluster is now healthy 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T22:15:13.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:13 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2798094144' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T22:15:13.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-10T22:15:13.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] up:active 2024-09-10T22:15:13.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-10T22:15:13.766 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-10T22:15:13.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: Cluster is now healthy 2024-09-10T22:15:13.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-10T22:15:13.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-10T22:15:13.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-10T22:15:13.767 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:13 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2798094144' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-10T22:15:14.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-10T22:15:14.383 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:14.663 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:14 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2798094144' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T22:15:14.663 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:14 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] up:active 2024-09-10T22:15:14.663 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:14 smithi005 ceph-mon[31115]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T22:15:14.663 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:14 smithi005 ceph-mon[31115]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:15:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:14 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2798094144' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T22:15:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:14 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] up:active 2024-09-10T22:15:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:14 smithi189 ceph-mon[35784]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T22:15:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:14 smithi189 ceph-mon[35784]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:15:14.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:14 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2798094144' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-10T22:15:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:14 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] up:active 2024-09-10T22:15:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:14 smithi052 ceph-mon[34997]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-10T22:15:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:14 smithi052 ceph-mon[34997]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.838+0000 7fe7dfb61640 1 -- 172.21.15.5:0/3755834938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075e60 msgr2=0x7fe7d81135e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.838+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/3755834938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075e60 0x7fe7d81135e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009900 tx=0x7fe7c802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 -- 172.21.15.5:0/3755834938 shutdown_connections 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/3755834938 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8113b20 0x7fe7d8115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/3755834938 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075e60 0x7fe7d81135e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/3755834938 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075540 0x7fe7d8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:14.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 -- 172.21.15.5:0/3755834938 >> 172.21.15.5:0/3755834938 conn(0x7fe7d80fe830 msgr2=0x7fe7d8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 -- 172.21.15.5:0/3755834938 shutdown_connections 2024-09-10T22:15:14.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 -- 172.21.15.5:0/3755834938 wait complete. 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 Processor -- start 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.839+0000 7fe7dfb61640 1 -- start start 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 0x7fe7d819f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075e60 0x7fe7d819fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8113b20 0x7fe7d81a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d81193a0 con 0x7fe7d8075540 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8119220 con 0x7fe7d8075e60 2024-09-10T22:15:14.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d8119520 con 0x7fe7d8113b20 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 0x7fe7d819f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 0x7fe7d819f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60232/0 (socket says 172.21.15.5:60232) 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 -- 172.21.15.5:0/2420630900 learned_addr learned my addr 172.21.15.5:0/2420630900 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd0fc640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075e60 0x7fe7d819fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7de0fe640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8113b20 0x7fe7d81a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 -- 172.21.15.5:0/2420630900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8113b20 msgr2=0x7fe7d81a5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8113b20 0x7fe7d81a5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 -- 172.21.15.5:0/2420630900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075e60 msgr2=0x7fe7d819fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075e60 0x7fe7d819fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 -- 172.21.15.5:0/2420630900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d81a5a00 con 0x7fe7d8075540 2024-09-10T22:15:14.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd0fc640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075e60 0x7fe7d819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dd8fd640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 0x7fe7d819f950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d950 tx=0x7fe7d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d4017070 con 0x7fe7d8075540 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d81a5cf0 con 0x7fe7d8075540 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7d4009c30 con 0x7fe7d8075540 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.840+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d400f620 con 0x7fe7d8075540 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.841+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d81ac580 con 0x7fe7d8075540 2024-09-10T22:15:14.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.841+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d8076a50 con 0x7fe7d8075540 2024-09-10T22:15:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.843+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7fe7d4010460 con 0x7fe7d8075540 2024-09-10T22:15:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.844+0000 7fe7ceffd640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe7c40b52e0 0x7fe7c40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.844+0000 7fe7dd0fc640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe7c40b52e0 0x7fe7c40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.844+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7fe7d40e5740 con 0x7fe7d8075540 2024-09-10T22:15:14.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.844+0000 7fe7dd0fc640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe7c40b52e0 0x7fe7c40b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8031440 tx=0x7fe7c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:14.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:14.847+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe7d40ac750 con 0x7fe7d8075540 2024-09-10T22:15:15.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.073+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe7d81ac750 con 0x7fe7d8075540 2024-09-10T22:15:15.405 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.402+0000 7fe7ceffd640 1 -- 172.21.15.5:0/2420630900 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7fe7d4009de0 con 0x7fe7d8075540 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe7c40b52e0 msgr2=0x7fe7c40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe7c40b52e0 0x7fe7c40b77a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8031440 tx=0x7fe7c8005a20 comp rx=0 tx=0).stop 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 msgr2=0x7fe7d819f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 0x7fe7d819f950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe7d400d950 tx=0x7fe7d400de10 comp rx=0 tx=0).stop 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 shutdown_connections 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe7c40b52e0 0x7fe7c40b77a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe7d8113b20 0x7fe7d81a5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe7d8075e60 0x7fe7d819fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 --2- 172.21.15.5:0/2420630900 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe7d8075540 0x7fe7d819f950 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 >> 172.21.15.5:0/2420630900 conn(0x7fe7d80fe830 msgr2=0x7fe7d80ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:15.408 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 shutdown_connections 2024-09-10T22:15:15.409 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:15.405+0000 7fe7dfb61640 1 -- 172.21.15.5:0/2420630900 wait complete. 2024-09-10T22:15:15.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:15 smithi189 ceph-mon[35784]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T22:15:15.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:15 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2420630900' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T22:15:15.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:15 smithi052 ceph-mon[34997]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T22:15:15.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:15 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2420630900' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T22:15:15.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:15 smithi005 ceph-mon[31115]: pgmap v296: 97 pgs: 97 active+clean; 579 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-10T22:15:15.777 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:15 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2420630900' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-10T22:15:16.232 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-10T22:15:16.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-10T22:15:16.498 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:16.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:16 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2420630900' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T22:15:16.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:16 smithi005 ceph-mon[31115]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:15:16.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:16 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2420630900' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T22:15:16.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:16 smithi189 ceph-mon[35784]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:15:16.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:16 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2420630900' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-10T22:15:16.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:16 smithi052 ceph-mon[34997]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 -- 172.21.15.5:0/3372363466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 msgr2=0x7f3894104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3372363466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894104080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f388c009900 tx=0x7f388c02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 -- 172.21.15.5:0/3372363466 shutdown_connections 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3372363466 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 0x7f389410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3372363466 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38941045c0 0x7f389410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3372363466 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894104080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:16.984 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 -- 172.21.15.5:0/3372363466 >> 172.21.15.5:0/3372363466 conn(0x7f38940fd700 msgr2=0x7f38940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 -- 172.21.15.5:0/3372363466 shutdown_connections 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 -- 172.21.15.5:0/3372363466 wait complete. 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 Processor -- start 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.948+0000 7f389c7f7640 1 -- start start 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38941045c0 0x7f38941997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 0x7f389419eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3894112d70 con 0x7f3894103ca0 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3894112bf0 con 0x7f38941045c0 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3894112ef0 con 0x7f389410d100 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60260/0 (socket says 172.21.15.5:60260) 2024-09-10T22:15:16.985 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 -- 172.21.15.5:0/3810663219 learned_addr learned my addr 172.21.15.5:0/3810663219 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f3899d92640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38941045c0 0x7f38941997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389ad94640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 0x7f389419eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 -- 172.21.15.5:0/3810663219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 msgr2=0x7f389419eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 0x7f389419eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 -- 172.21.15.5:0/3810663219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38941045c0 msgr2=0x7f38941997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38941045c0 0x7f38941997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 -- 172.21.15.5:0/3810663219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389419f330 con 0x7f3894103ca0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389ad94640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 0x7f389419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389a593640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894199280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f388c005940 tx=0x7f388c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c03f030 con 0x7f3894103ca0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f388c003cb0 con 0x7f3894103ca0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c035070 con 0x7f3894103ca0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389419f5c0 con 0x7f3894103ca0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.949+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38941a5ce0 con 0x7f3894103ca0 2024-09-10T22:15:16.986 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.950+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3894104080 con 0x7f3894103ca0 2024-09-10T22:15:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.952+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 16) ==== 153249+0+0 (secure 0 0 0) 0x7f388c03bbf0 con 0x7f3894103ca0 2024-09-10T22:15:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.953+0000 7f38937fe640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f387c0b52e0 0x7f387c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.953+0000 7f3899d92640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f387c0b52e0 0x7f387c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.953+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f388c106960 con 0x7f3894103ca0 2024-09-10T22:15:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.953+0000 7f3899d92640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f387c0b52e0 0x7f387c0b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f389410f800 tx=0x7f388800b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:16.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:16.956+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f388c0cd8d0 con 0x7f3894103ca0 2024-09-10T22:15:17.170 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.168+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3894108150 con 0x7f387c0b52e0 2024-09-10T22:15:17.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.192+0000 7f38937fe640 1 -- 172.21.15.5:0/3810663219 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3894108150 con 0x7f387c0b52e0 2024-09-10T22:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f387c0b52e0 msgr2=0x7f387c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f387c0b52e0 0x7f387c0b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f389410f800 tx=0x7f388800b2e0 comp rx=0 tx=0).stop 2024-09-10T22:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 msgr2=0x7f3894199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:17.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894199280 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f388c005940 tx=0x7f388c0042f0 comp rx=0 tx=0).stop 2024-09-10T22:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 shutdown_connections 2024-09-10T22:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f387c0b52e0 0x7f387c0b77a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f389410d100 0x7f389419eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f38941045c0 0x7f38941997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 --2- 172.21.15.5:0/3810663219 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3894103ca0 0x7f3894199280 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:17.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 >> 172.21.15.5:0/3810663219 conn(0x7f38940fd700 msgr2=0x7f38940fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 shutdown_connections 2024-09-10T22:15:17.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:17.195+0000 7f389c7f7640 1 -- 172.21.15.5:0/3810663219 wait complete. 2024-09-10T22:15:17.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:17 smithi005 ceph-mon[31115]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-10T22:15:17.582 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:15:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:15:17.173+0000 7f9c2e4a4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:15:17.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:15:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:15:17.173+0000 7f9c2e4a4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:15:17.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:15:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:15:17.173+0000 7f9c2e4a4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:15:17.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:15:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:15:17.173+0000 7f9c2e4a4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:15:17.583 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:15:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:15:17.173+0000 7f9c2e4a4640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T22:15:17.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:17 smithi189 ceph-mon[35784]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-10T22:15:17.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:17 smithi052 ceph-mon[34997]: pgmap v297: 97 pgs: 97 active+clean; 581 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-10T22:15:18.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-10T22:15:18.448 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:18.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:18 smithi189 ceph-mon[35784]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:18.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:18 smithi052 ceph-mon[34997]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:18.761 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:18 smithi005 ceph-mon[31115]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 -- 172.21.15.5:0/3962113377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc10d120 msgr2=0x7efecc10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:19.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 --2- 172.21.15.5:0/3962113377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc10d120 0x7efecc10f550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efec4009ca0 tx=0x7efec402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 -- 172.21.15.5:0/3962113377 shutdown_connections 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 --2- 172.21.15.5:0/3962113377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc10d120 0x7efecc10f550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 --2- 172.21.15.5:0/3962113377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 0x7efecc10cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 --2- 172.21.15.5:0/3962113377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc103b70 0x7efecc103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 -- 172.21.15.5:0/3962113377 >> 172.21.15.5:0/3962113377 conn(0x7efecc0fd700 msgr2=0x7efecc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 -- 172.21.15.5:0/3962113377 shutdown_connections 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 -- 172.21.15.5:0/3962113377 wait complete. 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.079+0000 7efed204d640 1 Processor -- start 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 -- start start 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 0x7efecc1019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 0x7efecc101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc10d120 0x7efecc102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:19.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efecc112d60 con 0x7efecc103b70 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efecc112be0 con 0x7efecc104570 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efed204d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efecc112ee0 con 0x7efecc10d120 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 0x7efecc1019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 0x7efecc1019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60302/0 (socket says 172.21.15.5:60302) 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 -- 172.21.15.5:0/3199058317 learned_addr learned my addr 172.21.15.5:0/3199058317 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecaffd640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 0x7efecc101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecbfff640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc10d120 0x7efecc102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 -- 172.21.15.5:0/3199058317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc10d120 msgr2=0x7efecc102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc10d120 0x7efecc102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 -- 172.21.15.5:0/3199058317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 msgr2=0x7efecc101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 0x7efecc101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 -- 172.21.15.5:0/3199058317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc1a75f0 con 0x7efecc103b70 2024-09-10T22:15:19.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecbfff640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc10d120 0x7efecc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecaffd640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 0x7efecc101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.080+0000 7efecb7fe640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 0x7efecc1019f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efebc00d770 tx=0x7efebc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.081+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc017070 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.081+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efecc1a78e0 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.081+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efebc0054d0 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.081+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc004c30 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.081+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efecc1a7dd0 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.082+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efecc103f50 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.083+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7efebc004dd0 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.084+0000 7efec8ff9640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efeb40b5370 0x7efeb40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.084+0000 7efecaffd640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efeb40b5370 0x7efeb40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.084+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7efebc0e5c40 con 0x7efecc103b70 2024-09-10T22:15:19.114 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.084+0000 7efecaffd640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efeb40b5370 0x7efeb40b7830 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efecc1034e0 tx=0x7efec0005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:19.115 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.087+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efebc0aca50 con 0x7efecc103b70 2024-09-10T22:15:19.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.299+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efecc0ff310 con 0x7efeb40b5370 2024-09-10T22:15:19.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.326+0000 7efec8ff9640 1 -- 172.21.15.5:0/3199058317 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efecc0ff310 con 0x7efeb40b5370 2024-09-10T22:15:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efeb40b5370 msgr2=0x7efeb40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:19.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efeb40b5370 0x7efeb40b7830 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efecc1034e0 tx=0x7efec0005ec0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 msgr2=0x7efecc1019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 0x7efecc1019f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efebc00d770 tx=0x7efebc00dc30 comp rx=0 tx=0).stop 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 shutdown_connections 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efeb40b5370 0x7efeb40b7830 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efecc10d120 0x7efecc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efecc104570 0x7efecc101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 --2- 172.21.15.5:0/3199058317 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efecc103b70 0x7efecc1019f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 >> 172.21.15.5:0/3199058317 conn(0x7efecc0fd700 msgr2=0x7efecc10f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 shutdown_connections 2024-09-10T22:15:19.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:19.328+0000 7efed204d640 1 -- 172.21.15.5:0/3199058317 wait complete. 2024-09-10T22:15:19.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:19 smithi005 ceph-mon[31115]: pgmap v298: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T22:15:19.689 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:19 smithi005 ceph-mon[31115]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T22:15:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:19 smithi189 ceph-mon[35784]: pgmap v298: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T22:15:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:19 smithi189 ceph-mon[35784]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T22:15:19.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:19 smithi052 ceph-mon[34997]: pgmap v298: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2024-09-10T22:15:19.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:19 smithi052 ceph-mon[34997]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-10T22:15:20.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-10T22:15:20.356 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:20.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:20 smithi189 ceph-mon[35784]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:20.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:20 smithi052 ceph-mon[34997]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:20.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:20 smithi005 ceph-mon[31115]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:20.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.940+0000 7f4b3937b640 1 -- 172.21.15.5:0/2490219737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34104600 msgr2=0x7f4b3410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.940+0000 7f4b3937b640 1 --2- 172.21.15.5:0/2490219737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34104600 0x7f4b3410caf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009900 tx=0x7f4b2802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 -- 172.21.15.5:0/2490219737 shutdown_connections 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 --2- 172.21.15.5:0/2490219737 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b3410d140 0x7f4b3410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 --2- 172.21.15.5:0/2490219737 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b34104600 0x7f4b3410caf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 --2- 172.21.15.5:0/2490219737 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b34103ce0 0x7f4b341040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 -- 172.21.15.5:0/2490219737 >> 172.21.15.5:0/2490219737 conn(0x7f4b340fd700 msgr2=0x7f4b340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 -- 172.21.15.5:0/2490219737 shutdown_connections 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 -- 172.21.15.5:0/2490219737 wait complete. 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 Processor -- start 2024-09-10T22:15:20.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.941+0000 7f4b3937b640 1 -- start start 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b3937b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b34103ce0 0x7f4b34199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b3937b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b34104600 0x7f4b341998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b3937b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 0x7f4b3419ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b3937b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4b34112df0 con 0x7f4b3410d140 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b3937b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4b34112c70 con 0x7f4b34103ce0 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b3937b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4b34112f70 con 0x7f4b34104600 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 0x7f4b3419ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:20.946 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 0x7f4b3419ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:60316/0 (socket says 172.21.15.5:60316) 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b32ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b34103ce0 0x7f4b34199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 -- 172.21.15.5:0/956703840 learned_addr learned my addr 172.21.15.5:0/956703840 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b327fc640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b34104600 0x7f4b341998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 -- 172.21.15.5:0/956703840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b34104600 msgr2=0x7f4b341998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b34104600 0x7f4b341998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 -- 172.21.15.5:0/956703840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b34103ce0 msgr2=0x7f4b34199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b34103ce0 0x7f4b34199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 -- 172.21.15.5:0/956703840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3419f410 con 0x7f4b3410d140 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b337fe640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 0x7f4b3419ec40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00eaa0 tx=0x7f4b2c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.942+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c004d20 con 0x7f4b3410d140 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.943+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b2c005020 con 0x7f4b3410d140 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.943+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3419f700 con 0x7f4b3410d140 2024-09-10T22:15:20.947 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.943+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0116b0 con 0x7f4b3410d140 2024-09-10T22:15:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.943+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b341a5e40 con 0x7f4b3410d140 2024-09-10T22:15:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.944+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b341040c0 con 0x7f4b3410d140 2024-09-10T22:15:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.945+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f4b2c00f040 con 0x7f4b3410d140 2024-09-10T22:15:20.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.946+0000 7f4b1bfff640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4b1c0b53f0 0x7f4b1c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.946+0000 7f4b32ffd640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4b1c0b53f0 0x7f4b1c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.946+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f4b2c0e5a90 con 0x7f4b3410d140 2024-09-10T22:15:20.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.946+0000 7f4b32ffd640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4b1c0b53f0 0x7f4b1c0b78b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009990 tx=0x7f4b24009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:20.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:20.950+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4b2c016030 con 0x7f4b3410d140 2024-09-10T22:15:21.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.163+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f4b340ffa20 con 0x7f4b1c0b53f0 2024-09-10T22:15:21.171 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.169+0000 7f4b1bfff640 1 -- 172.21.15.5:0/956703840 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4b340ffa20 con 0x7f4b1c0b53f0 2024-09-10T22:15:21.171 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/qa/sv_0/3712287d-26d8-41ff-ae0a-49bf92320128 2024-09-10T22:15:21.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4b1c0b53f0 msgr2=0x7f4b1c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4b1c0b53f0 0x7f4b1c0b78b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009990 tx=0x7f4b24009110 comp rx=0 tx=0).stop 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 msgr2=0x7f4b3419ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 0x7f4b3419ec40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c00eaa0 tx=0x7f4b2c00eea0 comp rx=0 tx=0).stop 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 shutdown_connections 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4b1c0b53f0 0x7f4b1c0b78b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4b3410d140 0x7f4b3419ec40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4b34104600 0x7f4b341998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 --2- 172.21.15.5:0/956703840 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4b34103ce0 0x7f4b34199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 >> 172.21.15.5:0/956703840 conn(0x7f4b340fd700 msgr2=0x7f4b340fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 shutdown_connections 2024-09-10T22:15:21.174 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:21.171+0000 7f4b3937b640 1 -- 172.21.15.5:0/956703840 wait complete. 2024-09-10T22:15:21.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:21 smithi189 ceph-mon[35784]: pgmap v299: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-10T22:15:21.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:21 smithi052 ceph-mon[34997]: pgmap v299: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-10T22:15:21.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:21 smithi005 ceph-mon[31115]: pgmap v299: 97 pgs: 97 active+clean; 582 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-10T22:15:21.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-10T22:15:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:22.580 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:22 smithi005 ceph-mon[31115]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 -- 172.21.15.5:0/3858134187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 msgr2=0x7f2cc41031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/3858134187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41031c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009900 tx=0x7f2cb402a410 comp rx=0 tx=0).stop 2024-09-10T22:15:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 -- 172.21.15.5:0/3858134187 shutdown_connections 2024-09-10T22:15:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/3858134187 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc4109170 0x7f2cc410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/3858134187 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc41087f0 0x7f2cc4108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.586 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/3858134187 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41031c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 -- 172.21.15.5:0/3858134187 >> 172.21.15.5:0/3858134187 conn(0x7f2cc40fe830 msgr2=0x7f2cc4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 -- 172.21.15.5:0/3858134187 shutdown_connections 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 -- 172.21.15.5:0/3858134187 wait complete. 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 Processor -- start 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 -- start start 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.582+0000 7f2cc9e60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc9e60640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41087f0 0x7f2cc4199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc9e60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4109170 0x7f2cc419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc9e60640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4112e80 con 0x7f2cc4102de0 2024-09-10T22:15:22.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58890/0 (socket says 172.21.15.5:58890) 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc37fe640 1 -- 172.21.15.5:0/2470830949 learned_addr learned my addr 172.21.15.5:0/2470830949 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4112d00 con 0x7f2cc4109170 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4113000 con 0x7f2cc41087f0 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4109170 0x7f2cc419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cbbfff640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41087f0 0x7f2cc4199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 -- 172.21.15.5:0/2470830949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41087f0 msgr2=0x7f2cc4199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:22.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41087f0 0x7f2cc4199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 -- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 msgr2=0x7f2cc41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc419f3a0 con 0x7f2cc4109170 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc37fe640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc3fff640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4109170 0x7f2cc419ebd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00be20 tx=0x7f2cbc00bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc019070 con 0x7f2cc4109170 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.583+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cbc0148f0 con 0x7f2cc4109170 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.584+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc419f690 con 0x7f2cc4109170 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.584+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc012840 con 0x7f2cc4109170 2024-09-10T22:15:22.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.584+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc41a5dd0 con 0x7f2cc4109170 2024-09-10T22:15:22.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.585+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc41031c0 con 0x7f2cc4109170 2024-09-10T22:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.586+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f2cbc014440 con 0x7f2cc4109170 2024-09-10T22:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.587+0000 7f2cc17fa640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2cb00b5370 0x7f2cb00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.587+0000 7f2cc37fe640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2cb00b5370 0x7f2cb00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.587+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f2cbc0e5640 con 0x7f2cc4109170 2024-09-10T22:15:22.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.587+0000 7f2cc37fe640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2cb00b5370 0x7f2cb00b7830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40096c0 tx=0x7f2cb4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:22.592 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.590+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2cbc0abe00 con 0x7f2cc4109170 2024-09-10T22:15:22.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:22 smithi189 ceph-mon[35784]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:22.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:22 smithi052 ceph-mon[34997]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:22.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.802+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2cc4063590 con 0x7f2cb00b5370 2024-09-10T22:15:22.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.824+0000 7f2cc17fa640 1 -- 172.21.15.5:0/2470830949 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2cc4063590 con 0x7f2cb00b5370 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2cb00b5370 msgr2=0x7f2cb00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2cb00b5370 0x7f2cb00b7830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40096c0 tx=0x7f2cb4005a20 comp rx=0 tx=0).stop 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4109170 msgr2=0x7f2cc419ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4109170 0x7f2cc419ebd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00be20 tx=0x7f2cbc00bf10 comp rx=0 tx=0).stop 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 shutdown_connections 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2cb00b5370 0x7f2cb00b7830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2cc4109170 0x7f2cc419ebd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2cc41087f0 0x7f2cc4199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 --2- 172.21.15.5:0/2470830949 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2cc4102de0 0x7f2cc41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:22.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 >> 172.21.15.5:0/2470830949 conn(0x7f2cc40fe830 msgr2=0x7f2cc40ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 shutdown_connections 2024-09-10T22:15:22.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:22.826+0000 7f2cc9e60640 1 -- 172.21.15.5:0/2470830949 wait complete. 2024-09-10T22:15:23.494 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:23 smithi005 ceph-mon[31115]: pgmap v300: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:15:23.527 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-10T22:15:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:23 smithi189 ceph-mon[35784]: pgmap v300: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:15:23.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:23 smithi052 ceph-mon[34997]: pgmap v300: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:15:23.787 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 -- 172.21.15.5:0/1411838435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00741087d0 msgr2=0x7f0074108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1411838435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00741087d0 0x7f0074108c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f005c009900 tx=0x7f005c02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 -- 172.21.15.5:0/1411838435 shutdown_connections 2024-09-10T22:15:24.257 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1411838435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074109150 0x7f007410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1411838435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f00741087d0 0x7f0074108c10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1411838435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0074102dc0 0x7f00741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 -- 172.21.15.5:0/1411838435 >> 172.21.15.5:0/1411838435 conn(0x7f00740fe830 msgr2=0x7f0074100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 -- 172.21.15.5:0/1411838435 shutdown_connections 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.232+0000 7f007a3d6640 1 -- 172.21.15.5:0/1411838435 wait complete. 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 Processor -- start 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 -- start start 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 0x7f00740754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00741087d0 0x7f00740759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074109150 0x7f0074075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f0073fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 0x7f00740754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f0073fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 0x7f00740754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58914/0 (socket says 172.21.15.5:58914) 2024-09-10T22:15:24.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0074112da0 con 0x7f0074102dc0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f0073fff640 1 -- 172.21.15.5:0/1642950788 learned_addr learned my addr 172.21.15.5:0/1642950788 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0074112c20 con 0x7f00741087d0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.233+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0074112f20 con 0x7f0074109150 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f006bfff640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00741087d0 0x7f00740759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0073fff640 1 -- 172.21.15.5:0/1642950788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074109150 msgr2=0x7f0074075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0073fff640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074109150 0x7f0074075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0073fff640 1 -- 172.21.15.5:0/1642950788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00741087d0 msgr2=0x7f00740759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0073fff640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00741087d0 0x7f00740759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0073fff640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00741a7690 con 0x7f0074102dc0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0073fff640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 0x7f00740754a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f006400d950 tx=0x7f006400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0064017070 con 0x7f0074102dc0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0064009c30 con 0x7f0074102dc0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00741a7980 con 0x7f0074102dc0 2024-09-10T22:15:24.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006400f620 con 0x7f0074102dc0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.234+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00741a7e90 con 0x7f0074102dc0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.235+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00741031a0 con 0x7f0074102dc0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.237+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f0064010460 con 0x7f0074102dc0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.237+0000 7f0071ffb640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00600b5370 0x7f00600b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.238+0000 7f006bfff640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00600b5370 0x7f00600b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.238+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f00640e5900 con 0x7f0074102dc0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.238+0000 7f006bfff640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00600b5370 0x7f00600b7830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f005c031440 tx=0x7f005c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:24.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.242+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f00640ac810 con 0x7f0074102dc0 2024-09-10T22:15:24.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.458+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0074063590 con 0x7f00600b5370 2024-09-10T22:15:24.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.464+0000 7f0071ffb640 1 -- 172.21.15.5:0/1642950788 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0074063590 con 0x7f00600b5370 2024-09-10T22:15:24.466 INFO:teuthology.orchestra.run.smithi005.stdout:/volumes/qa/sv_1/f60be848-4c1e-4e67-8e02-bf5c10104255 2024-09-10T22:15:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00600b5370 msgr2=0x7f00600b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00600b5370 0x7f00600b7830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f005c031440 tx=0x7f005c0095f0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 msgr2=0x7f00740754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 0x7f00740754a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f006400d950 tx=0x7f006400de10 comp rx=0 tx=0).stop 2024-09-10T22:15:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 shutdown_connections 2024-09-10T22:15:24.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00600b5370 0x7f00600b7830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0074109150 0x7f0074075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f00741087d0 0x7f00740759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 --2- 172.21.15.5:0/1642950788 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0074102dc0 0x7f00740754a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 >> 172.21.15.5:0/1642950788 conn(0x7f00740fe830 msgr2=0x7f0074100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 shutdown_connections 2024-09-10T22:15:24.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:24.466+0000 7f007a3d6640 1 -- 172.21.15.5:0/1642950788 wait complete. 2024-09-10T22:15:24.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:24 smithi005 ceph-mon[31115]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:24.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:24 smithi189 ceph-mon[35784]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:24.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:24 smithi052 ceph-mon[34997]: from='client.24647 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:25.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:15:25.347 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:25.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:25 smithi189 ceph-mon[35784]: pgmap v301: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:15:25.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:25 smithi189 ceph-mon[35784]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:25.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:25 smithi005 ceph-mon[31115]: pgmap v301: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:15:25.724 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:25 smithi005 ceph-mon[31115]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:25.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:25 smithi052 ceph-mon[34997]: pgmap v301: 97 pgs: 97 active+clean; 602 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-10T22:15:25.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:25 smithi052 ceph-mon[34997]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 -- 172.21.15.5:0/3462219418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04701087d0 msgr2=0x7f0470108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 --2- 172.21.15.5:0/3462219418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04701087d0 0x7f0470108c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0458009900 tx=0x7f045802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 -- 172.21.15.5:0/3462219418 shutdown_connections 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 --2- 172.21.15.5:0/3462219418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470109150 0x7f047010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 --2- 172.21.15.5:0/3462219418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f04701087d0 0x7f0470108c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 --2- 172.21.15.5:0/3462219418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0470102dc0 0x7f04701031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 -- 172.21.15.5:0/3462219418 >> 172.21.15.5:0/3462219418 conn(0x7f04700fe830 msgr2=0x7f0470100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:25.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.804+0000 7f047585d640 1 -- 172.21.15.5:0/3462219418 shutdown_connections 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 -- 172.21.15.5:0/3462219418 wait complete. 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 Processor -- start 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 -- start start 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470102dc0 0x7f04701994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04701087d0 0x7f0470199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 0x7f047019edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0470112e50 con 0x7f0470109150 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0470112cd0 con 0x7f0470102dc0 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f047585d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0470112fd0 con 0x7f04701087d0 2024-09-10T22:15:25.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.805+0000 7f046f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 0x7f047019edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 0x7f047019edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58932/0 (socket says 172.21.15.5:58932) 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 -- 172.21.15.5:0/1151334444 learned_addr learned my addr 172.21.15.5:0/1151334444 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f0467fff640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04701087d0 0x7f0470199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046effd640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470102dc0 0x7f04701994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 -- 172.21.15.5:0/1151334444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04701087d0 msgr2=0x7f0470199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04701087d0 0x7f0470199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 -- 172.21.15.5:0/1151334444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470102dc0 msgr2=0x7f04701994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470102dc0 0x7f04701994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 -- 172.21.15.5:0/1151334444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047019f5a0 con 0x7f0470109150 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046effd640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470102dc0 0x7f04701994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:25.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f0467fff640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04701087d0 0x7f0470199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f046f7fe640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 0x7f047019edd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f046800b970 tx=0x7f046800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0468019070 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047019f890 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0468014440 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04680075d0 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.806+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04701a5f50 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.807+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0470103220 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.810+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f046800cb40 con 0x7f0470109150 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.810+0000 7f047485b640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f045c0b5370 0x7f045c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.810+0000 7f046effd640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f045c0b5370 0x7f045c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:25.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.810+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f04680e5990 con 0x7f0470109150 2024-09-10T22:15:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.811+0000 7f046effd640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f045c0b5370 0x7f045c0b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0460006fd0 tx=0x7f0460008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:25.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:25.813+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f04680ac7a0 con 0x7f0470109150 2024-09-10T22:15:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.034+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f047019a620 con 0x7f0470109150 2024-09-10T22:15:26.037 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.035+0000 7f047485b640 1 -- 172.21.15.5:0/1151334444 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7f04680ac0a0 con 0x7f0470109150 2024-09-10T22:15:26.038 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:26.038 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-10T22:15:15:399259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:15:15.075706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24562,24563,24578]},"id":1}]} 2024-09-10T22:15:26.038 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f045c0b5370 msgr2=0x7f045c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f045c0b5370 0x7f045c0b7830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0460006fd0 tx=0x7f0460008040 comp rx=0 tx=0).stop 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 msgr2=0x7f047019edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 0x7f047019edd0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f046800b970 tx=0x7f046800be30 comp rx=0 tx=0).stop 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 shutdown_connections 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f045c0b5370 0x7f045c0b7830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0470109150 0x7f047019edd0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f04701087d0 0x7f0470199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 --2- 172.21.15.5:0/1151334444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0470102dc0 0x7f04701994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 >> 172.21.15.5:0/1151334444 conn(0x7f04700fe830 msgr2=0x7f0470100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:26.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 shutdown_connections 2024-09-10T22:15:26.042 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:26.038+0000 7f047585d640 1 -- 172.21.15.5:0/1151334444 wait complete. 2024-09-10T22:15:26.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:26 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1151334444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:15:26.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:26 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1151334444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:15:26.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:15:26.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:26 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1151334444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:15:27.106 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:27.518 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:27 smithi005 ceph-mon[31115]: pgmap v302: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-10T22:15:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 -- 172.21.15.5:0/2183139817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075540 msgr2=0x7f24f8075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 --2- 172.21.15.5:0/2183139817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075540 0x7f24f8075920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f24e8009900 tx=0x7f24e802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 -- 172.21.15.5:0/2183139817 shutdown_connections 2024-09-10T22:15:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 --2- 172.21.15.5:0/2183139817 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f8113b20 0x7f24f8115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 --2- 172.21.15.5:0/2183139817 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075e60 0x7f24f81135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 --2- 172.21.15.5:0/2183139817 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075540 0x7f24f8075920 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 -- 172.21.15.5:0/2183139817 >> 172.21.15.5:0/2183139817 conn(0x7f24f80fe830 msgr2=0x7f24f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 -- 172.21.15.5:0/2183139817 shutdown_connections 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.598+0000 7f24ff923640 1 -- 172.21.15.5:0/2183139817 wait complete. 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 Processor -- start 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 -- start start 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075540 0x7f24f819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 0x7f24f819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f8113b20 0x7f24f81a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8119410 con 0x7f24f8075e60 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8119290 con 0x7f24f8113b20 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24ff923640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8119590 con 0x7f24f8075540 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24fcebe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 0x7f24f819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:27.619 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24fcebe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 0x7f24f819fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58946/0 (socket says 172.21.15.5:58946) 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24fcebe640 1 -- 172.21.15.5:0/3289630610 learned_addr learned my addr 172.21.15.5:0/3289630610 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24fdec0640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f8113b20 0x7f24f81a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.599+0000 7f24fd6bf640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075540 0x7f24f819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fcebe640 1 -- 172.21.15.5:0/3289630610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075540 msgr2=0x7f24f819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fcebe640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075540 0x7f24f819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fcebe640 1 -- 172.21.15.5:0/3289630610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f8113b20 msgr2=0x7f24f81a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fcebe640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f8113b20 0x7f24f81a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fcebe640 1 -- 172.21.15.5:0/3289630610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f81a5990 con 0x7f24f8075e60 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fd6bf640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075540 0x7f24f819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24fcebe640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 0x7f24f819fe20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b4a0 tx=0x7f24ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec014070 con 0x7f24f8075e60 2024-09-10T22:15:27.620 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24ec010ac0 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f81a5c80 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec017c30 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.600+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f81ac3c0 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.601+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f8075920 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.602+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f24ec010610 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.604+0000 7f24f67fc640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f24e00b5370 0x7f24e00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.604+0000 7f24fd6bf640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f24e00b5370 0x7f24e00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.604+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f24ec0e5580 con 0x7f24f8075e60 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.604+0000 7f24fd6bf640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f24e00b5370 0x7f24e00b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24e8031440 tx=0x7f24e80095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:27.621 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.607+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f24ec0ac390 con 0x7f24f8075e60 2024-09-10T22:15:27.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:27 smithi052 ceph-mon[34997]: pgmap v302: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-10T22:15:27.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.794+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24f81ac680 con 0x7f24f8075e60 2024-09-10T22:15:27.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.795+0000 7f24f67fc640 1 -- 172.21.15.5:0/3289630610 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22197 (secure 0 0 0) 0x7f24ec0abc90 con 0x7f24f8075e60 2024-09-10T22:15:27.797 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:27.797 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":76,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:03.043266+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.797+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f24e00b5370 msgr2=0x7f24e00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.797+0000 7f24ff923640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f24e00b5370 0x7f24e00b7830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f24e8031440 tx=0x7f24e80095f0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.797+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 msgr2=0x7f24f819fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.797+0000 7f24ff923640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 0x7f24f819fe20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00b4a0 tx=0x7f24ec00b960 comp rx=0 tx=0).stop 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.797+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 shutdown_connections 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.797+0000 7f24ff923640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f24e00b5370 0x7f24e00b7830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.798+0000 7f24ff923640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f24f8113b20 0x7f24f81a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.798+0000 7f24ff923640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f24f8075e60 0x7f24f819fe20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.798+0000 7f24ff923640 1 --2- 172.21.15.5:0/3289630610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f24f8075540 0x7f24f819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.798+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 >> 172.21.15.5:0/3289630610 conn(0x7f24f80fe830 msgr2=0x7f24f80ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.798+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 shutdown_connections 2024-09-10T22:15:27.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:27.798+0000 7f24ff923640 1 -- 172.21.15.5:0/3289630610 wait complete. 2024-09-10T22:15:27.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:27 smithi189 ceph-mon[35784]: pgmap v302: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-10T22:15:28.596 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T22:15:28.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:15:28.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:28 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3289630610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:28.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:28 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3289630610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:28.857 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:28.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:28 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3289630610' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 -- 172.21.15.5:0/662776230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f790810d140 msgr2=0x7f790810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 --2- 172.21.15.5:0/662776230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f790810d140 0x7f790810f5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7900009ca0 tx=0x7f790002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 -- 172.21.15.5:0/662776230 shutdown_connections 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 --2- 172.21.15.5:0/662776230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f790810d140 0x7f790810f5a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 --2- 172.21.15.5:0/662776230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908104600 0x7f790810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 --2- 172.21.15.5:0/662776230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7908103ce0 0x7f79081040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 -- 172.21.15.5:0/662776230 >> 172.21.15.5:0/662776230 conn(0x7f79080fd700 msgr2=0x7f79080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 -- 172.21.15.5:0/662776230 shutdown_connections 2024-09-10T22:15:29.328 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.299+0000 7f790e7b3640 1 -- 172.21.15.5:0/662776230 wait complete. 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 Processor -- start 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 -- start start 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 0x7f7908199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908104600 0x7f79081997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f790810d140 0x7f790819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7908112df0 con 0x7f7908103ce0 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7908112c70 con 0x7f790810d140 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f790e7b3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7908112f70 con 0x7f7908104600 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f7907fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 0x7f7908199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f7907fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 0x7f7908199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58956/0 (socket says 172.21.15.5:58956) 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f7907fff640 1 -- 172.21.15.5:0/3174581305 learned_addr learned my addr 172.21.15.5:0/3174581305 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.300+0000 7f79077fe640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908104600 0x7f79081997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:29.329 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f790cd50640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f790810d140 0x7f790819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f7907fff640 1 -- 172.21.15.5:0/3174581305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908104600 msgr2=0x7f79081997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f7907fff640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908104600 0x7f79081997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f7907fff640 1 -- 172.21.15.5:0/3174581305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f790810d140 msgr2=0x7f790819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f7907fff640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f790810d140 0x7f790819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f7907fff640 1 -- 172.21.15.5:0/3174581305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790819f330 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f790cd50640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f790810d140 0x7f790819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f7907fff640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 0x7f7908199280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f78f800b4a0 tx=0x7f78f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8014070 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78f8010ac0 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8017c30 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790819f620 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.301+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79081018f0 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.303+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79081040c0 con 0x7f7908103ce0 2024-09-10T22:15:29.330 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.304+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f78f8010610 con 0x7f7908103ce0 2024-09-10T22:15:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.304+0000 7f79057fa640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f78f00b5370 0x7f78f00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.305+0000 7f79077fe640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f78f00b5370 0x7f78f00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.305+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f78f80e54a0 con 0x7f7908103ce0 2024-09-10T22:15:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.305+0000 7f79077fe640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f78f00b5370 0x7f78f00b7830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f790810f6b0 tx=0x7f78fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:29.331 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.308+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f78f80ac3b0 con 0x7f7908103ce0 2024-09-10T22:15:29.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.493+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f79080ffa20 con 0x7f78f00b5370 2024-09-10T22:15:29.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.498+0000 7f79057fa640 1 -- 172.21.15.5:0/3174581305 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258852 (secure 0 0 0) 0x7f79080ffa20 con 0x7f78f00b5370 2024-09-10T22:15:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:29.503 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f78f00b5370 msgr2=0x7f78f00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f78f00b5370 0x7f78f00b7830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f790810f6b0 tx=0x7f78fc005f90 comp rx=0 tx=0).stop 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 msgr2=0x7f7908199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 0x7f7908199280 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f78f800b4a0 tx=0x7f78f800b960 comp rx=0 tx=0).stop 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 shutdown_connections 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f78f00b5370 0x7f78f00b7830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f790810d140 0x7f790819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7908104600 0x7f79081997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 --2- 172.21.15.5:0/3174581305 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7908103ce0 0x7f7908199280 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 >> 172.21.15.5:0/3174581305 conn(0x7f79080fd700 msgr2=0x7f79080fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 shutdown_connections 2024-09-10T22:15:29.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:29.501+0000 7f790e7b3640 1 -- 172.21.15.5:0/3174581305 wait complete. 2024-09-10T22:15:29.574 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:29 smithi005 ceph-mon[31115]: pgmap v303: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T22:15:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:29 smithi052 ceph-mon[34997]: pgmap v303: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T22:15:29.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:29 smithi189 ceph-mon[35784]: pgmap v303: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-09-10T22:15:30.245 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2024-09-10T22:15:27.714522+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635666,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":272,"num_write_kb":2237,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363428,"kb_used_data":10020,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578396,"statfs":{"total":1151940427776,"available":1151568277504,"internally_reserved":0,"allocated":10260480,"data_stored":6599478,"data_compressed":107844,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40698,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":79,"num_read_kb":82,"num_write":40,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003282"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343107+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:15:03.343107+0000","last_peered":"2024-09-10T22:15:03.343107+0000","last_clean":"2024-09-10T22:15:03.343107+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:15:03.343107+0000","last_undegraded":"2024-09-10T22:15:03.343107+0000","last_fullsized":"2024-09-10T22:15:03.343107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349733+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:15:03.349733+0000","last_peered":"2024-09-10T22:15:03.349733+0000","last_clean":"2024-09-10T22:15:03.349733+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:15:03.349733+0000","last_undegraded":"2024-09-10T22:15:03.349733+0000","last_fullsized":"2024-09-10T22:15:03.349733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349727+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:15:03.349727+0000","last_peered":"2024-09-10T22:15:03.349727+0000","last_clean":"2024-09-10T22:15:03.349727+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:15:03.349727+0000","last_undegraded":"2024-09-10T22:15:03.349727+0000","last_fullsized":"2024-09-10T22:15:03.349727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353361+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:15:03.353361+0000","last_peered":"2024-09-10T22:15:03.353361+0000","last_clean":"2024-09-10T22:15:03.353361+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:15:03.353361+0000","last_undegraded":"2024-09-10T22:15:03.353361+0000","last_fullsized":"2024-09-10T22:15:03.353361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350420+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:15:03.350420+0000","last_peered":"2024-09-10T22:15:03.350420+0000","last_clean":"2024-09-10T22:15:03.350420+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:15:03.350420+0000","last_undegraded":"2024-09-10T22:15:03.350420+0000","last_fullsized":"2024-09-10T22:15:03.350420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343411+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:15:03.343411+0000","last_peered":"2024-09-10T22:15:03.343411+0000","last_clean":"2024-09-10T22:15:03.343411+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:15:03.343411+0000","last_undegraded":"2024-09-10T22:15:03.343411+0000","last_fullsized":"2024-09-10T22:15:03.343411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352870+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:15:03.352870+0000","last_peered":"2024-09-10T22:15:03.352870+0000","last_clean":"2024-09-10T22:15:03.352870+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:15:03.352870+0000","last_undegraded":"2024-09-10T22:15:03.352870+0000","last_fullsized":"2024-09-10T22:15:03.352870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.341878+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:15:03.341878+0000","last_peered":"2024-09-10T22:15:03.341878+0000","last_clean":"2024-09-10T22:15:03.341878+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:15:03.341878+0000","last_undegraded":"2024-09-10T22:15:03.341878+0000","last_fullsized":"2024-09-10T22:15:03.341878+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350121+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:15:03.350121+0000","last_peered":"2024-09-10T22:15:03.350121+0000","last_clean":"2024-09-10T22:15:03.350121+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:15:03.350121+0000","last_undegraded":"2024-09-10T22:15:03.350121+0000","last_fullsized":"2024-09-10T22:15:03.350121+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343625+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:15:03.343625+0000","last_peered":"2024-09-10T22:15:03.343625+0000","last_clean":"2024-09-10T22:15:03.343625+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:15:03.343625+0000","last_undegraded":"2024-09-10T22:15:03.343625+0000","last_fullsized":"2024-09-10T22:15:03.343625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355407+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:15:03.355407+0000","last_peered":"2024-09-10T22:15:03.355407+0000","last_clean":"2024-09-10T22:15:03.355407+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:15:03.355407+0000","last_undegraded":"2024-09-10T22:15:03.355407+0000","last_fullsized":"2024-09-10T22:15:03.355407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353381+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:15:03.353381+0000","last_peered":"2024-09-10T22:15:03.353381+0000","last_clean":"2024-09-10T22:15:03.353381+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:15:03.353381+0000","last_undegraded":"2024-09-10T22:15:03.353381+0000","last_fullsized":"2024-09-10T22:15:03.353381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350860+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:15:03.350860+0000","last_peered":"2024-09-10T22:15:03.350860+0000","last_clean":"2024-09-10T22:15:03.350860+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:15:03.350860+0000","last_undegraded":"2024-09-10T22:15:03.350860+0000","last_fullsized":"2024-09-10T22:15:03.350860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349801+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:15:03.349801+0000","last_peered":"2024-09-10T22:15:03.349801+0000","last_clean":"2024-09-10T22:15:03.349801+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:15:03.349801+0000","last_undegraded":"2024-09-10T22:15:03.349801+0000","last_fullsized":"2024-09-10T22:15:03.349801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350023+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:15:03.350023+0000","last_peered":"2024-09-10T22:15:03.350023+0000","last_clean":"2024-09-10T22:15:03.350023+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:15:03.350023+0000","last_undegraded":"2024-09-10T22:15:03.350023+0000","last_fullsized":"2024-09-10T22:15:03.350023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349193+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:15:03.349193+0000","last_peered":"2024-09-10T22:15:03.349193+0000","last_clean":"2024-09-10T22:15:03.349193+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:15:03.349193+0000","last_undegraded":"2024-09-10T22:15:03.349193+0000","last_fullsized":"2024-09-10T22:15:03.349193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343163+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:15:03.343163+0000","last_peered":"2024-09-10T22:15:03.343163+0000","last_clean":"2024-09-10T22:15:03.343163+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:15:03.343163+0000","last_undegraded":"2024-09-10T22:15:03.343163+0000","last_fullsized":"2024-09-10T22:15:03.343163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353312+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:15:03.353312+0000","last_peered":"2024-09-10T22:15:03.353312+0000","last_clean":"2024-09-10T22:15:03.353312+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:15:03.353312+0000","last_undegraded":"2024-09-10T22:15:03.353312+0000","last_fullsized":"2024-09-10T22:15:03.353312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354641+0000","last_change":"2024-09-10T22:15:02.361189+0000","last_active":"2024-09-10T22:15:03.354641+0000","last_peered":"2024-09-10T22:15:03.354641+0000","last_clean":"2024-09-10T22:15:03.354641+0000","last_became_active":"2024-09-10T22:15:02.360583+0000","last_became_peered":"2024-09-10T22:15:02.360583+0000","last_unstale":"2024-09-10T22:15:03.354641+0000","last_undegraded":"2024-09-10T22:15:03.354641+0000","last_fullsized":"2024-09-10T22:15:03.354641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:10.709747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342791+0000","last_change":"2024-09-10T22:15:02.361527+0000","last_active":"2024-09-10T22:15:03.342791+0000","last_peered":"2024-09-10T22:15:03.342791+0000","last_clean":"2024-09-10T22:15:03.342791+0000","last_became_active":"2024-09-10T22:15:02.359053+0000","last_became_peered":"2024-09-10T22:15:02.359053+0000","last_unstale":"2024-09-10T22:15:03.342791+0000","last_undegraded":"2024-09-10T22:15:03.342791+0000","last_fullsized":"2024-09-10T22:15:03.342791+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:32.763255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351061+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:15:03.351061+0000","last_peered":"2024-09-10T22:15:03.351061+0000","last_clean":"2024-09-10T22:15:03.351061+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:15:03.351061+0000","last_undegraded":"2024-09-10T22:15:03.351061+0000","last_fullsized":"2024-09-10T22:15:03.351061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349769+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:15:03.349769+0000","last_peered":"2024-09-10T22:15:03.349769+0000","last_clean":"2024-09-10T22:15:03.349769+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:15:03.349769+0000","last_undegraded":"2024-09-10T22:15:03.349769+0000","last_fullsized":"2024-09-10T22:15:03.349769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.341890+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:15:03.341890+0000","last_peered":"2024-09-10T22:15:03.341890+0000","last_clean":"2024-09-10T22:15:03.341890+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:15:03.341890+0000","last_undegraded":"2024-09-10T22:15:03.341890+0000","last_fullsized":"2024-09-10T22:15:03.341890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351336+0000","last_change":"2024-09-10T22:15:02.359414+0000","last_active":"2024-09-10T22:15:03.351336+0000","last_peered":"2024-09-10T22:15:03.351336+0000","last_clean":"2024-09-10T22:15:03.351336+0000","last_became_active":"2024-09-10T22:15:02.357378+0000","last_became_peered":"2024-09-10T22:15:02.357378+0000","last_unstale":"2024-09-10T22:15:03.351336+0000","last_undegraded":"2024-09-10T22:15:03.351336+0000","last_fullsized":"2024-09-10T22:15:03.351336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:37:03.852703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342318+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:15:03.342318+0000","last_peered":"2024-09-10T22:15:03.342318+0000","last_clean":"2024-09-10T22:15:03.342318+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:15:03.342318+0000","last_undegraded":"2024-09-10T22:15:03.342318+0000","last_fullsized":"2024-09-10T22:15:03.342318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354389+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:15:03.354389+0000","last_peered":"2024-09-10T22:15:03.354389+0000","last_clean":"2024-09-10T22:15:03.354389+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:15:03.354389+0000","last_undegraded":"2024-09-10T22:15:03.354389+0000","last_fullsized":"2024-09-10T22:15:03.354389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343008+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:15:03.343008+0000","last_peered":"2024-09-10T22:15:03.343008+0000","last_clean":"2024-09-10T22:15:03.343008+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:15:03.343008+0000","last_undegraded":"2024-09-10T22:15:03.343008+0000","last_fullsized":"2024-09-10T22:15:03.343008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350519+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:15:03.350519+0000","last_peered":"2024-09-10T22:15:03.350519+0000","last_clean":"2024-09-10T22:15:03.350519+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:15:03.350519+0000","last_undegraded":"2024-09-10T22:15:03.350519+0000","last_fullsized":"2024-09-10T22:15:03.350519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350486+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:15:03.350486+0000","last_peered":"2024-09-10T22:15:03.350486+0000","last_clean":"2024-09-10T22:15:03.350486+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:15:03.350486+0000","last_undegraded":"2024-09-10T22:15:03.350486+0000","last_fullsized":"2024-09-10T22:15:03.350486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351160+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:15:03.351160+0000","last_peered":"2024-09-10T22:15:03.351160+0000","last_clean":"2024-09-10T22:15:03.351160+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:15:03.351160+0000","last_undegraded":"2024-09-10T22:15:03.351160+0000","last_fullsized":"2024-09-10T22:15:03.351160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355025+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:15:03.355025+0000","last_peered":"2024-09-10T22:15:03.355025+0000","last_clean":"2024-09-10T22:15:03.355025+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:15:03.355025+0000","last_undegraded":"2024-09-10T22:15:03.355025+0000","last_fullsized":"2024-09-10T22:15:03.355025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342673+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:15:03.342673+0000","last_peered":"2024-09-10T22:15:03.342673+0000","last_clean":"2024-09-10T22:15:03.342673+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:15:03.342673+0000","last_undegraded":"2024-09-10T22:15:03.342673+0000","last_fullsized":"2024-09-10T22:15:03.342673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350390+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:15:03.350390+0000","last_peered":"2024-09-10T22:15:03.350390+0000","last_clean":"2024-09-10T22:15:03.350390+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:15:03.350390+0000","last_undegraded":"2024-09-10T22:15:03.350390+0000","last_fullsized":"2024-09-10T22:15:03.350390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:24.422681+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:15:24.422681+0000","last_peered":"2024-09-10T22:15:24.422681+0000","last_clean":"2024-09-10T22:15:24.422681+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:15:24.422681+0000","last_undegraded":"2024-09-10T22:15:24.422681+0000","last_fullsized":"2024-09-10T22:15:24.422681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351734+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:15:03.351734+0000","last_peered":"2024-09-10T22:15:03.351734+0000","last_clean":"2024-09-10T22:15:03.351734+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:15:03.351734+0000","last_undegraded":"2024-09-10T22:15:03.351734+0000","last_fullsized":"2024-09-10T22:15:03.351734+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.403174+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:12.403174+0000","last_peered":"2024-09-10T22:15:12.403174+0000","last_clean":"2024-09-10T22:15:12.403174+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:12.403174+0000","last_undegraded":"2024-09-10T22:15:12.403174+0000","last_fullsized":"2024-09-10T22:15:12.403174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.403797+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:12.403797+0000","last_peered":"2024-09-10T22:15:12.403797+0000","last_clean":"2024-09-10T22:15:12.403797+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:12.403797+0000","last_undegraded":"2024-09-10T22:15:12.403797+0000","last_fullsized":"2024-09-10T22:15:12.403797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342091+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:15:03.342091+0000","last_peered":"2024-09-10T22:15:03.342091+0000","last_clean":"2024-09-10T22:15:03.342091+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:15:03.342091+0000","last_undegraded":"2024-09-10T22:15:03.342091+0000","last_fullsized":"2024-09-10T22:15:03.342091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351855+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:03.351855+0000","last_peered":"2024-09-10T22:15:03.351855+0000","last_clean":"2024-09-10T22:15:03.351855+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:03.351855+0000","last_undegraded":"2024-09-10T22:15:03.351855+0000","last_fullsized":"2024-09-10T22:15:03.351855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352917+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:15:03.352917+0000","last_peered":"2024-09-10T22:15:03.352917+0000","last_clean":"2024-09-10T22:15:03.352917+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:15:03.352917+0000","last_undegraded":"2024-09-10T22:15:03.352917+0000","last_fullsized":"2024-09-10T22:15:03.352917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:23.420652+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:15:23.420652+0000","last_peered":"2024-09-10T22:15:23.420652+0000","last_clean":"2024-09-10T22:15:23.420652+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:15:23.420652+0000","last_undegraded":"2024-09-10T22:15:23.420652+0000","last_fullsized":"2024-09-10T22:15:23.420652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349655+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:15:03.349655+0000","last_peered":"2024-09-10T22:15:03.349655+0000","last_clean":"2024-09-10T22:15:03.349655+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:15:03.349655+0000","last_undegraded":"2024-09-10T22:15:03.349655+0000","last_fullsized":"2024-09-10T22:15:03.349655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.390710+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:11.390710+0000","last_peered":"2024-09-10T22:15:11.390710+0000","last_clean":"2024-09-10T22:15:11.390710+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:11.390710+0000","last_undegraded":"2024-09-10T22:15:11.390710+0000","last_fullsized":"2024-09-10T22:15:11.390710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351227+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:15:03.351227+0000","last_peered":"2024-09-10T22:15:03.351227+0000","last_clean":"2024-09-10T22:15:03.351227+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:15:03.351227+0000","last_undegraded":"2024-09-10T22:15:03.351227+0000","last_fullsized":"2024-09-10T22:15:03.351227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.389875+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:11.389875+0000","last_peered":"2024-09-10T22:15:11.389875+0000","last_clean":"2024-09-10T22:15:11.389875+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:11.389875+0000","last_undegraded":"2024-09-10T22:15:11.389875+0000","last_fullsized":"2024-09-10T22:15:11.389875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349478+0000","last_change":"2024-09-10T22:15:02.360315+0000","last_active":"2024-09-10T22:15:03.349478+0000","last_peered":"2024-09-10T22:15:03.349478+0000","last_clean":"2024-09-10T22:15:03.349478+0000","last_became_active":"2024-09-10T22:15:02.359647+0000","last_became_peered":"2024-09-10T22:15:02.359647+0000","last_unstale":"2024-09-10T22:15:03.349478+0000","last_undegraded":"2024-09-10T22:15:03.349478+0000","last_fullsized":"2024-09-10T22:15:03.349478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:44.008755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'21","reported_seq":70,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:24.423355+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:15:24.423355+0000","last_peered":"2024-09-10T22:15:24.423355+0000","last_clean":"2024-09-10T22:15:24.423355+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:15:24.423355+0000","last_undegraded":"2024-09-10T22:15:24.423355+0000","last_fullsized":"2024-09-10T22:15:24.423355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41063,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":54,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352466+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:15:03.352466+0000","last_peered":"2024-09-10T22:15:03.352466+0000","last_clean":"2024-09-10T22:15:03.352466+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:15:03.352466+0000","last_undegraded":"2024-09-10T22:15:03.352466+0000","last_fullsized":"2024-09-10T22:15:03.352466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.404628+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:12.404628+0000","last_peered":"2024-09-10T22:15:12.404628+0000","last_clean":"2024-09-10T22:15:12.404628+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:12.404628+0000","last_undegraded":"2024-09-10T22:15:12.404628+0000","last_fullsized":"2024-09-10T22:15:12.404628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351080+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:15:03.351080+0000","last_peered":"2024-09-10T22:15:03.351080+0000","last_clean":"2024-09-10T22:15:03.351080+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:15:03.351080+0000","last_undegraded":"2024-09-10T22:15:03.351080+0000","last_fullsized":"2024-09-10T22:15:03.351080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.390562+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:11.390562+0000","last_peered":"2024-09-10T22:15:11.390562+0000","last_clean":"2024-09-10T22:15:11.390562+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:11.390562+0000","last_undegraded":"2024-09-10T22:15:11.390562+0000","last_fullsized":"2024-09-10T22:15:11.390562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354953+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:15:03.354953+0000","last_peered":"2024-09-10T22:15:03.354953+0000","last_clean":"2024-09-10T22:15:03.354953+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:15:03.354953+0000","last_undegraded":"2024-09-10T22:15:03.354953+0000","last_fullsized":"2024-09-10T22:15:03.354953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:24.422096+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:15:24.422096+0000","last_peered":"2024-09-10T22:15:24.422096+0000","last_clean":"2024-09-10T22:15:24.422096+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:15:24.422096+0000","last_undegraded":"2024-09-10T22:15:24.422096+0000","last_fullsized":"2024-09-10T22:15:24.422096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353279+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:15:03.353279+0000","last_peered":"2024-09-10T22:15:03.353279+0000","last_clean":"2024-09-10T22:15:03.353279+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:15:03.353279+0000","last_undegraded":"2024-09-10T22:15:03.353279+0000","last_fullsized":"2024-09-10T22:15:03.353279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405933+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:12.405933+0000","last_peered":"2024-09-10T22:15:12.405933+0000","last_clean":"2024-09-10T22:15:12.405933+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:12.405933+0000","last_undegraded":"2024-09-10T22:15:12.405933+0000","last_fullsized":"2024-09-10T22:15:12.405933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350882+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:15:03.350882+0000","last_peered":"2024-09-10T22:15:03.350882+0000","last_clean":"2024-09-10T22:15:03.350882+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:15:03.350882+0000","last_undegraded":"2024-09-10T22:15:03.350882+0000","last_fullsized":"2024-09-10T22:15:03.350882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:13.400458+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:13.400458+0000","last_peered":"2024-09-10T22:15:13.400458+0000","last_clean":"2024-09-10T22:15:13.400458+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:13.400458+0000","last_undegraded":"2024-09-10T22:15:13.400458+0000","last_fullsized":"2024-09-10T22:15:13.400458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342868+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:15:03.342868+0000","last_peered":"2024-09-10T22:15:03.342868+0000","last_clean":"2024-09-10T22:15:03.342868+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:15:03.342868+0000","last_undegraded":"2024-09-10T22:15:03.342868+0000","last_fullsized":"2024-09-10T22:15:03.342868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.358247+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:03.358247+0000","last_peered":"2024-09-10T22:15:03.358247+0000","last_clean":"2024-09-10T22:15:03.358247+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:03.358247+0000","last_undegraded":"2024-09-10T22:15:03.358247+0000","last_fullsized":"2024-09-10T22:15:03.358247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355274+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:15:03.355274+0000","last_peered":"2024-09-10T22:15:03.355274+0000","last_clean":"2024-09-10T22:15:03.355274+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:15:03.355274+0000","last_undegraded":"2024-09-10T22:15:03.355274+0000","last_fullsized":"2024-09-10T22:15:03.355274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.356337+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:03.356337+0000","last_peered":"2024-09-10T22:15:03.356337+0000","last_clean":"2024-09-10T22:15:03.356337+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:03.356337+0000","last_undegraded":"2024-09-10T22:15:03.356337+0000","last_fullsized":"2024-09-10T22:15:03.356337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355332+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:15:03.355332+0000","last_peered":"2024-09-10T22:15:03.355332+0000","last_clean":"2024-09-10T22:15:03.355332+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:15:03.355332+0000","last_undegraded":"2024-09-10T22:15:03.355332+0000","last_fullsized":"2024-09-10T22:15:03.355332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405311+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:12.405311+0000","last_peered":"2024-09-10T22:15:12.405311+0000","last_clean":"2024-09-10T22:15:12.405311+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:12.405311+0000","last_undegraded":"2024-09-10T22:15:12.405311+0000","last_fullsized":"2024-09-10T22:15:12.405311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355524+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:15:03.355524+0000","last_peered":"2024-09-10T22:15:03.355524+0000","last_clean":"2024-09-10T22:15:03.355524+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:15:03.355524+0000","last_undegraded":"2024-09-10T22:15:03.355524+0000","last_fullsized":"2024-09-10T22:15:03.355524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353769+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:03.353769+0000","last_peered":"2024-09-10T22:15:03.353769+0000","last_clean":"2024-09-10T22:15:03.353769+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:03.353769+0000","last_undegraded":"2024-09-10T22:15:03.353769+0000","last_fullsized":"2024-09-10T22:15:03.353769+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:13.401661+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:13.401661+0000","last_peered":"2024-09-10T22:15:13.401661+0000","last_clean":"2024-09-10T22:15:13.401661+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:13.401661+0000","last_undegraded":"2024-09-10T22:15:13.401661+0000","last_fullsized":"2024-09-10T22:15:13.401661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342195+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:15:03.342195+0000","last_peered":"2024-09-10T22:15:03.342195+0000","last_clean":"2024-09-10T22:15:03.342195+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:15:03.342195+0000","last_undegraded":"2024-09-10T22:15:03.342195+0000","last_fullsized":"2024-09-10T22:15:03.342195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.403044+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:12.403044+0000","last_peered":"2024-09-10T22:15:12.403044+0000","last_clean":"2024-09-10T22:15:12.403044+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:12.403044+0000","last_undegraded":"2024-09-10T22:15:12.403044+0000","last_fullsized":"2024-09-10T22:15:12.403044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350224+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:15:03.350224+0000","last_peered":"2024-09-10T22:15:03.350224+0000","last_clean":"2024-09-10T22:15:03.350224+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:15:03.350224+0000","last_undegraded":"2024-09-10T22:15:03.350224+0000","last_fullsized":"2024-09-10T22:15:03.350224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:21.417205+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:15:21.417205+0000","last_peered":"2024-09-10T22:15:21.417205+0000","last_clean":"2024-09-10T22:15:21.417205+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:15:21.417205+0000","last_undegraded":"2024-09-10T22:15:21.417205+0000","last_fullsized":"2024-09-10T22:15:21.417205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351568+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:15:03.351568+0000","last_peered":"2024-09-10T22:15:03.351568+0000","last_clean":"2024-09-10T22:15:03.351568+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:15:03.351568+0000","last_undegraded":"2024-09-10T22:15:03.351568+0000","last_fullsized":"2024-09-10T22:15:03.351568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354298+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:03.354298+0000","last_peered":"2024-09-10T22:15:03.354298+0000","last_clean":"2024-09-10T22:15:03.354298+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:03.354298+0000","last_undegraded":"2024-09-10T22:15:03.354298+0000","last_fullsized":"2024-09-10T22:15:03.354298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343010+0000","last_change":"2024-09-10T22:15:02.359623+0000","last_active":"2024-09-10T22:15:03.343010+0000","last_peered":"2024-09-10T22:15:03.343010+0000","last_clean":"2024-09-10T22:15:03.343010+0000","last_became_active":"2024-09-10T22:15:02.359247+0000","last_became_peered":"2024-09-10T22:15:02.359247+0000","last_unstale":"2024-09-10T22:15:03.343010+0000","last_undegraded":"2024-09-10T22:15:03.343010+0000","last_fullsized":"2024-09-10T22:15:03.343010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:11.856907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352917+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:03.352917+0000","last_peered":"2024-09-10T22:15:03.352917+0000","last_clean":"2024-09-10T22:15:03.352917+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:03.352917+0000","last_undegraded":"2024-09-10T22:15:03.352917+0000","last_fullsized":"2024-09-10T22:15:03.352917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:04.955822+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:15:04.955822+0000","last_peered":"2024-09-10T22:15:04.955822+0000","last_clean":"2024-09-10T22:15:04.955822+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:15:04.955822+0000","last_undegraded":"2024-09-10T22:15:04.955822+0000","last_fullsized":"2024-09-10T22:15:04.955822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.385595+0000","last_change":"2024-09-10T22:15:00.549824+0000","last_active":"2024-09-10T22:15:11.385595+0000","last_peered":"2024-09-10T22:15:11.385595+0000","last_clean":"2024-09-10T22:15:11.385595+0000","last_became_active":"2024-09-10T22:15:00.549415+0000","last_became_peered":"2024-09-10T22:15:00.549415+0000","last_unstale":"2024-09-10T22:15:11.385595+0000","last_undegraded":"2024-09-10T22:15:11.385595+0000","last_fullsized":"2024-09-10T22:15:11.385595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:22.013191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350767+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:15:03.350767+0000","last_peered":"2024-09-10T22:15:03.350767+0000","last_clean":"2024-09-10T22:15:03.350767+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:15:03.350767+0000","last_undegraded":"2024-09-10T22:15:03.350767+0000","last_fullsized":"2024-09-10T22:15:03.350767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'7","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:22.349671+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:15:22.349671+0000","last_peered":"2024-09-10T22:15:22.349671+0000","last_clean":"2024-09-10T22:15:22.349671+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:15:22.349671+0000","last_undegraded":"2024-09-10T22:15:22.349671+0000","last_fullsized":"2024-09-10T22:15:22.349671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342461+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:15:03.342461+0000","last_peered":"2024-09-10T22:15:03.342461+0000","last_clean":"2024-09-10T22:15:03.342461+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:15:03.342461+0000","last_undegraded":"2024-09-10T22:15:03.342461+0000","last_fullsized":"2024-09-10T22:15:03.342461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.388913+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:11.388913+0000","last_peered":"2024-09-10T22:15:11.388913+0000","last_clean":"2024-09-10T22:15:11.388913+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:11.388913+0000","last_undegraded":"2024-09-10T22:15:11.388913+0000","last_fullsized":"2024-09-10T22:15:11.388913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349949+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:15:03.349949+0000","last_peered":"2024-09-10T22:15:03.349949+0000","last_clean":"2024-09-10T22:15:03.349949+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:15:03.349949+0000","last_undegraded":"2024-09-10T22:15:03.349949+0000","last_fullsized":"2024-09-10T22:15:03.349949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.388309+0000","last_change":"2024-09-10T22:15:00.549895+0000","last_active":"2024-09-10T22:15:11.388309+0000","last_peered":"2024-09-10T22:15:11.388309+0000","last_clean":"2024-09-10T22:15:11.388309+0000","last_became_active":"2024-09-10T22:15:00.549528+0000","last_became_peered":"2024-09-10T22:15:00.549528+0000","last_unstale":"2024-09-10T22:15:11.388309+0000","last_undegraded":"2024-09-10T22:15:11.388309+0000","last_fullsized":"2024-09-10T22:15:11.388309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:27.008226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350065+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:15:03.350065+0000","last_peered":"2024-09-10T22:15:03.350065+0000","last_clean":"2024-09-10T22:15:03.350065+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:15:03.350065+0000","last_undegraded":"2024-09-10T22:15:03.350065+0000","last_fullsized":"2024-09-10T22:15:03.350065+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.389669+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:11.389669+0000","last_peered":"2024-09-10T22:15:11.389669+0000","last_clean":"2024-09-10T22:15:11.389669+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:11.389669+0000","last_undegraded":"2024-09-10T22:15:11.389669+0000","last_fullsized":"2024-09-10T22:15:11.389669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342864+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:15:03.342864+0000","last_peered":"2024-09-10T22:15:03.342864+0000","last_clean":"2024-09-10T22:15:03.342864+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:15:03.342864+0000","last_undegraded":"2024-09-10T22:15:03.342864+0000","last_fullsized":"2024-09-10T22:15:03.342864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351372+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:03.351372+0000","last_peered":"2024-09-10T22:15:03.351372+0000","last_clean":"2024-09-10T22:15:03.351372+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:03.351372+0000","last_undegraded":"2024-09-10T22:15:03.351372+0000","last_fullsized":"2024-09-10T22:15:03.351372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342297+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:15:03.342297+0000","last_peered":"2024-09-10T22:15:03.342297+0000","last_clean":"2024-09-10T22:15:03.342297+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:15:03.342297+0000","last_undegraded":"2024-09-10T22:15:03.342297+0000","last_fullsized":"2024-09-10T22:15:03.342297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.389222+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:11.389222+0000","last_peered":"2024-09-10T22:15:11.389222+0000","last_clean":"2024-09-10T22:15:11.389222+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:11.389222+0000","last_undegraded":"2024-09-10T22:15:11.389222+0000","last_fullsized":"2024-09-10T22:15:11.389222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352994+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:15:03.352994+0000","last_peered":"2024-09-10T22:15:03.352994+0000","last_clean":"2024-09-10T22:15:03.352994+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:15:03.352994+0000","last_undegraded":"2024-09-10T22:15:03.352994+0000","last_fullsized":"2024-09-10T22:15:03.352994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352402+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:15:03.352402+0000","last_peered":"2024-09-10T22:15:03.352402+0000","last_clean":"2024-09-10T22:15:03.352402+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:15:03.352402+0000","last_undegraded":"2024-09-10T22:15:03.352402+0000","last_fullsized":"2024-09-10T22:15:03.352402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.356747+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:03.356747+0000","last_peered":"2024-09-10T22:15:03.356747+0000","last_clean":"2024-09-10T22:15:03.356747+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:03.356747+0000","last_undegraded":"2024-09-10T22:15:03.356747+0000","last_fullsized":"2024-09-10T22:15:03.356747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349261+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:15:03.349261+0000","last_peered":"2024-09-10T22:15:03.349261+0000","last_clean":"2024-09-10T22:15:03.349261+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:15:03.349261+0000","last_undegraded":"2024-09-10T22:15:03.349261+0000","last_fullsized":"2024-09-10T22:15:03.349261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405237+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:12.405237+0000","last_peered":"2024-09-10T22:15:12.405237+0000","last_clean":"2024-09-10T22:15:12.405237+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:12.405237+0000","last_undegraded":"2024-09-10T22:15:12.405237+0000","last_fullsized":"2024-09-10T22:15:12.405237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351001+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:15:03.351001+0000","last_peered":"2024-09-10T22:15:03.351001+0000","last_clean":"2024-09-10T22:15:03.351001+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:15:03.351001+0000","last_undegraded":"2024-09-10T22:15:03.351001+0000","last_fullsized":"2024-09-10T22:15:03.351001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349871+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:03.349871+0000","last_peered":"2024-09-10T22:15:03.349871+0000","last_clean":"2024-09-10T22:15:03.349871+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:03.349871+0000","last_undegraded":"2024-09-10T22:15:03.349871+0000","last_fullsized":"2024-09-10T22:15:03.349871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342564+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:15:03.342564+0000","last_peered":"2024-09-10T22:15:03.342564+0000","last_clean":"2024-09-10T22:15:03.342564+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:15:03.342564+0000","last_undegraded":"2024-09-10T22:15:03.342564+0000","last_fullsized":"2024-09-10T22:15:03.342564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405263+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:12.405263+0000","last_peered":"2024-09-10T22:15:12.405263+0000","last_clean":"2024-09-10T22:15:12.405263+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:12.405263+0000","last_undegraded":"2024-09-10T22:15:12.405263+0000","last_fullsized":"2024-09-10T22:15:12.405263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45064,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":97,"num_read_kb":95,"num_write":147,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356352,"data_stored":135192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710738,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":391622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":1024166,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":391858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":391778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":983708,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":391247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":983392,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":391684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":391558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":433844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":432103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":392518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":42804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:15:30.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:15:30.514 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:31.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 -- 172.21.15.5:0/2732996536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248109150 msgr2=0x7f024810f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 --2- 172.21.15.5:0/2732996536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248109150 0x7f024810f950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f0240009900 tx=0x7f024002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 -- 172.21.15.5:0/2732996536 shutdown_connections 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 --2- 172.21.15.5:0/2732996536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248109150 0x7f024810f950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 --2- 172.21.15.5:0/2732996536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 0x7f0248108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 --2- 172.21.15.5:0/2732996536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0248102dc0 0x7f02481031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 -- 172.21.15.5:0/2732996536 >> 172.21.15.5:0/2732996536 conn(0x7f02480fe830 msgr2=0x7f0248100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 -- 172.21.15.5:0/2732996536 shutdown_connections 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.985+0000 7f024ce10640 1 -- 172.21.15.5:0/2732996536 wait complete. 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 Processor -- start 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 -- start start 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 0x7f0248199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:31.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 0x7f02481997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0248109150 0x7f024819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0248112dd0 con 0x7f0248102dc0 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0248112c50 con 0x7f02481087d0 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024ce10640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0248112f50 con 0x7f0248109150 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 0x7f0248199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024659c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 0x7f0248199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:58980/0 (socket says 172.21.15.5:58980) 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.986+0000 7f024659c640 1 -- 172.21.15.5:0/3454351570 learned_addr learned my addr 172.21.15.5:0/3454351570 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f0245d9b640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 0x7f02481997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024659c640 1 -- 172.21.15.5:0/3454351570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0248109150 msgr2=0x7f024819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024659c640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0248109150 0x7f024819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024659c640 1 -- 172.21.15.5:0/3454351570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 msgr2=0x7f02481997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:31.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024659c640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 0x7f02481997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024659c640 1 -- 172.21.15.5:0/3454351570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024819f310 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f0245d9b640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 0x7f02481997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024659c640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 0x7f0248199260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f023800d950 tx=0x7f023800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238017070 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024819f600 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0238009c30 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023800f620 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.987+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02481a5e90 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.988+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02481031a0 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.990+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f0238010460 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.991+0000 7f02377fe640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f02300b5370 0x7f02300b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.991+0000 7f0245d9b640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f02300b5370 0x7f02300b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.991+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f02380e5a00 con 0x7f0248102dc0 2024-09-10T22:15:31.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.991+0000 7f0245d9b640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f02300b5370 0x7f02300b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0248104ea0 tx=0x7f023c0093e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:31.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:30.995+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f02380ac810 con 0x7f0248102dc0 2024-09-10T22:15:31.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.176+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0248063590 con 0x7f02300b5370 2024-09-10T22:15:31.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.181+0000 7f02377fe640 1 -- 172.21.15.5:0/3454351570 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258881 (secure 0 0 0) 0x7f0248063590 con 0x7f02300b5370 2024-09-10T22:15:31.184 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:31.185 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:15:31.187 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f02300b5370 msgr2=0x7f02300b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f02300b5370 0x7f02300b7830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0248104ea0 tx=0x7f023c0093e0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 msgr2=0x7f0248199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 0x7f0248199260 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f023800d950 tx=0x7f023800de10 comp rx=0 tx=0).stop 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 shutdown_connections 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f02300b5370 0x7f02300b7830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0248109150 0x7f024819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f02481087d0 0x7f02481997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 --2- 172.21.15.5:0/3454351570 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0248102dc0 0x7f0248199260 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 >> 172.21.15.5:0/3454351570 conn(0x7f02480fe830 msgr2=0x7f02480ff110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 shutdown_connections 2024-09-10T22:15:31.188 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:31.184+0000 7f024ce10640 1 -- 172.21.15.5:0/3454351570 wait complete. 2024-09-10T22:15:31.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:31 smithi052 ceph-mon[34997]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:15:31.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:31 smithi052 ceph-mon[34997]: pgmap v304: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-10T22:15:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:31 smithi005 ceph-mon[31115]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:15:31.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:31 smithi005 ceph-mon[31115]: pgmap v304: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-10T22:15:31.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:31 smithi189 ceph-mon[35784]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:15:31.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:31 smithi189 ceph-mon[35784]: pgmap v304: 97 pgs: 97 active+clean; 621 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-10T22:15:31.983 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2024-09-10T22:15:29.714973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635666,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":178,"num_read_kb":164,"num_write":280,"num_write_kb":2238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363440,"kb_used_data":10032,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578384,"statfs":{"total":1151940427776,"available":1151568265216,"internally_reserved":0,"allocated":10272768,"data_stored":6612787,"data_compressed":109658,"data_compressed_allocated":139264,"data_compressed_original":1777664,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":40076,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":76,"num_write":32,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003120"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343107+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:15:03.343107+0000","last_peered":"2024-09-10T22:15:03.343107+0000","last_clean":"2024-09-10T22:15:03.343107+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:15:03.343107+0000","last_undegraded":"2024-09-10T22:15:03.343107+0000","last_fullsized":"2024-09-10T22:15:03.343107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349733+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:15:03.349733+0000","last_peered":"2024-09-10T22:15:03.349733+0000","last_clean":"2024-09-10T22:15:03.349733+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:15:03.349733+0000","last_undegraded":"2024-09-10T22:15:03.349733+0000","last_fullsized":"2024-09-10T22:15:03.349733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349727+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:15:03.349727+0000","last_peered":"2024-09-10T22:15:03.349727+0000","last_clean":"2024-09-10T22:15:03.349727+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:15:03.349727+0000","last_undegraded":"2024-09-10T22:15:03.349727+0000","last_fullsized":"2024-09-10T22:15:03.349727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353361+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:15:03.353361+0000","last_peered":"2024-09-10T22:15:03.353361+0000","last_clean":"2024-09-10T22:15:03.353361+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:15:03.353361+0000","last_undegraded":"2024-09-10T22:15:03.353361+0000","last_fullsized":"2024-09-10T22:15:03.353361+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350420+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:15:03.350420+0000","last_peered":"2024-09-10T22:15:03.350420+0000","last_clean":"2024-09-10T22:15:03.350420+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:15:03.350420+0000","last_undegraded":"2024-09-10T22:15:03.350420+0000","last_fullsized":"2024-09-10T22:15:03.350420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343411+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:15:03.343411+0000","last_peered":"2024-09-10T22:15:03.343411+0000","last_clean":"2024-09-10T22:15:03.343411+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:15:03.343411+0000","last_undegraded":"2024-09-10T22:15:03.343411+0000","last_fullsized":"2024-09-10T22:15:03.343411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352870+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:15:03.352870+0000","last_peered":"2024-09-10T22:15:03.352870+0000","last_clean":"2024-09-10T22:15:03.352870+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:15:03.352870+0000","last_undegraded":"2024-09-10T22:15:03.352870+0000","last_fullsized":"2024-09-10T22:15:03.352870+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.341878+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:15:03.341878+0000","last_peered":"2024-09-10T22:15:03.341878+0000","last_clean":"2024-09-10T22:15:03.341878+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:15:03.341878+0000","last_undegraded":"2024-09-10T22:15:03.341878+0000","last_fullsized":"2024-09-10T22:15:03.341878+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350121+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:15:03.350121+0000","last_peered":"2024-09-10T22:15:03.350121+0000","last_clean":"2024-09-10T22:15:03.350121+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:15:03.350121+0000","last_undegraded":"2024-09-10T22:15:03.350121+0000","last_fullsized":"2024-09-10T22:15:03.350121+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343625+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:15:03.343625+0000","last_peered":"2024-09-10T22:15:03.343625+0000","last_clean":"2024-09-10T22:15:03.343625+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:15:03.343625+0000","last_undegraded":"2024-09-10T22:15:03.343625+0000","last_fullsized":"2024-09-10T22:15:03.343625+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355407+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:15:03.355407+0000","last_peered":"2024-09-10T22:15:03.355407+0000","last_clean":"2024-09-10T22:15:03.355407+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:15:03.355407+0000","last_undegraded":"2024-09-10T22:15:03.355407+0000","last_fullsized":"2024-09-10T22:15:03.355407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353381+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:15:03.353381+0000","last_peered":"2024-09-10T22:15:03.353381+0000","last_clean":"2024-09-10T22:15:03.353381+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:15:03.353381+0000","last_undegraded":"2024-09-10T22:15:03.353381+0000","last_fullsized":"2024-09-10T22:15:03.353381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350860+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:15:03.350860+0000","last_peered":"2024-09-10T22:15:03.350860+0000","last_clean":"2024-09-10T22:15:03.350860+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:15:03.350860+0000","last_undegraded":"2024-09-10T22:15:03.350860+0000","last_fullsized":"2024-09-10T22:15:03.350860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349801+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:15:03.349801+0000","last_peered":"2024-09-10T22:15:03.349801+0000","last_clean":"2024-09-10T22:15:03.349801+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:15:03.349801+0000","last_undegraded":"2024-09-10T22:15:03.349801+0000","last_fullsized":"2024-09-10T22:15:03.349801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350023+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:15:03.350023+0000","last_peered":"2024-09-10T22:15:03.350023+0000","last_clean":"2024-09-10T22:15:03.350023+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:15:03.350023+0000","last_undegraded":"2024-09-10T22:15:03.350023+0000","last_fullsized":"2024-09-10T22:15:03.350023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349193+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:15:03.349193+0000","last_peered":"2024-09-10T22:15:03.349193+0000","last_clean":"2024-09-10T22:15:03.349193+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:15:03.349193+0000","last_undegraded":"2024-09-10T22:15:03.349193+0000","last_fullsized":"2024-09-10T22:15:03.349193+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343163+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:15:03.343163+0000","last_peered":"2024-09-10T22:15:03.343163+0000","last_clean":"2024-09-10T22:15:03.343163+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:15:03.343163+0000","last_undegraded":"2024-09-10T22:15:03.343163+0000","last_fullsized":"2024-09-10T22:15:03.343163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353312+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:15:03.353312+0000","last_peered":"2024-09-10T22:15:03.353312+0000","last_clean":"2024-09-10T22:15:03.353312+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:15:03.353312+0000","last_undegraded":"2024-09-10T22:15:03.353312+0000","last_fullsized":"2024-09-10T22:15:03.353312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354641+0000","last_change":"2024-09-10T22:15:02.361189+0000","last_active":"2024-09-10T22:15:03.354641+0000","last_peered":"2024-09-10T22:15:03.354641+0000","last_clean":"2024-09-10T22:15:03.354641+0000","last_became_active":"2024-09-10T22:15:02.360583+0000","last_became_peered":"2024-09-10T22:15:02.360583+0000","last_unstale":"2024-09-10T22:15:03.354641+0000","last_undegraded":"2024-09-10T22:15:03.354641+0000","last_fullsized":"2024-09-10T22:15:03.354641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:36:10.709747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342791+0000","last_change":"2024-09-10T22:15:02.361527+0000","last_active":"2024-09-10T22:15:03.342791+0000","last_peered":"2024-09-10T22:15:03.342791+0000","last_clean":"2024-09-10T22:15:03.342791+0000","last_became_active":"2024-09-10T22:15:02.359053+0000","last_became_peered":"2024-09-10T22:15:02.359053+0000","last_unstale":"2024-09-10T22:15:03.342791+0000","last_undegraded":"2024-09-10T22:15:03.342791+0000","last_fullsized":"2024-09-10T22:15:03.342791+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:56:32.763255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351061+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:15:03.351061+0000","last_peered":"2024-09-10T22:15:03.351061+0000","last_clean":"2024-09-10T22:15:03.351061+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:15:03.351061+0000","last_undegraded":"2024-09-10T22:15:03.351061+0000","last_fullsized":"2024-09-10T22:15:03.351061+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349769+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:15:03.349769+0000","last_peered":"2024-09-10T22:15:03.349769+0000","last_clean":"2024-09-10T22:15:03.349769+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:15:03.349769+0000","last_undegraded":"2024-09-10T22:15:03.349769+0000","last_fullsized":"2024-09-10T22:15:03.349769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.341890+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:15:03.341890+0000","last_peered":"2024-09-10T22:15:03.341890+0000","last_clean":"2024-09-10T22:15:03.341890+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:15:03.341890+0000","last_undegraded":"2024-09-10T22:15:03.341890+0000","last_fullsized":"2024-09-10T22:15:03.341890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351336+0000","last_change":"2024-09-10T22:15:02.359414+0000","last_active":"2024-09-10T22:15:03.351336+0000","last_peered":"2024-09-10T22:15:03.351336+0000","last_clean":"2024-09-10T22:15:03.351336+0000","last_became_active":"2024-09-10T22:15:02.357378+0000","last_became_peered":"2024-09-10T22:15:02.357378+0000","last_unstale":"2024-09-10T22:15:03.351336+0000","last_undegraded":"2024-09-10T22:15:03.351336+0000","last_fullsized":"2024-09-10T22:15:03.351336+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:37:03.852703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342318+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:15:03.342318+0000","last_peered":"2024-09-10T22:15:03.342318+0000","last_clean":"2024-09-10T22:15:03.342318+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:15:03.342318+0000","last_undegraded":"2024-09-10T22:15:03.342318+0000","last_fullsized":"2024-09-10T22:15:03.342318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354389+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:15:03.354389+0000","last_peered":"2024-09-10T22:15:03.354389+0000","last_clean":"2024-09-10T22:15:03.354389+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:15:03.354389+0000","last_undegraded":"2024-09-10T22:15:03.354389+0000","last_fullsized":"2024-09-10T22:15:03.354389+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343008+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:15:03.343008+0000","last_peered":"2024-09-10T22:15:03.343008+0000","last_clean":"2024-09-10T22:15:03.343008+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:15:03.343008+0000","last_undegraded":"2024-09-10T22:15:03.343008+0000","last_fullsized":"2024-09-10T22:15:03.343008+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350519+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:15:03.350519+0000","last_peered":"2024-09-10T22:15:03.350519+0000","last_clean":"2024-09-10T22:15:03.350519+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:15:03.350519+0000","last_undegraded":"2024-09-10T22:15:03.350519+0000","last_fullsized":"2024-09-10T22:15:03.350519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350486+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:15:03.350486+0000","last_peered":"2024-09-10T22:15:03.350486+0000","last_clean":"2024-09-10T22:15:03.350486+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:15:03.350486+0000","last_undegraded":"2024-09-10T22:15:03.350486+0000","last_fullsized":"2024-09-10T22:15:03.350486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351160+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:15:03.351160+0000","last_peered":"2024-09-10T22:15:03.351160+0000","last_clean":"2024-09-10T22:15:03.351160+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:15:03.351160+0000","last_undegraded":"2024-09-10T22:15:03.351160+0000","last_fullsized":"2024-09-10T22:15:03.351160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355025+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:15:03.355025+0000","last_peered":"2024-09-10T22:15:03.355025+0000","last_clean":"2024-09-10T22:15:03.355025+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:15:03.355025+0000","last_undegraded":"2024-09-10T22:15:03.355025+0000","last_fullsized":"2024-09-10T22:15:03.355025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342673+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:15:03.342673+0000","last_peered":"2024-09-10T22:15:03.342673+0000","last_clean":"2024-09-10T22:15:03.342673+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:15:03.342673+0000","last_undegraded":"2024-09-10T22:15:03.342673+0000","last_fullsized":"2024-09-10T22:15:03.342673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350390+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:15:03.350390+0000","last_peered":"2024-09-10T22:15:03.350390+0000","last_clean":"2024-09-10T22:15:03.350390+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:15:03.350390+0000","last_undegraded":"2024-09-10T22:15:03.350390+0000","last_fullsized":"2024-09-10T22:15:03.350390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":41,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:24.422681+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:15:24.422681+0000","last_peered":"2024-09-10T22:15:24.422681+0000","last_clean":"2024-09-10T22:15:24.422681+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:15:24.422681+0000","last_undegraded":"2024-09-10T22:15:24.422681+0000","last_fullsized":"2024-09-10T22:15:24.422681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351734+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:15:03.351734+0000","last_peered":"2024-09-10T22:15:03.351734+0000","last_clean":"2024-09-10T22:15:03.351734+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:15:03.351734+0000","last_undegraded":"2024-09-10T22:15:03.351734+0000","last_fullsized":"2024-09-10T22:15:03.351734+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.403174+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:12.403174+0000","last_peered":"2024-09-10T22:15:12.403174+0000","last_clean":"2024-09-10T22:15:12.403174+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:12.403174+0000","last_undegraded":"2024-09-10T22:15:12.403174+0000","last_fullsized":"2024-09-10T22:15:12.403174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.403797+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:12.403797+0000","last_peered":"2024-09-10T22:15:12.403797+0000","last_clean":"2024-09-10T22:15:12.403797+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:12.403797+0000","last_undegraded":"2024-09-10T22:15:12.403797+0000","last_fullsized":"2024-09-10T22:15:12.403797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342091+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:15:03.342091+0000","last_peered":"2024-09-10T22:15:03.342091+0000","last_clean":"2024-09-10T22:15:03.342091+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:15:03.342091+0000","last_undegraded":"2024-09-10T22:15:03.342091+0000","last_fullsized":"2024-09-10T22:15:03.342091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351855+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:03.351855+0000","last_peered":"2024-09-10T22:15:03.351855+0000","last_clean":"2024-09-10T22:15:03.351855+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:03.351855+0000","last_undegraded":"2024-09-10T22:15:03.351855+0000","last_fullsized":"2024-09-10T22:15:03.351855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352917+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:15:03.352917+0000","last_peered":"2024-09-10T22:15:03.352917+0000","last_clean":"2024-09-10T22:15:03.352917+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:15:03.352917+0000","last_undegraded":"2024-09-10T22:15:03.352917+0000","last_fullsized":"2024-09-10T22:15:03.352917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:23.420652+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:15:23.420652+0000","last_peered":"2024-09-10T22:15:23.420652+0000","last_clean":"2024-09-10T22:15:23.420652+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:15:23.420652+0000","last_undegraded":"2024-09-10T22:15:23.420652+0000","last_fullsized":"2024-09-10T22:15:23.420652+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349655+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:15:03.349655+0000","last_peered":"2024-09-10T22:15:03.349655+0000","last_clean":"2024-09-10T22:15:03.349655+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:15:03.349655+0000","last_undegraded":"2024-09-10T22:15:03.349655+0000","last_fullsized":"2024-09-10T22:15:03.349655+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.390710+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:11.390710+0000","last_peered":"2024-09-10T22:15:11.390710+0000","last_clean":"2024-09-10T22:15:11.390710+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:11.390710+0000","last_undegraded":"2024-09-10T22:15:11.390710+0000","last_fullsized":"2024-09-10T22:15:11.390710+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351227+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:15:03.351227+0000","last_peered":"2024-09-10T22:15:03.351227+0000","last_clean":"2024-09-10T22:15:03.351227+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:15:03.351227+0000","last_undegraded":"2024-09-10T22:15:03.351227+0000","last_fullsized":"2024-09-10T22:15:03.351227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.389875+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:11.389875+0000","last_peered":"2024-09-10T22:15:11.389875+0000","last_clean":"2024-09-10T22:15:11.389875+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:11.389875+0000","last_undegraded":"2024-09-10T22:15:11.389875+0000","last_fullsized":"2024-09-10T22:15:11.389875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349478+0000","last_change":"2024-09-10T22:15:02.360315+0000","last_active":"2024-09-10T22:15:03.349478+0000","last_peered":"2024-09-10T22:15:03.349478+0000","last_clean":"2024-09-10T22:15:03.349478+0000","last_became_active":"2024-09-10T22:15:02.359647+0000","last_became_peered":"2024-09-10T22:15:02.359647+0000","last_unstale":"2024-09-10T22:15:03.349478+0000","last_undegraded":"2024-09-10T22:15:03.349478+0000","last_fullsized":"2024-09-10T22:15:03.349478+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:00:44.008755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'21","reported_seq":70,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:24.423355+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:15:24.423355+0000","last_peered":"2024-09-10T22:15:24.423355+0000","last_clean":"2024-09-10T22:15:24.423355+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:15:24.423355+0000","last_undegraded":"2024-09-10T22:15:24.423355+0000","last_fullsized":"2024-09-10T22:15:24.423355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41063,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":54,"num_write":22,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352466+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:15:03.352466+0000","last_peered":"2024-09-10T22:15:03.352466+0000","last_clean":"2024-09-10T22:15:03.352466+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:15:03.352466+0000","last_undegraded":"2024-09-10T22:15:03.352466+0000","last_fullsized":"2024-09-10T22:15:03.352466+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.404628+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:12.404628+0000","last_peered":"2024-09-10T22:15:12.404628+0000","last_clean":"2024-09-10T22:15:12.404628+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:12.404628+0000","last_undegraded":"2024-09-10T22:15:12.404628+0000","last_fullsized":"2024-09-10T22:15:12.404628+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351080+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:15:03.351080+0000","last_peered":"2024-09-10T22:15:03.351080+0000","last_clean":"2024-09-10T22:15:03.351080+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:15:03.351080+0000","last_undegraded":"2024-09-10T22:15:03.351080+0000","last_fullsized":"2024-09-10T22:15:03.351080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.390562+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:11.390562+0000","last_peered":"2024-09-10T22:15:11.390562+0000","last_clean":"2024-09-10T22:15:11.390562+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:11.390562+0000","last_undegraded":"2024-09-10T22:15:11.390562+0000","last_fullsized":"2024-09-10T22:15:11.390562+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354953+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:15:03.354953+0000","last_peered":"2024-09-10T22:15:03.354953+0000","last_clean":"2024-09-10T22:15:03.354953+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:15:03.354953+0000","last_undegraded":"2024-09-10T22:15:03.354953+0000","last_fullsized":"2024-09-10T22:15:03.354953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":37,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:24.422096+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:15:24.422096+0000","last_peered":"2024-09-10T22:15:24.422096+0000","last_clean":"2024-09-10T22:15:24.422096+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:15:24.422096+0000","last_undegraded":"2024-09-10T22:15:24.422096+0000","last_fullsized":"2024-09-10T22:15:24.422096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353279+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:15:03.353279+0000","last_peered":"2024-09-10T22:15:03.353279+0000","last_clean":"2024-09-10T22:15:03.353279+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:15:03.353279+0000","last_undegraded":"2024-09-10T22:15:03.353279+0000","last_fullsized":"2024-09-10T22:15:03.353279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405933+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:12.405933+0000","last_peered":"2024-09-10T22:15:12.405933+0000","last_clean":"2024-09-10T22:15:12.405933+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:12.405933+0000","last_undegraded":"2024-09-10T22:15:12.405933+0000","last_fullsized":"2024-09-10T22:15:12.405933+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350882+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:15:03.350882+0000","last_peered":"2024-09-10T22:15:03.350882+0000","last_clean":"2024-09-10T22:15:03.350882+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:15:03.350882+0000","last_undegraded":"2024-09-10T22:15:03.350882+0000","last_fullsized":"2024-09-10T22:15:03.350882+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:13.400458+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:13.400458+0000","last_peered":"2024-09-10T22:15:13.400458+0000","last_clean":"2024-09-10T22:15:13.400458+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:13.400458+0000","last_undegraded":"2024-09-10T22:15:13.400458+0000","last_fullsized":"2024-09-10T22:15:13.400458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342868+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:15:03.342868+0000","last_peered":"2024-09-10T22:15:03.342868+0000","last_clean":"2024-09-10T22:15:03.342868+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:15:03.342868+0000","last_undegraded":"2024-09-10T22:15:03.342868+0000","last_fullsized":"2024-09-10T22:15:03.342868+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.358247+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:03.358247+0000","last_peered":"2024-09-10T22:15:03.358247+0000","last_clean":"2024-09-10T22:15:03.358247+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:03.358247+0000","last_undegraded":"2024-09-10T22:15:03.358247+0000","last_fullsized":"2024-09-10T22:15:03.358247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355274+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:15:03.355274+0000","last_peered":"2024-09-10T22:15:03.355274+0000","last_clean":"2024-09-10T22:15:03.355274+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:15:03.355274+0000","last_undegraded":"2024-09-10T22:15:03.355274+0000","last_fullsized":"2024-09-10T22:15:03.355274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.356337+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:03.356337+0000","last_peered":"2024-09-10T22:15:03.356337+0000","last_clean":"2024-09-10T22:15:03.356337+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:03.356337+0000","last_undegraded":"2024-09-10T22:15:03.356337+0000","last_fullsized":"2024-09-10T22:15:03.356337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355332+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:15:03.355332+0000","last_peered":"2024-09-10T22:15:03.355332+0000","last_clean":"2024-09-10T22:15:03.355332+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:15:03.355332+0000","last_undegraded":"2024-09-10T22:15:03.355332+0000","last_fullsized":"2024-09-10T22:15:03.355332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405311+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:12.405311+0000","last_peered":"2024-09-10T22:15:12.405311+0000","last_clean":"2024-09-10T22:15:12.405311+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:12.405311+0000","last_undegraded":"2024-09-10T22:15:12.405311+0000","last_fullsized":"2024-09-10T22:15:12.405311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.355524+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:15:03.355524+0000","last_peered":"2024-09-10T22:15:03.355524+0000","last_clean":"2024-09-10T22:15:03.355524+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:15:03.355524+0000","last_undegraded":"2024-09-10T22:15:03.355524+0000","last_fullsized":"2024-09-10T22:15:03.355524+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.353769+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:03.353769+0000","last_peered":"2024-09-10T22:15:03.353769+0000","last_clean":"2024-09-10T22:15:03.353769+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:03.353769+0000","last_undegraded":"2024-09-10T22:15:03.353769+0000","last_fullsized":"2024-09-10T22:15:03.353769+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:13.401661+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:13.401661+0000","last_peered":"2024-09-10T22:15:13.401661+0000","last_clean":"2024-09-10T22:15:13.401661+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:13.401661+0000","last_undegraded":"2024-09-10T22:15:13.401661+0000","last_fullsized":"2024-09-10T22:15:13.401661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342195+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:15:03.342195+0000","last_peered":"2024-09-10T22:15:03.342195+0000","last_clean":"2024-09-10T22:15:03.342195+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:15:03.342195+0000","last_undegraded":"2024-09-10T22:15:03.342195+0000","last_fullsized":"2024-09-10T22:15:03.342195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.403044+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:12.403044+0000","last_peered":"2024-09-10T22:15:12.403044+0000","last_clean":"2024-09-10T22:15:12.403044+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:12.403044+0000","last_undegraded":"2024-09-10T22:15:12.403044+0000","last_fullsized":"2024-09-10T22:15:12.403044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350224+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:15:03.350224+0000","last_peered":"2024-09-10T22:15:03.350224+0000","last_clean":"2024-09-10T22:15:03.350224+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:15:03.350224+0000","last_undegraded":"2024-09-10T22:15:03.350224+0000","last_fullsized":"2024-09-10T22:15:03.350224+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:26.424373+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:15:26.424373+0000","last_peered":"2024-09-10T22:15:26.424373+0000","last_clean":"2024-09-10T22:15:26.424373+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:15:26.424373+0000","last_undegraded":"2024-09-10T22:15:26.424373+0000","last_fullsized":"2024-09-10T22:15:26.424373+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351568+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:15:03.351568+0000","last_peered":"2024-09-10T22:15:03.351568+0000","last_clean":"2024-09-10T22:15:03.351568+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:15:03.351568+0000","last_undegraded":"2024-09-10T22:15:03.351568+0000","last_fullsized":"2024-09-10T22:15:03.351568+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.354298+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:03.354298+0000","last_peered":"2024-09-10T22:15:03.354298+0000","last_clean":"2024-09-10T22:15:03.354298+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:03.354298+0000","last_undegraded":"2024-09-10T22:15:03.354298+0000","last_fullsized":"2024-09-10T22:15:03.354298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.343010+0000","last_change":"2024-09-10T22:15:02.359623+0000","last_active":"2024-09-10T22:15:03.343010+0000","last_peered":"2024-09-10T22:15:03.343010+0000","last_clean":"2024-09-10T22:15:03.343010+0000","last_became_active":"2024-09-10T22:15:02.359247+0000","last_became_peered":"2024-09-10T22:15:02.359247+0000","last_unstale":"2024-09-10T22:15:03.343010+0000","last_undegraded":"2024-09-10T22:15:03.343010+0000","last_fullsized":"2024-09-10T22:15:03.343010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:11.856907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352917+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:03.352917+0000","last_peered":"2024-09-10T22:15:03.352917+0000","last_clean":"2024-09-10T22:15:03.352917+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:03.352917+0000","last_undegraded":"2024-09-10T22:15:03.352917+0000","last_fullsized":"2024-09-10T22:15:03.352917+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:04.955822+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:15:04.955822+0000","last_peered":"2024-09-10T22:15:04.955822+0000","last_clean":"2024-09-10T22:15:04.955822+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:15:04.955822+0000","last_undegraded":"2024-09-10T22:15:04.955822+0000","last_fullsized":"2024-09-10T22:15:04.955822+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.385595+0000","last_change":"2024-09-10T22:15:00.549824+0000","last_active":"2024-09-10T22:15:11.385595+0000","last_peered":"2024-09-10T22:15:11.385595+0000","last_clean":"2024-09-10T22:15:11.385595+0000","last_became_active":"2024-09-10T22:15:00.549415+0000","last_became_peered":"2024-09-10T22:15:00.549415+0000","last_unstale":"2024-09-10T22:15:11.385595+0000","last_undegraded":"2024-09-10T22:15:11.385595+0000","last_fullsized":"2024-09-10T22:15:11.385595+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:03:22.013191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350767+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:15:03.350767+0000","last_peered":"2024-09-10T22:15:03.350767+0000","last_clean":"2024-09-10T22:15:03.350767+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:15:03.350767+0000","last_undegraded":"2024-09-10T22:15:03.350767+0000","last_fullsized":"2024-09-10T22:15:03.350767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'11","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:27.350740+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:15:27.350740+0000","last_peered":"2024-09-10T22:15:27.350740+0000","last_clean":"2024-09-10T22:15:27.350740+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:15:27.350740+0000","last_undegraded":"2024-09-10T22:15:27.350740+0000","last_fullsized":"2024-09-10T22:15:27.350740+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342461+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:15:03.342461+0000","last_peered":"2024-09-10T22:15:03.342461+0000","last_clean":"2024-09-10T22:15:03.342461+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:15:03.342461+0000","last_undegraded":"2024-09-10T22:15:03.342461+0000","last_fullsized":"2024-09-10T22:15:03.342461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.388913+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:11.388913+0000","last_peered":"2024-09-10T22:15:11.388913+0000","last_clean":"2024-09-10T22:15:11.388913+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:11.388913+0000","last_undegraded":"2024-09-10T22:15:11.388913+0000","last_fullsized":"2024-09-10T22:15:11.388913+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349949+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:15:03.349949+0000","last_peered":"2024-09-10T22:15:03.349949+0000","last_clean":"2024-09-10T22:15:03.349949+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:15:03.349949+0000","last_undegraded":"2024-09-10T22:15:03.349949+0000","last_fullsized":"2024-09-10T22:15:03.349949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.388309+0000","last_change":"2024-09-10T22:15:00.549895+0000","last_active":"2024-09-10T22:15:11.388309+0000","last_peered":"2024-09-10T22:15:11.388309+0000","last_clean":"2024-09-10T22:15:11.388309+0000","last_became_active":"2024-09-10T22:15:00.549528+0000","last_became_peered":"2024-09-10T22:15:00.549528+0000","last_unstale":"2024-09-10T22:15:11.388309+0000","last_undegraded":"2024-09-10T22:15:11.388309+0000","last_fullsized":"2024-09-10T22:15:11.388309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:40:27.008226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.350065+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:15:03.350065+0000","last_peered":"2024-09-10T22:15:03.350065+0000","last_clean":"2024-09-10T22:15:03.350065+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:15:03.350065+0000","last_undegraded":"2024-09-10T22:15:03.350065+0000","last_fullsized":"2024-09-10T22:15:03.350065+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.389669+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:11.389669+0000","last_peered":"2024-09-10T22:15:11.389669+0000","last_clean":"2024-09-10T22:15:11.389669+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:11.389669+0000","last_undegraded":"2024-09-10T22:15:11.389669+0000","last_fullsized":"2024-09-10T22:15:11.389669+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342864+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:15:03.342864+0000","last_peered":"2024-09-10T22:15:03.342864+0000","last_clean":"2024-09-10T22:15:03.342864+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:15:03.342864+0000","last_undegraded":"2024-09-10T22:15:03.342864+0000","last_fullsized":"2024-09-10T22:15:03.342864+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351372+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:03.351372+0000","last_peered":"2024-09-10T22:15:03.351372+0000","last_clean":"2024-09-10T22:15:03.351372+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:03.351372+0000","last_undegraded":"2024-09-10T22:15:03.351372+0000","last_fullsized":"2024-09-10T22:15:03.351372+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342297+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:15:03.342297+0000","last_peered":"2024-09-10T22:15:03.342297+0000","last_clean":"2024-09-10T22:15:03.342297+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:15:03.342297+0000","last_undegraded":"2024-09-10T22:15:03.342297+0000","last_fullsized":"2024-09-10T22:15:03.342297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:11.389222+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:11.389222+0000","last_peered":"2024-09-10T22:15:11.389222+0000","last_clean":"2024-09-10T22:15:11.389222+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:11.389222+0000","last_undegraded":"2024-09-10T22:15:11.389222+0000","last_fullsized":"2024-09-10T22:15:11.389222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352994+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:15:03.352994+0000","last_peered":"2024-09-10T22:15:03.352994+0000","last_clean":"2024-09-10T22:15:03.352994+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:15:03.352994+0000","last_undegraded":"2024-09-10T22:15:03.352994+0000","last_fullsized":"2024-09-10T22:15:03.352994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.352402+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:15:03.352402+0000","last_peered":"2024-09-10T22:15:03.352402+0000","last_clean":"2024-09-10T22:15:03.352402+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:15:03.352402+0000","last_undegraded":"2024-09-10T22:15:03.352402+0000","last_fullsized":"2024-09-10T22:15:03.352402+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.356747+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:03.356747+0000","last_peered":"2024-09-10T22:15:03.356747+0000","last_clean":"2024-09-10T22:15:03.356747+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:03.356747+0000","last_undegraded":"2024-09-10T22:15:03.356747+0000","last_fullsized":"2024-09-10T22:15:03.356747+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349261+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:15:03.349261+0000","last_peered":"2024-09-10T22:15:03.349261+0000","last_clean":"2024-09-10T22:15:03.349261+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:15:03.349261+0000","last_undegraded":"2024-09-10T22:15:03.349261+0000","last_fullsized":"2024-09-10T22:15:03.349261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405237+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:12.405237+0000","last_peered":"2024-09-10T22:15:12.405237+0000","last_clean":"2024-09-10T22:15:12.405237+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:12.405237+0000","last_undegraded":"2024-09-10T22:15:12.405237+0000","last_fullsized":"2024-09-10T22:15:12.405237+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.351001+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:15:03.351001+0000","last_peered":"2024-09-10T22:15:03.351001+0000","last_clean":"2024-09-10T22:15:03.351001+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:15:03.351001+0000","last_undegraded":"2024-09-10T22:15:03.351001+0000","last_fullsized":"2024-09-10T22:15:03.351001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.349871+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:03.349871+0000","last_peered":"2024-09-10T22:15:03.349871+0000","last_clean":"2024-09-10T22:15:03.349871+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:03.349871+0000","last_undegraded":"2024-09-10T22:15:03.349871+0000","last_fullsized":"2024-09-10T22:15:03.349871+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:03.342564+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:15:03.342564+0000","last_peered":"2024-09-10T22:15:03.342564+0000","last_clean":"2024-09-10T22:15:03.342564+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:15:03.342564+0000","last_undegraded":"2024-09-10T22:15:03.342564+0000","last_fullsized":"2024-09-10T22:15:03.342564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-10T22:15:12.405263+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:12.405263+0000","last_peered":"2024-09-10T22:15:12.405263+0000","last_clean":"2024-09-10T22:15:12.405263+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:12.405263+0000","last_undegraded":"2024-09-10T22:15:12.405263+0000","last_fullsized":"2024-09-10T22:15:12.405263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45064,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":102,"num_read_kb":100,"num_write":155,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":368640,"data_stored":148501,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710738,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":815104,"data_stored":391622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906967,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":1024166,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070492,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":391858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266721,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31996,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713156,"statfs":{"total":95995035648,"available":95962271744,"internally_reserved":0,"allocated":831488,"data_stored":391778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36204,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708948,"statfs":{"total":95995035648,"available":95957962752,"internally_reserved":0,"allocated":880640,"data_stored":983708,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626476,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":391247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":983392,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":391684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":391558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":897024,"data_stored":447153,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":432103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":839680,"data_stored":392518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":56113,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":42641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:15:31.987 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T22:15:31.987 INFO:tasks.cephadm:Setting up client nodes... 2024-09-10T22:15:31.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-10T22:15:32.251 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:32 smithi005 ceph-mon[31115]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:15:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 -- 172.21.15.5:0/1869246262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 msgr2=0x7f355810d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 --2- 172.21.15.5:0/1869246262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355810d100 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3550009930 tx=0x7f355002a420 comp rx=0 tx=0).stop 2024-09-10T22:15:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 -- 172.21.15.5:0/1869246262 shutdown_connections 2024-09-10T22:15:32.723 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 --2- 172.21.15.5:0/1869246262 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355810d100 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 --2- 172.21.15.5:0/1869246262 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 0x7f3558106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 --2- 172.21.15.5:0/1869246262 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3558104c60 0x7f3558105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.720+0000 7f35606b6640 1 -- 172.21.15.5:0/1869246262 >> 172.21.15.5:0/1869246262 conn(0x7f3558100510 msgr2=0x7f3558102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 -- 172.21.15.5:0/1869246262 shutdown_connections 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 -- 172.21.15.5:0/1869246262 wait complete. 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 Processor -- start 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 -- start start 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3558104c60 0x7f355819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 0x7f355819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:32.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f35581108c0 con 0x7f3558106780 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3558110740 con 0x7f3558104c60 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f35606b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3558110a40 con 0x7f3558105dc0 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f355ec53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f355ec53640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355819c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48128/0 (socket says 172.21.15.5:48128) 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.721+0000 7f355ec53640 1 -- 172.21.15.5:0/1131164601 learned_addr learned my addr 172.21.15.5:0/1131164601 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355dc51640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 0x7f355819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355e452640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3558104c60 0x7f355819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355ec53640 1 -- 172.21.15.5:0/1131164601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 msgr2=0x7f355819b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355ec53640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 0x7f355819b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355ec53640 1 -- 172.21.15.5:0/1131164601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3558104c60 msgr2=0x7f355819af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355ec53640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3558104c60 0x7f355819af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.725 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355ec53640 1 -- 172.21.15.5:0/1131164601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355819cac0 con 0x7f3558106780 2024-09-10T22:15:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355dc51640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 0x7f355819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f355ec53640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355819c220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3550009900 tx=0x7f35500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355003f030 con 0x7f3558106780 2024-09-10T22:15:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3550003cb0 con 0x7f3558106780 2024-09-10T22:15:32.726 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355819cd50 con 0x7f3558106780 2024-09-10T22:15:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550035070 con 0x7f3558106780 2024-09-10T22:15:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.722+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35581a32c0 con 0x7f3558106780 2024-09-10T22:15:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.723+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355810bf80 con 0x7f3558106780 2024-09-10T22:15:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.725+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f355003bbb0 con 0x7f3558106780 2024-09-10T22:15:32.727 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.725+0000 7f35577fe640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f35400b5370 0x7f35400b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.725+0000 7f355e452640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f35400b5370 0x7f35400b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.725+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f3550106940 con 0x7f3558106780 2024-09-10T22:15:32.728 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.726+0000 7f355e452640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f35400b5370 0x7f35400b7830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3548005fd0 tx=0x7f3548009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:32.730 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.729+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f35500cd850 con 0x7f3558106780 2024-09-10T22:15:32.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:32 smithi052 ceph-mon[34997]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:15:32.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:32 smithi189 ceph-mon[35784]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:15:32.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.985+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f355802e5c0 con 0x7f3558106780 2024-09-10T22:15:32.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.988+0000 7f35577fe640 1 -- 172.21.15.5:0/1131164601 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f35500cd150 con 0x7f3558106780 2024-09-10T22:15:32.989 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-09-10T22:15:32.990 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQAExeBmxKHWOhAAQ/AitBiUotHR6LTzIBocvA== 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f35400b5370 msgr2=0x7f35400b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f35400b5370 0x7f35400b7830 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3548005fd0 tx=0x7f3548009870 comp rx=0 tx=0).stop 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 msgr2=0x7f355819c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355819c220 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3550009900 tx=0x7f35500042f0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 shutdown_connections 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f35400b5370 0x7f35400b7830 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3558106780 0x7f355819c220 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.992 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3558105dc0 0x7f355819b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 --2- 172.21.15.5:0/1131164601 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3558104c60 0x7f355819af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:32.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 >> 172.21.15.5:0/1131164601 conn(0x7f3558100510 msgr2=0x7f3558109150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:32.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.990+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 shutdown_connections 2024-09-10T22:15:32.993 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:32.991+0000 7f35606b6640 1 -- 172.21.15.5:0/1131164601 wait complete. 2024-09-10T22:15:33.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:33 smithi005 ceph-mon[31115]: pgmap v305: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-10T22:15:33.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:33 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1131164601' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T22:15:33.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:33 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1131164601' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T22:15:33.637 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:15:33.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-10T22:15:33.637 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T22:15:33.679 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-10T22:15:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:33 smithi052 ceph-mon[34997]: pgmap v305: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-10T22:15:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:33 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1131164601' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T22:15:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:33 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1131164601' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T22:15:33.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:33 smithi189 ceph-mon[35784]: pgmap v305: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-09-10T22:15:33.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:33 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1131164601' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-10T22:15:33.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:33 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1131164601' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-10T22:15:33.979 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 -- 172.21.15.5:0/492606650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6900109170 msgr2=0x7f690010f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 --2- 172.21.15.5:0/492606650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6900109170 0x7f690010f970 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009ca0 tx=0x7f68f802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 -- 172.21.15.5:0/492606650 shutdown_connections 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 --2- 172.21.15.5:0/492606650 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6900109170 0x7f690010f970 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 --2- 172.21.15.5:0/492606650 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f69001087f0 0x7f6900108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 --2- 172.21.15.5:0/492606650 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 0x7f69001031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.447+0000 7f6907a67640 1 -- 172.21.15.5:0/492606650 >> 172.21.15.5:0/492606650 conn(0x7f69000fe830 msgr2=0x7f6900100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 -- 172.21.15.5:0/492606650 shutdown_connections 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 -- 172.21.15.5:0/492606650 wait complete. 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 Processor -- start 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 -- start start 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 0x7f69000754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 0x7f69000759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6900109170 0x7f6900075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:34.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6900112e80 con 0x7f69001087f0 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6900112d00 con 0x7f6900109170 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.448+0000 7f6907a67640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6900113000 con 0x7f6900102de0 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 0x7f69000759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 0x7f69000759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48138/0 (socket says 172.21.15.5:48138) 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 -- 172.21.15.5:0/4198403620 learned_addr learned my addr 172.21.15.5:0/4198403620 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6906004640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6900109170 0x7f6900075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 -- 172.21.15.5:0/4198403620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 msgr2=0x7f69000754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905803640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 0x7f69000754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 0x7f69000754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 -- 172.21.15.5:0/4198403620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6900109170 msgr2=0x7f6900075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6900109170 0x7f6900075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 -- 172.21.15.5:0/4198403620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69001a7670 con 0x7f69001087f0 2024-09-10T22:15:34.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6906004640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6900109170 0x7f6900075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905803640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 0x7f69000754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6905002640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 0x7f69000759e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f68f000e9f0 tx=0x7f68f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f000cd80 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68f00108e0 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69001a7960 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0018980 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.449+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69001a7ef0 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.450+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69001031c0 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.452+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f68f0010430 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.452+0000 7f68f6ffd640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68ec0b5470 0x7f68ec0b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.453+0000 7f6905803640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68ec0b5470 0x7f68ec0b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.453+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7979+0+0 (secure 0 0 0) 0x7f68f00e6560 con 0x7f69001087f0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.453+0000 7f6905803640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68ec0b5470 0x7f68ec0b7930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009b50 tx=0x7f68fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:34.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.455+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f68f00ad370 con 0x7f69001087f0 2024-09-10T22:15:34.647 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.645+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f69001a8350 con 0x7f69001087f0 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]} : dispatch 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T22:15:34.647 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:34 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]} : dispatch 2024-09-10T22:15:34.648 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.646+0000 7f68f6ffd640 1 -- 172.21.15.5:0/4198403620 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7f68f00acc70 con 0x7f69001087f0 2024-09-10T22:15:34.648 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68ec0b5470 msgr2=0x7f68ec0b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68ec0b5470 0x7f68ec0b7930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009b50 tx=0x7f68fc005f90 comp rx=0 tx=0).stop 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 msgr2=0x7f69000759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 0x7f69000759e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f68f000e9f0 tx=0x7f68f000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 shutdown_connections 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f68ec0b5470 0x7f68ec0b7930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6900109170 0x7f6900075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f69001087f0 0x7f69000759e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 --2- 172.21.15.5:0/4198403620 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6900102de0 0x7f69000754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 >> 172.21.15.5:0/4198403620 conn(0x7f69000fe830 msgr2=0x7f6900100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 shutdown_connections 2024-09-10T22:15:34.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:34.648+0000 7f6907a67640 1 -- 172.21.15.5:0/4198403620 wait complete. 2024-09-10T22:15:34.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-10T22:15:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-10T22:15:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-10T22:15:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T22:15:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]} : dispatch 2024-09-10T22:15:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T22:15:34.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:34 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]} : dispatch 2024-09-10T22:15:34.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-10T22:15:34.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]} : dispatch 2024-09-10T22:15:34.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-10T22:15:34.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2024-09-10T22:15:34.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]} : dispatch 2024-09-10T22:15:34.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2024-09-10T22:15:34.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:34 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]} : dispatch 2024-09-10T22:15:35.420 INFO:teuthology.orchestra.run.smithi005.stdout:[{"version":49,"timestamp":"2024-09-10T22:14:52.316525+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-10T22:15:35.420 INFO:tasks.ceph_manager:config epoch is 49 2024-09-10T22:15:35.421 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T22:15:35.421 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-10T22:15:35.421 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-10T22:15:35.683 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: pgmap v306: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:15:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:35 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/4198403620' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: pgmap v306: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:15:35.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:35 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4198403620' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T22:15:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: pgmap v306: 97 pgs: 97 active+clean; 634 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-09-10T22:15:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: osdmap e77: 12 total, 12 up, 12 in 2024-09-10T22:15:35.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:35 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/4198403620' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-10T22:15:36.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 -- 172.21.15.5:0/1669435175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc108060 msgr2=0x7fa4cc10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/1669435175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc108060 0x7fa4cc10e860 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4009ca0 tx=0x7fa4c402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 -- 172.21.15.5:0/1669435175 shutdown_connections 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/1669435175 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc108060 0x7fa4cc10e860 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/1669435175 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc1076e0 0x7fa4cc107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/1669435175 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 -- 172.21.15.5:0/1669435175 >> 172.21.15.5:0/1669435175 conn(0x7fa4cc0fd700 msgr2=0x7fa4cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 -- 172.21.15.5:0/1669435175 shutdown_connections 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.179+0000 7fa4d18c1640 1 -- 172.21.15.5:0/1669435175 wait complete. 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 Processor -- start 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 -- start start 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc1076e0 0x7fa4cc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:36.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc108060 0x7fa4cc19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc111d20 con 0x7fa4cc101cd0 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc111ba0 con 0x7fa4cc108060 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4d18c1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa4cc111ea0 con 0x7fa4cc1076e0 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48156/0 (socket says 172.21.15.5:48156) 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 -- 172.21.15.5:0/3819054945 learned_addr learned my addr 172.21.15.5:0/3819054945 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4c3fff640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc1076e0 0x7fa4cc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4cb7fe640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc108060 0x7fa4cc19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 -- 172.21.15.5:0/3819054945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc1076e0 msgr2=0x7fa4cc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc1076e0 0x7fa4cc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 -- 172.21.15.5:0/3819054945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc108060 msgr2=0x7fa4cc19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:36.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc108060 0x7fa4cc19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 -- 172.21.15.5:0/3819054945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4cc1a5430 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4cb7fe640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc108060 0x7fa4cc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.180+0000 7fa4caffd640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc19a050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00d770 tx=0x7fa4bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.181+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc017070 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.181+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4bc0054d0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.181+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc004c30 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.181+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4cc1a5720 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.181+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4cc1a5c10 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.182+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4cc1020b0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.184+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fa4bc004dd0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.185+0000 7fa4d08bf640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa4b80b53f0 0x7fa4b80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.185+0000 7fa4c3fff640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa4b80b53f0 0x7fa4b80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.185+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fa4bc0e5bf0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.185+0000 7fa4c3fff640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa4b80b53f0 0x7fa4b80b78b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc06c090 tx=0x7fa4b400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:36.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.188+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa4bc0ac9a0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.423+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa4cc02e5c0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.427+0000 7fa4d08bf640 1 -- 172.21.15.5:0/3819054945 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294205 (secure 0 0 0) 0x7fa4bc0ac2a0 con 0x7fa4cc101cd0 2024-09-10T22:15:36.432 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:36.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa4b80b53f0 msgr2=0x7fa4b80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa4b80b53f0 0x7fa4b80b78b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc06c090 tx=0x7fa4b400b390 comp rx=0 tx=0).stop 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 msgr2=0x7fa4cc19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc19a050 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00d770 tx=0x7fa4bc00dc30 comp rx=0 tx=0).stop 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 shutdown_connections 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa4b80b53f0 0x7fa4b80b78b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa4cc108060 0x7fa4cc19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa4cc1076e0 0x7fa4cc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 --2- 172.21.15.5:0/3819054945 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa4cc101cd0 0x7fa4cc19a050 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 >> 172.21.15.5:0/3819054945 conn(0x7fa4cc0fd700 msgr2=0x7fa4cc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 shutdown_connections 2024-09-10T22:15:36.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:36.431+0000 7fa4d18c1640 1 -- 172.21.15.5:0/3819054945 wait complete. 2024-09-10T22:15:36.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:36 smithi052 ceph-mon[34997]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T22:15:36.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:36 smithi052 ceph-mon[34997]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-10T22:15:36.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:36 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3819054945' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T22:15:36.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:36 smithi005 ceph-mon[31115]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T22:15:36.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:36 smithi005 ceph-mon[31115]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-10T22:15:36.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:36 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3819054945' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T22:15:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:36 smithi189 ceph-mon[35784]: osdmap e78: 12 total, 12 up, 12 in 2024-09-10T22:15:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:36 smithi189 ceph-mon[35784]: pgmap v309: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-10T22:15:36.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:36 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3819054945' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-10T22:15:37.225 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":2373125998},{"type":"v1","addr":"172.21.15.5:6801","nonce":2373125998}]},"active_addr":"172.21.15.5:6801/2373125998","active_change":"2024-09-10T22:07:33.618484+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24121,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24131,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.5:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2227085846}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":296780087}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":2639910305}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":570612030}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3244694486}]}]} 2024-09-10T22:15:37.231 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-10T22:15:37.231 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-10T22:15:37.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:15:37.488 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/3814389479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0101870 msgr2=0x7f9ba0101c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/3814389479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0101870 0x7f9ba0101c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009900 tx=0x7f9b9c02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/3814389479 shutdown_connections 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/3814389479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba010f420 0x7f9ba0111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/3814389479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ba0102190 0x7f9ba010eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/3814389479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0101870 0x7f9ba0101c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:37.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/3814389479 >> 172.21.15.5:0/3814389479 conn(0x7f9ba00fd700 msgr2=0x7f9ba00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/3814389479 shutdown_connections 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.955+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/3814389479 wait complete. 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 Processor -- start 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 -- start start 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba0101870 0x7f9ba019b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 0x7f9ba019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ba010f420 0x7f9ba01a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0115080 con 0x7f9ba0102190 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0114f00 con 0x7f9ba0101870 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba7ba0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9ba0115200 con 0x7f9ba010f420 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 0x7f9ba019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 0x7f9ba019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48172/0 (socket says 172.21.15.5:48172) 2024-09-10T22:15:37.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 -- 172.21.15.5:0/455905089 learned_addr learned my addr 172.21.15.5:0/455905089 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba593c640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba0101870 0x7f9ba019b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba613d640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ba010f420 0x7f9ba01a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 -- 172.21.15.5:0/455905089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ba010f420 msgr2=0x7f9ba01a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ba010f420 0x7f9ba01a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 -- 172.21.15.5:0/455905089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba0101870 msgr2=0x7f9ba019b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba0101870 0x7f9ba019b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba513b640 1 -- 172.21.15.5:0/455905089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba01a16e0 con 0x7f9ba0102190 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.956+0000 7f9ba593c640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba0101870 0x7f9ba019b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:37.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.957+0000 7f9ba513b640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 0x7f9ba019bb70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000b4a0 tx=0x7f9b9000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.957+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90014070 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.957+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b90010ac0 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.957+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b90017c30 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.957+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba01a19d0 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.957+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ba01a8110 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.958+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ba0101cd0 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.959+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9b90010610 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.960+0000 7f9b96ffd640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b8c0b53f0 0x7f9b8c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.960+0000 7f9ba593c640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b8c0b53f0 0x7f9b8c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.960+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f9b900e5690 con 0x7f9ba0102190 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.960+0000 7f9ba593c640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b8c0b53f0 0x7f9b8c0b78b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c031440 tx=0x7f9b9c0095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:37.978 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:37.963+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9b900ac3c0 con 0x7f9ba0102190 2024-09-10T22:15:38.152 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.151+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ba019c760 con 0x7f9ba0102190 2024-09-10T22:15:38.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.152+0000 7f9b96ffd640 1 -- 172.21.15.5:0/455905089 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7f9b900abcc0 con 0x7f9ba0102190 2024-09-10T22:15:38.154 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:38.154 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:15:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.154+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b8c0b53f0 msgr2=0x7f9b8c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.154+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b8c0b53f0 0x7f9b8c0b78b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c031440 tx=0x7f9b9c0095f0 comp rx=0 tx=0).stop 2024-09-10T22:15:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.154+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 msgr2=0x7f9ba019bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 0x7f9ba019bb70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000b4a0 tx=0x7f9b9000b960 comp rx=0 tx=0).stop 2024-09-10T22:15:38.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 shutdown_connections 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9b8c0b53f0 0x7f9b8c0b78b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9ba010f420 0x7f9ba01a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9ba0102190 0x7f9ba019bb70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 --2- 172.21.15.5:0/455905089 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9ba0101870 0x7f9ba019b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 >> 172.21.15.5:0/455905089 conn(0x7f9ba00fd700 msgr2=0x7f9ba00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 shutdown_connections 2024-09-10T22:15:38.157 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:38.155+0000 7f9ba7ba0640 1 -- 172.21.15.5:0/455905089 wait complete. 2024-09-10T22:15:38.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:38 smithi005 ceph-mon[31115]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:38.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/455905089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:38.958 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-10T22:15:38.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:15:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:38 smithi189 ceph-mon[35784]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/455905089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:39.222 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:39.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:38 smithi052 ceph-mon[34997]: pgmap v310: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.5 KiB/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:39.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/455905089' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 -- 172.21.15.5:0/1620227951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98281076a0 msgr2=0x7f9828107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:39.701 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 --2- 172.21.15.5:0/1620227951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98281076a0 0x7f9828107ae0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f981c009900 tx=0x7f981c02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 -- 172.21.15.5:0/1620227951 shutdown_connections 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 --2- 172.21.15.5:0/1620227951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828108020 0x7f982810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 --2- 172.21.15.5:0/1620227951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98281076a0 0x7f9828107ae0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 --2- 172.21.15.5:0/1620227951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9828101c90 0x7f9828102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 -- 172.21.15.5:0/1620227951 >> 172.21.15.5:0/1620227951 conn(0x7f98280fd700 msgr2=0x7f98280ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 -- 172.21.15.5:0/1620227951 shutdown_connections 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.673+0000 7f982ee7b640 1 -- 172.21.15.5:0/1620227951 wait complete. 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 Processor -- start 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 -- start start 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828101c90 0x7f98281993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98281076a0 0x7f9828199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 0x7f982819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:39.702 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9828112e20 con 0x7f9828108020 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9828112ca0 con 0x7f9828101c90 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.674+0000 7f982ee7b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9828112fa0 con 0x7f98281076a0 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 0x7f982819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 0x7f982819ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:48196/0 (socket says 172.21.15.5:48196) 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 -- 172.21.15.5:0/946483915 learned_addr learned my addr 172.21.15.5:0/946483915 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f9827fff640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98281076a0 0x7f9828199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982cc17640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828101c90 0x7f98281993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 -- 172.21.15.5:0/946483915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98281076a0 msgr2=0x7f9828199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98281076a0 0x7f9828199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 -- 172.21.15.5:0/946483915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828101c90 msgr2=0x7f98281993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828101c90 0x7f98281993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 -- 172.21.15.5:0/946483915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982819f480 con 0x7f9828108020 2024-09-10T22:15:39.703 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982cc17640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828101c90 0x7f98281993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982d418640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 0x7f982819ecb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f982000b970 tx=0x7f982000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9820019070 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9820014440 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982819f770 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.675+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98200075d0 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.676+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98281a5e30 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.677+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98281020f0 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.678+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f982000cb40 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.679+0000 7f9825ffb640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f98100b5370 0x7f98100b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.679+0000 7f982cc17640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f98100b5370 0x7f98100b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.679+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f98200e5530 con 0x7f9828108020 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.679+0000 7f982cc17640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f98100b5370 0x7f98100b7830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9818009930 tx=0x7f9818008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:39.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.683+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98200abc10 con 0x7f9828108020 2024-09-10T22:15:39.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.870+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f982802e5c0 con 0x7f9828108020 2024-09-10T22:15:39.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.871+0000 7f9825ffb640 1 -- 172.21.15.5:0/946483915 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7f98200b0640 con 0x7f9828108020 2024-09-10T22:15:39.873 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:15:39.873 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:15:39.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f98100b5370 msgr2=0x7f98100b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:39.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f98100b5370 0x7f98100b7830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9818009930 tx=0x7f9818008040 comp rx=0 tx=0).stop 2024-09-10T22:15:39.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 msgr2=0x7f982819ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:39.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 0x7f982819ecb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f982000b970 tx=0x7f982000be30 comp rx=0 tx=0).stop 2024-09-10T22:15:39.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 shutdown_connections 2024-09-10T22:15:39.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f98100b5370 0x7f98100b7830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9828108020 0x7f982819ecb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98281076a0 0x7f9828199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 --2- 172.21.15.5:0/946483915 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9828101c90 0x7f98281993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 >> 172.21.15.5:0/946483915 conn(0x7f98280fd700 msgr2=0x7f98280ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 shutdown_connections 2024-09-10T22:15:39.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:39.874+0000 7f982ee7b640 1 -- 172.21.15.5:0/946483915 wait complete. 2024-09-10T22:15:40.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-10T22:15:40.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-10T22:15:40.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-10T22:15:40.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-10T22:15:40.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-10T22:15:40.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-10T22:15:40.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-10T22:15:40.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-10T22:15:40.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-10T22:15:40.700 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-10T22:15:40.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-10T22:15:40.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-10T22:15:41.019 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:40 smithi005 ceph-mon[31115]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 639 B/s wr, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:41.019 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:40 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/946483915' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:41.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:40 smithi189 ceph-mon[35784]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 639 B/s wr, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:41.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:40 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/946483915' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:41.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:40 smithi052 ceph-mon[34997]: pgmap v311: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 639 B/s wr, 4 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:41.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:40 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/946483915' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:15:41.435 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:41.435 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:41.457 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:41.492 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 -- 172.21.15.5:0/1041726809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4108040 msgr2=0x7fc0b410e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 --2- 172.21.15.5:0/1041726809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4108040 0x7fc0b410e840 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009ca0 tx=0x7fc0ac02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 -- 172.21.15.5:0/1041726809 shutdown_connections 2024-09-10T22:15:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 --2- 172.21.15.5:0/1041726809 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4108040 0x7fc0b410e840 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 --2- 172.21.15.5:0/1041726809 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b41076c0 0x7fc0b4107b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 --2- 172.21.15.5:0/1041726809 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b4101cb0 0x7fc0b4102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 -- 172.21.15.5:0/1041726809 >> 172.21.15.5:0/1041726809 conn(0x7fc0b40fd740 msgr2=0x7fc0b40ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 -- 172.21.15.5:0/1041726809 shutdown_connections 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.199+0000 7fc0b9397640 1 -- 172.21.15.5:0/1041726809 wait complete. 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 Processor -- start 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 -- start start 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4101cb0 0x7fc0b410f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b41076c0 0x7fc0b410f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b4108040 0x7fc0b410fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4112de0 con 0x7fc0b4101cb0 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4112c60 con 0x7fc0b4108040 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b9397640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4112f60 con 0x7fc0b41076c0 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.200+0000 7fc0b2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4101cb0 0x7fc0b410f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4101cb0 0x7fc0b410f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47426/0 (socket says 172.21.15.5:47426) 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 -- 172.21.15.5:0/2857827549 learned_addr learned my addr 172.21.15.5:0/2857827549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b37fe640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b4108040 0x7fc0b410fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b27fc640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b41076c0 0x7fc0b410f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 -- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b41076c0 msgr2=0x7fc0b410f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b41076c0 0x7fc0b410f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 -- 172.21.15.5:0/2857827549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b4108040 msgr2=0x7fc0b410fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b4108040 0x7fc0b410fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 -- 172.21.15.5:0/2857827549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b41a7610 con 0x7fc0b4101cb0 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b27fc640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0b41076c0 0x7fc0b410f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b37fe640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0b4108040 0x7fc0b410fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b2ffd640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4101cb0 0x7fc0b410f350 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c970 tx=0x7fc0a400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4007bb0 con 0x7fc0b4101cb0 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b41a7900 con 0x7fc0b4101cb0 2024-09-10T22:15:42.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0a4007d50 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400f450 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.201+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b41a7df0 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.202+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc0b40fe920 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.204+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc0a4004f00 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.204+0000 7fc09bfff640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc09c0b5370 0x7fc09c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.204+0000 7fc0b27fc640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc09c0b5370 0x7fc09c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc0a40e5f40 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc09bfff640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] conn(0x7fc09c0bed90 0x7fc09c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 --> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc09c0c1900 con 0x7fc09c0bed90 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fc0a40e6390 con 0x7fc0b4101cb0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc0b27fc640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc09c0b5370 0x7fc09c0b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4110e40 tx=0x7fc0a8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc0b37fe640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] conn(0x7fc09c0bed90 0x7fc09c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.205+0000 7fc0b37fe640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] conn(0x7fc09c0bed90 0x7fc09c0c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:42.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.206+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== osd.5 v2:172.21.15.189:6808/3637282250 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc09c0c1900 con 0x7fc09c0bed90 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.220+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 --> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc0b4102f60 con 0x7fc09c0bed90 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.220+0000 7fc09bfff640 1 -- 172.21.15.5:0/2857827549 <== osd.5 v2:172.21.15.189:6808/3637282250 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc0b4102f60 con 0x7fc09c0bed90 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.220+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] conn(0x7fc09c0bed90 msgr2=0x7fc09c0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.220+0000 7fc0b9397640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] conn(0x7fc09c0bed90 0x7fc09c0c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc09c0b5370 msgr2=0x7fc09c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc09c0b5370 0x7fc09c0b7830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4110e40 tx=0x7fc0a8005e50 comp rx=0 tx=0).stop 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4101cb0 msgr2=0x7fc0b410f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 --2- 172.21.15.5:0/2857827549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0b4101cb0 0x7fc0b410f350 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c970 tx=0x7fc0a400ce30 comp rx=0 tx=0).stop 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b37fe640 1 -- 172.21.15.5:0/2857827549 reap_dead start 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 shutdown_connections 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 >> 172.21.15.5:0/2857827549 conn(0x7fc0b40fd740 msgr2=0x7fc0b40fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 shutdown_connections 2024-09-10T22:15:42.229 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.221+0000 7fc0b9397640 1 -- 172.21.15.5:0/2857827549 wait complete. 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 -- 172.21.15.5:0/2742250596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 msgr2=0x7fe21c1031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 --2- 172.21.15.5:0/2742250596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c1031a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe210009900 tx=0x7fe21002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 -- 172.21.15.5:0/2742250596 shutdown_connections 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 --2- 172.21.15.5:0/2742250596 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe21c109150 0x7fe21c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 --2- 172.21.15.5:0/2742250596 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe21c1087d0 0x7fe21c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 --2- 172.21.15.5:0/2742250596 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c1031a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 -- 172.21.15.5:0/2742250596 >> 172.21.15.5:0/2742250596 conn(0x7fe21c0fe830 msgr2=0x7fe21c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 -- 172.21.15.5:0/2742250596 shutdown_connections 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.626+0000 7fe223023640 1 -- 172.21.15.5:0/2742250596 wait complete. 2024-09-10T22:15:42.636 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 Processor -- start 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 -- start start 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe21c1087d0 0x7fe21c199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe21c109150 0x7fe21c19ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c112dd0 con 0x7fe21c102dc0 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c112c50 con 0x7fe21c109150 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe223023640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe21c112f50 con 0x7fe21c1087d0 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe220dbf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe220dbf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47452/0 (socket says 172.21.15.5:47452) 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.627+0000 7fe220dbf640 1 -- 172.21.15.5:0/1709444363 learned_addr learned my addr 172.21.15.5:0/1709444363 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe2215c0640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe21c109150 0x7fe21c19ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe220dbf640 1 -- 172.21.15.5:0/1709444363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe21c1087d0 msgr2=0x7fe21c199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe21bfff640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe21c1087d0 0x7fe21c199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe220dbf640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe21c1087d0 0x7fe21c199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe220dbf640 1 -- 172.21.15.5:0/1709444363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe21c109150 msgr2=0x7fe21c19ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe220dbf640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe21c109150 0x7fe21c19ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe220dbf640 1 -- 172.21.15.5:0/1709444363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21c19f3d0 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe2215c0640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe21c109150 0x7fe21c19ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe21bfff640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe21c1087d0 0x7fe21c199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe220dbf640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c199320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe210005940 tx=0x7fe2100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21003f030 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe210003cb0 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe21c19f660 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe210035070 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.628+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe21c1a5d80 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.629+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe21c0638e0 con 0x7fe21c102dc0 2024-09-10T22:15:42.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.631+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fe21003bb50 con 0x7fe21c102dc0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.631+0000 7fe219ffb640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe20c0b53f0 0x7fe20c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.631+0000 7fe21bfff640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe20c0b53f0 0x7fe20c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe210106bd0 con 0x7fe21c102dc0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe219ffb640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] conn(0x7fe20c0bee10 0x7fe20c0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 --> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe21003ce50 con 0x7fe20c0bee10 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fe210107020 con 0x7fe21c102dc0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe2215c0640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] conn(0x7fe20c0bee10 0x7fe20c0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe21bfff640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe20c0b53f0 0x7fe20c0b78b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe208005d00 tx=0x7fe208009550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.632+0000 7fe2215c0640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] conn(0x7fe20c0bee10 0x7fe20c0c12b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.633+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== osd.6 v2:172.21.15.5:6818/785003891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe21003ce50 con 0x7fe20c0bee10 2024-09-10T22:15:42.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.647+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 --> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe21c063ce0 con 0x7fe20c0bee10 2024-09-10T22:15:42.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe219ffb640 1 -- 172.21.15.5:0/1709444363 <== osd.6 v2:172.21.15.5:6818/785003891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe21c063ce0 con 0x7fe20c0bee10 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] conn(0x7fe20c0bee10 msgr2=0x7fe20c0c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] conn(0x7fe20c0bee10 0x7fe20c0c12b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe20c0b53f0 msgr2=0x7fe20c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe20c0b53f0 0x7fe20c0b78b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe208005d00 tx=0x7fe208009550 comp rx=0 tx=0).stop 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 msgr2=0x7fe21c199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 --2- 172.21.15.5:0/1709444363 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe21c102dc0 0x7fe21c199320 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe210005940 tx=0x7fe2100042f0 comp rx=0 tx=0).stop 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe2215c0640 1 -- 172.21.15.5:0/1709444363 reap_dead start 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 shutdown_connections 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 >> 172.21.15.5:0/1709444363 conn(0x7fe21c0fe830 msgr2=0x7fe21c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:42.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 shutdown_connections 2024-09-10T22:15:42.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:42.648+0000 7fe223023640 1 -- 172.21.15.5:0/1709444363 wait complete. 2024-09-10T22:15:42.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:42 smithi005 ceph-mon[31115]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:43.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:42 smithi189 ceph-mon[35784]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:42 smithi052 ceph-mon[34997]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1023 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:43.415 INFO:teuthology.orchestra.run.smithi005.stdout:180388626479 2024-09-10T22:15:43.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-10T22:15:43.635 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:43.639 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:43.640 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:43.647 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:44.080 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:44.108 INFO:teuthology.orchestra.run.smithi005.stdout:154618822708 2024-09-10T22:15:44.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-10T22:15:44.893 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:44 smithi005 ceph-mon[31115]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 885 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:45.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 -- 172.21.15.5:0/2500081985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130102dc0 msgr2=0x7f41301031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 --2- 172.21.15.5:0/2500081985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130102dc0 0x7f41301031a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4120009900 tx=0x7f412002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 -- 172.21.15.5:0/2500081985 shutdown_connections 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 --2- 172.21.15.5:0/2500081985 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4130109150 0x7f413010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 --2- 172.21.15.5:0/2500081985 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41301087d0 0x7f4130108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 --2- 172.21.15.5:0/2500081985 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130102dc0 0x7f41301031a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 -- 172.21.15.5:0/2500081985 >> 172.21.15.5:0/2500081985 conn(0x7f41300fe830 msgr2=0x7f4130100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 -- 172.21.15.5:0/2500081985 shutdown_connections 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.073+0000 7f4135ad5640 1 -- 172.21.15.5:0/2500081985 wait complete. 2024-09-10T22:15:45.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 Processor -- start 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 -- start start 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4130102dc0 0x7f4130199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41301087d0 0x7f4130199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130109150 0x7f413019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4130112dd0 con 0x7f4130109150 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4130112c50 con 0x7f4130102dc0 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f4135ad5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4130112f50 con 0x7f41301087d0 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130109150 0x7f413019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130109150 0x7f413019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47492/0 (socket says 172.21.15.5:47492) 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 -- 172.21.15.5:0/343089179 learned_addr learned my addr 172.21.15.5:0/343089179 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:45.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412effd640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41301087d0 0x7f4130199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412f7fe640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4130102dc0 0x7f4130199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 -- 172.21.15.5:0/343089179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41301087d0 msgr2=0x7f4130199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f41301087d0 0x7f4130199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 -- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4130102dc0 msgr2=0x7f4130199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.074+0000 7f412ffff640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4130102dc0 0x7f4130199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f412ffff640 1 -- 172.21.15.5:0/343089179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413019f2d0 con 0x7f4130109150 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f412f7fe640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4130102dc0 0x7f4130199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f412ffff640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130109150 0x7f413019eb00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f412800eb10 tx=0x7f412800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412800ce20 con 0x7f4130109150 2024-09-10T22:15:45.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413019f5c0 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4128005020 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128010690 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.075+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41301a5c80 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.076+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f41300638e0 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.078+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f4128005510 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.078+0000 7f412cff9640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f41180b5370 0x7f41180b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.078+0000 7f412f7fe640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f41180b5370 0x7f41180b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.078+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f41280e6790 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.079+0000 7f412cff9640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] conn(0x7f41180bed90 0x7f41180c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.079+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 --> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4128015e80 con 0x7f41180bed90 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.079+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f41280e6be0 con 0x7f4130109150 2024-09-10T22:15:45.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.079+0000 7f412f7fe640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f41180b5370 0x7f41180b7830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4120000c00 tx=0x7f4120031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.079+0000 7f412effd640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] conn(0x7f41180bed90 0x7f41180c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.079+0000 7f412effd640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] conn(0x7f41180bed90 0x7f41180c1230 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:45.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.080+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== osd.10 v2:172.21.15.52:6824/1898218403 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4128015e80 con 0x7f41180bed90 2024-09-10T22:15:45.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.094+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 --> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4130063d60 con 0x7f41180bed90 2024-09-10T22:15:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f412cff9640 1 -- 172.21.15.5:0/343089179 <== osd.10 v2:172.21.15.52:6824/1898218403 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4130063d60 con 0x7f41180bed90 2024-09-10T22:15:45.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] conn(0x7f41180bed90 msgr2=0x7f41180c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] conn(0x7f41180bed90 0x7f41180c1230 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f41180b5370 msgr2=0x7f41180b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f41180b5370 0x7f41180b7830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4120000c00 tx=0x7f4120031400 comp rx=0 tx=0).stop 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130109150 msgr2=0x7f413019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 --2- 172.21.15.5:0/343089179 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4130109150 0x7f413019eb00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f412800eb10 tx=0x7f412800ef10 comp rx=0 tx=0).stop 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f412ffff640 1 -- 172.21.15.5:0/343089179 reap_dead start 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 shutdown_connections 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 >> 172.21.15.5:0/343089179 conn(0x7f41300fe830 msgr2=0x7f4130100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 shutdown_connections 2024-09-10T22:15:45.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:45.095+0000 7f4135ad5640 1 -- 172.21.15.5:0/343089179 wait complete. 2024-09-10T22:15:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:44 smithi189 ceph-mon[35784]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 885 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:45.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:44 smithi052 ceph-mon[34997]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 885 B/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.160+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2035084826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa4102dc0 msgr2=0x7f8aa41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.160+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2035084826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa4102dc0 0x7f8aa41031a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009900 tx=0x7f8a9402a410 comp rx=0 tx=0).stop 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2035084826 shutdown_connections 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2035084826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8aa4109150 0x7f8aa410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2035084826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa41087d0 0x7f8aa4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2035084826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa4102dc0 0x7f8aa41031a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2035084826 >> 172.21.15.5:0/2035084826 conn(0x7f8aa40fe830 msgr2=0x7f8aa4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2035084826 shutdown_connections 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2035084826 wait complete. 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 Processor -- start 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.161+0000 7f8aa9dde640 1 -- start start 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa9dde640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa4102dc0 0x7f8aa41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa9dde640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa41087d0 0x7f8aa4199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa9dde640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8aa4109150 0x7f8aa419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa9dde640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4112e10 con 0x7f8aa41087d0 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa9dde640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4112c90 con 0x7f8aa4109150 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa9dde640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa4112f90 con 0x7f8aa4102dc0 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa41087d0 0x7f8aa4199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa41087d0 0x7f8aa4199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47518/0 (socket says 172.21.15.5:47518) 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 -- 172.21.15.5:0/2288097929 learned_addr learned my addr 172.21.15.5:0/2288097929 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa3fff640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8aa4109150 0x7f8aa419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa37fe640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa4102dc0 0x7f8aa41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 -- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa4102dc0 msgr2=0x7f8aa41992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8aa4102dc0 0x7f8aa41992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 -- 172.21.15.5:0/2288097929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8aa4109150 msgr2=0x7f8aa419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8aa4109150 0x7f8aa419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 -- 172.21.15.5:0/2288097929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa419f370 con 0x7f8aa41087d0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.162+0000 7f8aa2ffd640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa41087d0 0x7f8aa4199800 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800c890 tx=0x7f8a9800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.163+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98004220 con 0x7f8aa41087d0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.163+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa419f660 con 0x7f8aa41087d0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.163+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a980043c0 con 0x7f8aa41087d0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.163+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98004a00 con 0x7f8aa41087d0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.163+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa41a5ef0 con 0x7f8aa41087d0 2024-09-10T22:15:46.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.164+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8aa40638e0 con 0x7f8aa41087d0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.165+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f8a980079b0 con 0x7f8aa41087d0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa0ff9640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a8c0b5370 0x7f8a8c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa37fe640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a8c0b5370 0x7f8a8c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f8a980e5df0 con 0x7f8aa41087d0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa0ff9640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] conn(0x7f8a8c0bed90 0x7f8a8c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 --> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a8c0c1900 con 0x7f8a8c0bed90 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f8a980e6240 con 0x7f8aa41087d0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.166+0000 7f8aa37fe640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a8c0b5370 0x7f8a8c0b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a94031440 tx=0x7f8a94005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.167+0000 7f8aa3fff640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] conn(0x7f8a8c0bed90 0x7f8a8c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.167+0000 7f8aa3fff640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] conn(0x7f8a8c0bed90 0x7f8a8c0c1230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.168+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== osd.8 v2:172.21.15.189:6816/2630630352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8a8c0c1900 con 0x7f8a8c0bed90 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.182+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 --> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8aa4063ce0 con 0x7f8a8c0bed90 2024-09-10T22:15:46.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.182+0000 7f8aa0ff9640 1 -- 172.21.15.5:0/2288097929 <== osd.8 v2:172.21.15.189:6816/2630630352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8aa4063ce0 con 0x7f8a8c0bed90 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] conn(0x7f8a8c0bed90 msgr2=0x7f8a8c0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] conn(0x7f8a8c0bed90 0x7f8a8c0c1230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a8c0b5370 msgr2=0x7f8a8c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a8c0b5370 0x7f8a8c0b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8a94031440 tx=0x7f8a94005e80 comp rx=0 tx=0).stop 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa41087d0 msgr2=0x7f8aa4199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 --2- 172.21.15.5:0/2288097929 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8aa41087d0 0x7f8aa4199800 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a9800c890 tx=0x7f8a9800cd50 comp rx=0 tx=0).stop 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa3fff640 1 -- 172.21.15.5:0/2288097929 reap_dead start 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 shutdown_connections 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 >> 172.21.15.5:0/2288097929 conn(0x7f8aa40fe830 msgr2=0x7f8aa40ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 shutdown_connections 2024-09-10T22:15:46.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.183+0000 7f8aa9dde640 1 -- 172.21.15.5:0/2288097929 wait complete. 2024-09-10T22:15:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 -- 172.21.15.5:0/2756997613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075540 msgr2=0x7f4e40075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 --2- 172.21.15.5:0/2756997613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075540 0x7f4e40075920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009ca0 tx=0x7f4e3c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 -- 172.21.15.5:0/2756997613 shutdown_connections 2024-09-10T22:15:46.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 --2- 172.21.15.5:0/2756997613 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e4010f3e0 0x7f4e401117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 --2- 172.21.15.5:0/2756997613 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e40075f40 0x7f4e4010ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 --2- 172.21.15.5:0/2756997613 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075540 0x7f4e40075920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 -- 172.21.15.5:0/2756997613 >> 172.21.15.5:0/2756997613 conn(0x7f4e400fe830 msgr2=0x7f4e40100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 -- 172.21.15.5:0/2756997613 shutdown_connections 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.976+0000 7f4e4825d640 1 -- 172.21.15.5:0/2756997613 wait complete. 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 Processor -- start 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 -- start start 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e40075540 0x7f4e4019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075f40 0x7f4e4019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e4010f3e0 0x7f4e401a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4e40115040 con 0x7f4e40075f40 2024-09-10T22:15:46.737 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4e40114ec0 con 0x7f4e4010f3e0 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e4825d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4e401151c0 con 0x7f4e40075540 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075f40 0x7f4e4019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075f40 0x7f4e4019bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47462/0 (socket says 172.21.15.5:47462) 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 -- 172.21.15.5:0/3424245716 learned_addr learned my addr 172.21.15.5:0/3424245716 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e45ff9640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e40075540 0x7f4e4019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e467fa640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e4010f3e0 0x7f4e401a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 -- 172.21.15.5:0/3424245716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e40075540 msgr2=0x7f4e4019b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4e40075540 0x7f4e4019b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 -- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e4010f3e0 msgr2=0x7f4e401a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4e4010f3e0 0x7f4e401a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 -- 172.21.15.5:0/3424245716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e401a1700 con 0x7f4e40075f40 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.977+0000 7f4e457f8640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075f40 0x7f4e4019bb90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000b4a0 tx=0x7f4e3000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:46.738 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.978+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30014070 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.978+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e30010ac0 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.978+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e401a19f0 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.978+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30017c30 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.978+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e401a80b0 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.978+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e40063860 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.980+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f4e30010610 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e36ffd640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e2c0b5370 0x7f4e2c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e45ff9640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e2c0b5370 0x7f4e2c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f4e300e5750 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e36ffd640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] conn(0x7f4e2c0bed90 0x7f4e2c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 --> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e3000ee50 con 0x7f4e2c0bed90 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f4e300e5ba0 con 0x7f4e40075f40 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e45ff9640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e2c0b5370 0x7f4e2c0b7830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c02f540 tx=0x7f4e3c009a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:46.739 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.981+0000 7f4e467fa640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] conn(0x7f4e2c0bed90 0x7f4e2c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.982+0000 7f4e467fa640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] conn(0x7f4e2c0bed90 0x7f4e2c0c1230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.983+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== osd.4 v2:172.21.15.52:6808/2372406744 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e3000ee50 con 0x7f4e2c0bed90 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.997+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 --> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4e40063ce0 con 0x7f4e2c0bed90 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.997+0000 7f4e36ffd640 1 -- 172.21.15.5:0/3424245716 <== osd.4 v2:172.21.15.52:6808/2372406744 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4e40063ce0 con 0x7f4e2c0bed90 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] conn(0x7f4e2c0bed90 msgr2=0x7f4e2c0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] conn(0x7f4e2c0bed90 0x7f4e2c0c1230 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e2c0b5370 msgr2=0x7f4e2c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f4e2c0b5370 0x7f4e2c0b7830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c02f540 tx=0x7f4e3c009a20 comp rx=0 tx=0).stop 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075f40 msgr2=0x7f4e4019bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 --2- 172.21.15.5:0/3424245716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4e40075f40 0x7f4e4019bb90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000b4a0 tx=0x7f4e3000b960 comp rx=0 tx=0).stop 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e467fa640 1 -- 172.21.15.5:0/3424245716 reap_dead start 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 shutdown_connections 2024-09-10T22:15:46.740 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 >> 172.21.15.5:0/3424245716 conn(0x7f4e400fe830 msgr2=0x7f4e400ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 shutdown_connections 2024-09-10T22:15:46.741 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:44.998+0000 7f4e4825d640 1 -- 172.21.15.5:0/3424245716 wait complete. 2024-09-10T22:15:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 -- 172.21.15.5:0/713435716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc40810d140 msgr2=0x7fc40810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 --2- 172.21.15.5:0/713435716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc40810d140 0x7fc40810f5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009860 tx=0x7fc3f002a340 comp rx=0 tx=0).stop 2024-09-10T22:15:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 -- 172.21.15.5:0/713435716 shutdown_connections 2024-09-10T22:15:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 --2- 172.21.15.5:0/713435716 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc40810d140 0x7fc40810f5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 --2- 172.21.15.5:0/713435716 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc408104600 0x7fc40810caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 --2- 172.21.15.5:0/713435716 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc408103ce0 0x7fc4081040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 -- 172.21.15.5:0/713435716 >> 172.21.15.5:0/713435716 conn(0x7fc4080fd700 msgr2=0x7fc4080ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 -- 172.21.15.5:0/713435716 shutdown_connections 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 -- 172.21.15.5:0/713435716 wait complete. 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.599+0000 7fc40ea64640 1 Processor -- start 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 -- start start 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc408103ce0 0x7fc408199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc408104600 0x7fc4081997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc40810d140 0x7fc40819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc408112db0 con 0x7fc408103ce0 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc408112c30 con 0x7fc408104600 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40ea64640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc408112f30 con 0x7fc40810d140 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc408103ce0 0x7fc408199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc408103ce0 0x7fc408199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47534/0 (socket says 172.21.15.5:47534) 2024-09-10T22:15:47.047 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 -- 172.21.15.5:0/3216009244 learned_addr learned my addr 172.21.15.5:0/3216009244 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40d001640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc40810d140 0x7fc40819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc407fff640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc408104600 0x7fc4081997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 -- 172.21.15.5:0/3216009244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc40810d140 msgr2=0x7fc40819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc40810d140 0x7fc40819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 -- 172.21.15.5:0/3216009244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc408104600 msgr2=0x7fc4081997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc408104600 0x7fc4081997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 -- 172.21.15.5:0/3216009244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40819f310 con 0x7fc408103ce0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40d001640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc40810d140 0x7fc40819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.600+0000 7fc40c800640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc408103ce0 0x7fc408199260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800ebc0 tx=0x7fc3f800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.601+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8010630 con 0x7fc408103ce0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.601+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3f8010c80 con 0x7fc408103ce0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.601+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40819f600 con 0x7fc408103ce0 2024-09-10T22:15:47.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.601+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8018b60 con 0x7fc408103ce0 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.601+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4081a5e90 con 0x7fc408103ce0 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.602+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4080ffd70 con 0x7fc408103ce0 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.603+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc3f8029050 con 0x7fc408103ce0 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc405ffb640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc3f40b53f0 0x7fc3f40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc407fff640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc3f40b53f0 0x7fc3f40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc3f80e6910 con 0x7fc408103ce0 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc405ffb640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] conn(0x7fc3f40bee10 0x7fc3f40c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 --> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3f40c1980 con 0x7fc3f40bee10 2024-09-10T22:15:47.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fc3f80e6cc0 con 0x7fc408103ce0 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc40d001640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] conn(0x7fc3f40bee10 0x7fc3f40c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.604+0000 7fc407fff640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc3f40b53f0 0x7fc3f40b78b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4081012f0 tx=0x7fc400009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.605+0000 7fc40d001640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] conn(0x7fc3f40bee10 0x7fc3f40c12b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.605+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== osd.0 v2:172.21.15.5:6802/3696075683 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3f40c1980 con 0x7fc3f40bee10 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 --> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc40806bb90 con 0x7fc3f40bee10 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc405ffb640 1 -- 172.21.15.5:0/3216009244 <== osd.0 v2:172.21.15.5:6802/3696075683 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc40806bb90 con 0x7fc3f40bee10 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] conn(0x7fc3f40bee10 msgr2=0x7fc3f40c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] conn(0x7fc3f40bee10 0x7fc3f40c12b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc3f40b53f0 msgr2=0x7fc3f40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc3f40b53f0 0x7fc3f40b78b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc4081012f0 tx=0x7fc400009260 comp rx=0 tx=0).stop 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc408103ce0 msgr2=0x7fc408199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 --2- 172.21.15.5:0/3216009244 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc408103ce0 0x7fc408199260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800ebc0 tx=0x7fc3f800c6a0 comp rx=0 tx=0).stop 2024-09-10T22:15:47.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40d001640 1 -- 172.21.15.5:0/3216009244 reap_dead start 2024-09-10T22:15:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.619+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 shutdown_connections 2024-09-10T22:15:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.620+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 >> 172.21.15.5:0/3216009244 conn(0x7fc4080fd700 msgr2=0x7fc4080fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.620+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 shutdown_connections 2024-09-10T22:15:47.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.620+0000 7fc40ea64640 1 -- 172.21.15.5:0/3216009244 wait complete. 2024-09-10T22:15:47.051 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:46 smithi005 ceph-mon[31115]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 299 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:46 smithi189 ceph-mon[35784]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 299 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:47.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:46 smithi052 ceph-mon[34997]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 299 B/s wr, 6 op/s; 2 B/s, 0 objects/s recovering 2024-09-10T22:15:47.695 INFO:teuthology.orchestra.run.smithi005.stdout:34359738447 2024-09-10T22:15:47.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-10T22:15:48.608 INFO:teuthology.orchestra.run.smithi005.stdout:274877906972 2024-09-10T22:15:48.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-10T22:15:48.825 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2621749968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a41045e0 msgr2=0x7f88a410cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2621749968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a41045e0 0x7f88a410cad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8898009900 tx=0x7f889802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:48.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2621749968 shutdown_connections 2024-09-10T22:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2621749968 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a410d120 0x7f88a410f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2621749968 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a41045e0 0x7f88a410cad0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2621749968 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88a4103cc0 0x7f88a41040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.829 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2621749968 >> 172.21.15.5:0/2621749968 conn(0x7f88a40fd780 msgr2=0x7f88a40ffba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:48.829 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:48 smithi005 ceph-mon[31115]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T22:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2621749968 shutdown_connections 2024-09-10T22:15:48.830 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.827+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2621749968 wait complete. 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.828+0000 7f88a9f5c640 1 Processor -- start 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.828+0000 7f88a9f5c640 1 -- start start 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.828+0000 7f88a9f5c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a4103cc0 0x7f88a4101970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.828+0000 7f88a9f5c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88a41045e0 0x7f88a4101eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.828+0000 7f88a9f5c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a410d120 0x7f88a41023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a9f5c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4112d90 con 0x7f88a410d120 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a410d120 0x7f88a41023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a9f5c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4112c10 con 0x7f88a4103cc0 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a410d120 0x7f88a41023f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47580/0 (socket says 172.21.15.5:47580) 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 -- 172.21.15.5:0/2567902747 learned_addr learned my addr 172.21.15.5:0/2567902747 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a37fe640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a4103cc0 0x7f88a4101970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f88a4112f10 con 0x7f88a41045e0 2024-09-10T22:15:48.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a2ffd640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88a41045e0 0x7f88a4101eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 -- 172.21.15.5:0/2567902747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88a41045e0 msgr2=0x7f88a4101eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f88a41045e0 0x7f88a4101eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 -- 172.21.15.5:0/2567902747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a4103cc0 msgr2=0x7f88a4101970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a4103cc0 0x7f88a4101970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a3fff640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a41a7720 con 0x7f88a410d120 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.829+0000 7f88a37fe640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f88a4103cc0 0x7f88a4101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.830+0000 7f88a3fff640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a410d120 0x7f88a41023f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f889c00eb10 tx=0x7f889c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.830+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c004b20 con 0x7f88a410d120 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.830+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a41a7a10 con 0x7f88a410d120 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.830+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a41a7f20 con 0x7f88a410d120 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.830+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f889c004cc0 con 0x7f88a410d120 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.831+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c005a30 con 0x7f88a410d120 2024-09-10T22:15:48.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.831+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8890001060 con 0x7f88a410d120 2024-09-10T22:15:48.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.834+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f889c005000 con 0x7f88a410d120 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.834+0000 7f88a0ff9640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f888c0b5370 0x7f888c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f889c0e65f0 con 0x7f88a410d120 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a37fe640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f888c0b5370 0x7f888c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a0ff9640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] conn(0x7f888c0bed90 0x7f888c0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f889c00ae50 con 0x7f888c0bed90 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f889c0e6a40 con 0x7f88a410d120 2024-09-10T22:15:48.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a2ffd640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] conn(0x7f888c0bed90 0x7f888c0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.835+0000 7f88a37fe640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f888c0b5370 0x7f888c0b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8894009fc0 tx=0x7f8894005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.836+0000 7f88a2ffd640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] conn(0x7f888c0bed90 0x7f888c0c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:48.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.836+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== osd.3 v2:172.21.15.5:6810/2032049707 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f889c00ae50 con 0x7f888c0bed90 2024-09-10T22:15:48.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.858+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 --> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8890002e00 con 0x7f888c0bed90 2024-09-10T22:15:48.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.858+0000 7f88a0ff9640 1 -- 172.21.15.5:0/2567902747 <== osd.3 v2:172.21.15.5:6810/2032049707 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8890002e00 con 0x7f888c0bed90 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] conn(0x7f888c0bed90 msgr2=0x7f888c0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] conn(0x7f888c0bed90 0x7f888c0c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f888c0b5370 msgr2=0x7f888c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f888c0b5370 0x7f888c0b7830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8894009fc0 tx=0x7f8894005f90 comp rx=0 tx=0).stop 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a410d120 msgr2=0x7f88a41023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 --2- 172.21.15.5:0/2567902747 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f88a410d120 0x7f88a41023f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f889c00eb10 tx=0x7f889c00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a3fff640 1 -- 172.21.15.5:0/2567902747 reap_dead start 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 shutdown_connections 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 >> 172.21.15.5:0/2567902747 conn(0x7f88a40fd780 msgr2=0x7f88a40fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:48.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 shutdown_connections 2024-09-10T22:15:48.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.859+0000 7f88a9f5c640 1 -- 172.21.15.5:0/2567902747 wait complete. 2024-09-10T22:15:49.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:48 smithi189 ceph-mon[35784]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T22:15:49.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:48 smithi052 ceph-mon[34997]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s; 1 B/s, 0 objects/s recovering 2024-09-10T22:15:49.270 INFO:teuthology.orchestra.run.smithi005.stdout:133143986234 2024-09-10T22:15:49.270 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-10T22:15:49.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 -- 172.21.15.5:0/2186417718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 msgr2=0x7fb2e0107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2186417718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e0107ae0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009900 tx=0x7fb2c802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 -- 172.21.15.5:0/2186417718 shutdown_connections 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2186417718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2e0108020 0x7fb2e010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2186417718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e0107ae0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2186417718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e0101c90 0x7fb2e0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 -- 172.21.15.5:0/2186417718 >> 172.21.15.5:0/2186417718 conn(0x7fb2e00fd700 msgr2=0x7fb2e00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 -- 172.21.15.5:0/2186417718 shutdown_connections 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.517+0000 7fb2e6099640 1 -- 172.21.15.5:0/2186417718 wait complete. 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 Processor -- start 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 -- start start 2024-09-10T22:15:49.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2e0101c90 0x7fb2e00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e0108020 0x7fb2e00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111cf0 con 0x7fb2e01076a0 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111b70 con 0x7fb2e0108020 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2e6099640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e0111e70 con 0x7fb2e0101c90 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2d6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e00fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47602/0 (socket says 172.21.15.5:47602) 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.518+0000 7fb2d6ffd640 1 -- 172.21.15.5:0/2124157529 learned_addr learned my addr 172.21.15.5:0/2124157529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:49.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2dffff640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e0108020 0x7fb2e00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2df7fe640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2e0101c90 0x7fb2e00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2d6ffd640 1 -- 172.21.15.5:0/2124157529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2e0101c90 msgr2=0x7fb2e00fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2d6ffd640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2e0101c90 0x7fb2e00fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2d6ffd640 1 -- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e0108020 msgr2=0x7fb2e00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2d6ffd640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb2e0108020 0x7fb2e00fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2d6ffd640 1 -- 172.21.15.5:0/2124157529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e01a76f0 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2df7fe640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb2e0101c90 0x7fb2e00fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2d6ffd640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e00fe140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8005ab0 tx=0x7fb2c8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c803f070 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2c8031d60 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e01a7980 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8035030 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.519+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e01a7e60 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.520+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2e0100620 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.522+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fb2c803b580 con 0x7fb2e01076a0 2024-09-10T22:15:49.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.522+0000 7fb2dd7fa640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb2cc0b5370 0x7fb2cc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.522+0000 7fb2df7fe640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb2cc0b5370 0x7fb2cc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.522+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb2c8106f50 con 0x7fb2e01076a0 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.523+0000 7fb2dd7fa640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] conn(0x7fb2cc0bed90 0x7fb2cc0c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.523+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 --> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2c8046e50 con 0x7fb2cc0bed90 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.523+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fb2c81073a0 con 0x7fb2e01076a0 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.523+0000 7fb2df7fe640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb2cc0b5370 0x7fb2cc0b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009b40 tx=0x7fb2d0005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.523+0000 7fb2dffff640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] conn(0x7fb2cc0bed90 0x7fb2cc0c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.523+0000 7fb2dffff640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] conn(0x7fb2cc0bed90 0x7fb2cc0c1230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:49.546 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.524+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== osd.1 v2:172.21.15.52:6800/1933409756 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2c8046e50 con 0x7fb2cc0bed90 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.538+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 --> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2e0102f40 con 0x7fb2cc0bed90 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.538+0000 7fb2dd7fa640 1 -- 172.21.15.5:0/2124157529 <== osd.1 v2:172.21.15.52:6800/1933409756 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb2e0102f40 con 0x7fb2cc0bed90 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.538+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] conn(0x7fb2cc0bed90 msgr2=0x7fb2cc0c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.538+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] conn(0x7fb2cc0bed90 0x7fb2cc0c1230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.538+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb2cc0b5370 msgr2=0x7fb2cc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.538+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb2cc0b5370 0x7fb2cc0b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009b40 tx=0x7fb2d0005e50 comp rx=0 tx=0).stop 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 msgr2=0x7fb2e00fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2e6099640 1 --2- 172.21.15.5:0/2124157529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb2e01076a0 0x7fb2e00fe140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8005ab0 tx=0x7fb2c8003cd0 comp rx=0 tx=0).stop 2024-09-10T22:15:49.548 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2dffff640 1 -- 172.21.15.5:0/2124157529 reap_dead start 2024-09-10T22:15:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 shutdown_connections 2024-09-10T22:15:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 >> 172.21.15.5:0/2124157529 conn(0x7fb2e00fd700 msgr2=0x7fb2e006adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 shutdown_connections 2024-09-10T22:15:49.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:49.539+0000 7fb2e6099640 1 -- 172.21.15.5:0/2124157529 wait complete. 2024-09-10T22:15:50.255 INFO:teuthology.orchestra.run.smithi005.stdout:227633266725 2024-09-10T22:15:50.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 -- 172.21.15.5:0/1036663485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 msgr2=0x7f9290107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 --2- 172.21.15.5:0/1036663485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290107b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9284009900 tx=0x7f928402a410 comp rx=0 tx=0).stop 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 -- 172.21.15.5:0/1036663485 shutdown_connections 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 --2- 172.21.15.5:0/1036663485 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9290108060 0x7f929010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 --2- 172.21.15.5:0/1036663485 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290107b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 --2- 172.21.15.5:0/1036663485 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9290101cd0 0x7f92901020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 -- 172.21.15.5:0/1036663485 >> 172.21.15.5:0/1036663485 conn(0x7f92900fd700 msgr2=0x7f92900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 -- 172.21.15.5:0/1036663485 shutdown_connections 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 -- 172.21.15.5:0/1036663485 wait complete. 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.205+0000 7f92965e7640 1 Processor -- start 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 -- start start 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9290101cd0 0x7f92901993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9290108060 0x7f929019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9290111d60 con 0x7f92901076e0 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9290111be0 con 0x7f9290108060 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f92965e7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9290111ee0 con 0x7f9290101cd0 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f928f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:50.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f928f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47562/0 (socket says 172.21.15.5:47562) 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f928f7fe640 1 -- 172.21.15.5:0/75586656 learned_addr learned my addr 172.21.15.5:0/75586656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f928ffff640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9290101cd0 0x7f92901993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f928f7fe640 1 -- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9290101cd0 msgr2=0x7f92901993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f9294b84640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9290108060 0x7f929019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.206+0000 7f928f7fe640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9290101cd0 0x7f92901993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928f7fe640 1 -- 172.21.15.5:0/75586656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9290108060 msgr2=0x7f929019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928f7fe640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9290108060 0x7f929019ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928f7fe640 1 -- 172.21.15.5:0/75586656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929019f490 con 0x7f92901076e0 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928ffff640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9290101cd0 0x7f92901993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928f7fe640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290199920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9284006010 tx=0x7f92840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928403f030 con 0x7f92901076e0 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929019f720 con 0x7f92901076e0 2024-09-10T22:15:50.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9284003800 con 0x7f92901076e0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284035070 con 0x7f92901076e0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.207+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92901a5e40 con 0x7f92901076e0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.208+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9290100620 con 0x7f92901076e0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.209+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9284031b10 con 0x7f92901076e0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.210+0000 7f928d7fa640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f92780b5370 0x7f92780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.210+0000 7f928ffff640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f92780b5370 0x7f92780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.210+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f9284106e80 con 0x7f92901076e0 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.210+0000 7f928d7fa640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] conn(0x7f92780bed80 0x7f92780c1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.210+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 --> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f928403be50 con 0x7f92780bed80 2024-09-10T22:15:50.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.210+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f9284107230 con 0x7f92901076e0 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.211+0000 7f928ffff640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f92780b5370 0x7f92780b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9280006fd0 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.211+0000 7f9294b84640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] conn(0x7f92780bed80 0x7f92780c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.211+0000 7f9294b84640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] conn(0x7f92780bed80 0x7f92780c1220 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.212+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== osd.2 v2:172.21.15.189:6800/3820297552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f928403be50 con 0x7f92780bed80 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 --> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9290102f80 con 0x7f92780bed80 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f928d7fa640 1 -- 172.21.15.5:0/75586656 <== osd.2 v2:172.21.15.189:6800/3820297552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9290102f80 con 0x7f92780bed80 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] conn(0x7f92780bed80 msgr2=0x7f92780c1220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:50.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] conn(0x7f92780bed80 0x7f92780c1220 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f92780b5370 msgr2=0x7f92780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f92780b5370 0x7f92780b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9280006fd0 tx=0x7f9280008040 comp rx=0 tx=0).stop 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 msgr2=0x7f9290199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f92965e7640 1 --2- 172.21.15.5:0/75586656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f92901076e0 0x7f9290199920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9284006010 tx=0x7f92840042f0 comp rx=0 tx=0).stop 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.226+0000 7f9294b84640 1 -- 172.21.15.5:0/75586656 reap_dead start 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.227+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 shutdown_connections 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.227+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 >> 172.21.15.5:0/75586656 conn(0x7f92900fd700 msgr2=0x7f929006b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.227+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 shutdown_connections 2024-09-10T22:15:50.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:48.227+0000 7f92965e7640 1 -- 172.21.15.5:0/75586656 wait complete. 2024-09-10T22:15:50.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:50 smithi005 ceph-mon[31115]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:15:51.052 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:50 smithi052 ceph-mon[34997]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:15:51.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:50 smithi189 ceph-mon[35784]: pgmap v316: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:15:51.236 INFO:teuthology.orchestra.run.smithi005.stdout:77309411397 2024-09-10T22:15:51.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-10T22:15:51.844 INFO:teuthology.orchestra.run.smithi005.stdout:55834574922 2024-09-10T22:15:51.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.007+0000 7f3f9c749640 1 -- 172.21.15.5:0/935865452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f94103ca0 msgr2=0x7f3f94104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.007+0000 7f3f9c749640 1 --2- 172.21.15.5:0/935865452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f94103ca0 0x7f3f94104080 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f90009900 tx=0x7f3f9002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 -- 172.21.15.5:0/935865452 shutdown_connections 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 --2- 172.21.15.5:0/935865452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f9410d100 0x7f3f9410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 --2- 172.21.15.5:0/935865452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f941045c0 0x7f3f9410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 --2- 172.21.15.5:0/935865452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f94103ca0 0x7f3f94104080 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 -- 172.21.15.5:0/935865452 >> 172.21.15.5:0/935865452 conn(0x7f3f940fd700 msgr2=0x7f3f940ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 -- 172.21.15.5:0/935865452 shutdown_connections 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 -- 172.21.15.5:0/935865452 wait complete. 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.008+0000 7f3f9c749640 1 Processor -- start 2024-09-10T22:15:52.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 -- start start 2024-09-10T22:15:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f94103ca0 0x7f3f94101950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f941045c0 0x7f3f94101e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f9410d100 0x7f3f941023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.013 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94112dc0 con 0x7f3f941045c0 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94112c40 con 0x7f3f9410d100 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9c749640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94112f40 con 0x7f3f94103ca0 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f941045c0 0x7f3f94101e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f941045c0 0x7f3f94101e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47610/0 (socket says 172.21.15.5:47610) 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 -- 172.21.15.5:0/3135374451 learned_addr learned my addr 172.21.15.5:0/3135374451 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9a4e5640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f94103ca0 0x7f3f94101950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 -- 172.21.15.5:0/3135374451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f94103ca0 msgr2=0x7f3f94101950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f94103ca0 0x7f3f94101950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 -- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f9410d100 msgr2=0x7f3f941023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3f9410d100 0x7f3f941023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f99ce4640 1 -- 172.21.15.5:0/3135374451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f941a76d0 con 0x7f3f941045c0 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.009+0000 7f3f9a4e5640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3f94103ca0 0x7f3f94101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:52.014 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.010+0000 7f3f99ce4640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f941045c0 0x7f3f94101e90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400e9c0 tx=0x7f3f8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.010+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400ccc0 con 0x7f3f941045c0 2024-09-10T22:15:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.010+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f840035f0 con 0x7f3f941045c0 2024-09-10T22:15:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.010+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f941a79c0 con 0x7f3f941045c0 2024-09-10T22:15:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.011+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400ce60 con 0x7f3f941045c0 2024-09-10T22:15:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.011+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f941a7f50 con 0x7f3f941045c0 2024-09-10T22:15:52.015 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.012+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f940ffd30 con 0x7f3f941045c0 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.013+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f3f84004020 con 0x7f3f941045c0 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.014+0000 7f3f8b7fe640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3f800b53f0 0x7f3f800b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.014+0000 7f3f9a4e5640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3f800b53f0 0x7f3f800b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.014+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3f840e6090 con 0x7f3f941045c0 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.014+0000 7f3f8b7fe640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] conn(0x7f3f800bee10 0x7f3f800c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.014+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 --> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f8401ee50 con 0x7f3f800bee10 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.014+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f3f840ed050 con 0x7f3f941045c0 2024-09-10T22:15:52.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.015+0000 7f3f9a4e5640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3f800b53f0 0x7f3f800b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f90000c00 tx=0x7f3f90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:52.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.015+0000 7f3f9ace6640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] conn(0x7f3f800bee10 0x7f3f800c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.015+0000 7f3f9ace6640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] conn(0x7f3f800bee10 0x7f3f800c12b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:52.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.016+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== osd.7 v2:172.21.15.52:6816/3246361291 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f8401ee50 con 0x7f3f800bee10 2024-09-10T22:15:52.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.030+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 --> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f9406b1b0 con 0x7f3f800bee10 2024-09-10T22:15:52.032 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f8b7fe640 1 -- 172.21.15.5:0/3135374451 <== osd.7 v2:172.21.15.52:6816/3246361291 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3f9406b1b0 con 0x7f3f800bee10 2024-09-10T22:15:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] conn(0x7f3f800bee10 msgr2=0x7f3f800c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] conn(0x7f3f800bee10 0x7f3f800c12b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3f800b53f0 msgr2=0x7f3f800b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3f800b53f0 0x7f3f800b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f90000c00 tx=0x7f3f90005a20 comp rx=0 tx=0).stop 2024-09-10T22:15:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f941045c0 msgr2=0x7f3f94101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.033 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 --2- 172.21.15.5:0/3135374451 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3f941045c0 0x7f3f94101e90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400e9c0 tx=0x7f3f8400ee80 comp rx=0 tx=0).stop 2024-09-10T22:15:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9ace6640 1 -- 172.21.15.5:0/3135374451 reap_dead start 2024-09-10T22:15:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 shutdown_connections 2024-09-10T22:15:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 >> 172.21.15.5:0/3135374451 conn(0x7f3f940fd700 msgr2=0x7f3f940fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.031+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 shutdown_connections 2024-09-10T22:15:52.034 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:52.032+0000 7f3f9c749640 1 -- 172.21.15.5:0/3135374451 wait complete. 2024-09-10T22:15:52.476 INFO:teuthology.orchestra.run.smithi005.stdout:107374182464 2024-09-10T22:15:52.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-10T22:15:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 -- 172.21.15.5:0/1163532879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 msgr2=0x7f050c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 --2- 172.21.15.5:0/1163532879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c108c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009900 tx=0x7f04fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 -- 172.21.15.5:0/1163532879 shutdown_connections 2024-09-10T22:15:52.596 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 --2- 172.21.15.5:0/1163532879 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c109150 0x7f050c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 --2- 172.21.15.5:0/1163532879 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c108c10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 --2- 172.21.15.5:0/1163532879 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f050c102dc0 0x7f050c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 -- 172.21.15.5:0/1163532879 >> 172.21.15.5:0/1163532879 conn(0x7f050c0fe830 msgr2=0x7f050c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 -- 172.21.15.5:0/1163532879 shutdown_connections 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.709+0000 7f05147e1640 1 -- 172.21.15.5:0/1163532879 wait complete. 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 Processor -- start 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 -- start start 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f050c102dc0 0x7f050c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c109150 0x7f050c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f050c112e10 con 0x7f050c1087d0 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f050c112c90 con 0x7f050c102dc0 2024-09-10T22:15:52.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f05147e1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f050c112f90 con 0x7f050c109150 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:47554/0 (socket says 172.21.15.5:47554) 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 -- 172.21.15.5:0/736232772 learned_addr learned my addr 172.21.15.5:0/736232772 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f051257d640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f050c102dc0 0x7f050c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0512d7e640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c109150 0x7f050c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 -- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c109150 msgr2=0x7f050c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c109150 0x7f050c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 -- 172.21.15.5:0/736232772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f050c102dc0 msgr2=0x7f050c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.710+0000 7f0511d7c640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f050c102dc0 0x7f050c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f0511d7c640 1 -- 172.21.15.5:0/736232772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050c1a7620 con 0x7f050c1087d0 2024-09-10T22:15:52.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f0512d7e640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f050c109150 0x7f050c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f0511d7c640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c0759e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005940 tx=0x7f04fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc03f030 con 0x7f050c1087d0 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f050c1a78b0 con 0x7f050c1087d0 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04fc003aa0 con 0x7f050c1087d0 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04fc035070 con 0x7f050c1087d0 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.711+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f050c1a7d90 con 0x7f050c1087d0 2024-09-10T22:15:52.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.712+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f050c1060e0 con 0x7f050c1087d0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.713+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f04fc003c50 con 0x7f050c1087d0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.714+0000 7f05037fe640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f04f80b5370 0x7f04f80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.714+0000 7f051257d640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f04f80b5370 0x7f04f80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.714+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f04fc106ee0 con 0x7f050c1087d0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.714+0000 7f05037fe640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] conn(0x7f04f80bed90 0x7f04f80c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.714+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 --> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04fc049e50 con 0x7f04f80bed90 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.714+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f04fc107290 con 0x7f050c1087d0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.715+0000 7f0512d7e640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] conn(0x7f04f80bed90 0x7f04f80c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.715+0000 7f051257d640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f04f80b5370 0x7f04f80b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0508009b40 tx=0x7f0508005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.715+0000 7f0512d7e640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] conn(0x7f04f80bed90 0x7f04f80c1230 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:52.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.716+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== osd.11 v2:172.21.15.189:6824/4080775547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04fc049e50 con 0x7f04f80bed90 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.730+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 --> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f050c104070 con 0x7f04f80bed90 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.730+0000 7f05037fe640 1 -- 172.21.15.5:0/736232772 <== osd.11 v2:172.21.15.189:6824/4080775547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f050c104070 con 0x7f04f80bed90 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.730+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] conn(0x7f04f80bed90 msgr2=0x7f04f80c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.730+0000 7f05147e1640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] conn(0x7f04f80bed90 0x7f04f80c1230 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f04f80b5370 msgr2=0x7f04f80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f04f80b5370 0x7f04f80b7830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0508009b40 tx=0x7f0508005f90 comp rx=0 tx=0).stop 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 msgr2=0x7f050c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 --2- 172.21.15.5:0/736232772 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f050c1087d0 0x7f050c0759e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f04fc005940 tx=0x7f04fc004270 comp rx=0 tx=0).stop 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f0512d7e640 1 -- 172.21.15.5:0/736232772 reap_dead start 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 shutdown_connections 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 >> 172.21.15.5:0/736232772 conn(0x7f050c0fe830 msgr2=0x7f050c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:52.601 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 shutdown_connections 2024-09-10T22:15:52.602 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:46.731+0000 7f05147e1640 1 -- 172.21.15.5:0/736232772 wait complete. 2024-09-10T22:15:53.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:52 smithi005 ceph-mon[31115]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:15:53.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:52 smithi189 ceph-mon[35784]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:15:53.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:52 smithi052 ceph-mon[34997]: pgmap v317: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:15:53.252 INFO:teuthology.orchestra.run.smithi005.stdout:300647710743 2024-09-10T22:15:53.253 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-10T22:15:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:53.686 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:54.119 INFO:teuthology.orchestra.run.smithi005.stdout:201863462956 2024-09-10T22:15:54.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.559+0000 7fadd4133640 1 -- 172.21.15.5:0/541392222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 msgr2=0x7fadcc102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.559+0000 7fadd4133640 1 --2- 172.21.15.5:0/541392222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc102070 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009ca0 tx=0x7fadbc02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 -- 172.21.15.5:0/541392222 shutdown_connections 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 --2- 172.21.15.5:0/541392222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadcc108020 0x7fadcc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 --2- 172.21.15.5:0/541392222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadcc1076a0 0x7fadcc107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 --2- 172.21.15.5:0/541392222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc102070 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 -- 172.21.15.5:0/541392222 >> 172.21.15.5:0/541392222 conn(0x7fadcc0fd700 msgr2=0x7fadcc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 -- 172.21.15.5:0/541392222 shutdown_connections 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 -- 172.21.15.5:0/541392222 wait complete. 2024-09-10T22:15:54.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 Processor -- start 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 -- start start 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadcc1076a0 0x7fadcc1986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadcc108020 0x7fadcc19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.560+0000 7fadd4133640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111ce0 con 0x7fadcc101c90 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd4133640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111b60 con 0x7fadcc1076a0 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd4133640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc111e60 con 0x7fadcc108020 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53482/0 (socket says 172.21.15.5:53482) 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 -- 172.21.15.5:0/1775935293 learned_addr learned my addr 172.21.15.5:0/1775935293 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd16ce640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadcc1076a0 0x7fadcc1986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd26d0640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadcc108020 0x7fadcc19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:54.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 -- 172.21.15.5:0/1775935293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadcc108020 msgr2=0x7fadcc19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadcc108020 0x7fadcc19da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 -- 172.21.15.5:0/1775935293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadcc1076a0 msgr2=0x7fadcc1986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadcc1076a0 0x7fadcc1986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 -- 172.21.15.5:0/1775935293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc19e220 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd16ce640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadcc1076a0 0x7fadcc1986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd1ecf640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc198170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadbc02ade0 tx=0x7fadbc003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc003d60 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc19e4b0 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadbc0044f0 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc02fd10 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.561+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a4c50 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.562+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fadcc0638e0 con 0x7fadcc101c90 2024-09-10T22:15:54.579 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.564+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fadbc004040 con 0x7fadcc101c90 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadcaffd640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fadb40b5370 0x7fadb40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadd16ce640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fadb40b5370 0x7fadb40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fadbc107540 con 0x7fadcc101c90 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadcaffd640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] conn(0x7fadb40bed90 0x7fadb40c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 --> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadbc03fec0 con 0x7fadb40bed90 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7fadbc107990 con 0x7fadcc101c90 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadd16ce640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fadb40b5370 0x7fadb40b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fadcc101100 tx=0x7fadc000a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadd26d0640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] conn(0x7fadb40bed90 0x7fadb40c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.565+0000 7fadd26d0640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] conn(0x7fadb40bed90 0x7fadb40c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:54.580 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.566+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== osd.9 v2:172.21.15.5:6826/416812838 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fadbc03fec0 con 0x7fadb40bed90 2024-09-10T22:15:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.580+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 --> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fadcc063ce0 con 0x7fadb40bed90 2024-09-10T22:15:54.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.580+0000 7fadcaffd640 1 -- 172.21.15.5:0/1775935293 <== osd.9 v2:172.21.15.5:6826/416812838 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fadcc063ce0 con 0x7fadb40bed90 2024-09-10T22:15:54.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] conn(0x7fadb40bed90 msgr2=0x7fadb40c1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] conn(0x7fadb40bed90 0x7fadb40c1230 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fadb40b5370 msgr2=0x7fadb40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fadb40b5370 0x7fadb40b7830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fadcc101100 tx=0x7fadc000a5c0 comp rx=0 tx=0).stop 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 msgr2=0x7fadcc198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 --2- 172.21.15.5:0/1775935293 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadcc101c90 0x7fadcc198170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fadbc02ade0 tx=0x7fadbc003970 comp rx=0 tx=0).stop 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd26d0640 1 -- 172.21.15.5:0/1775935293 reap_dead start 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 shutdown_connections 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 >> 172.21.15.5:0/1775935293 conn(0x7fadcc0fd700 msgr2=0x7fadcc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 shutdown_connections 2024-09-10T22:15:54.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:54.581+0000 7fadd4133640 1 -- 172.21.15.5:0/1775935293 wait complete. 2024-09-10T22:15:55.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:54 smithi005 ceph-mon[31115]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:15:55.187 INFO:teuthology.orchestra.run.smithi005.stdout:253403070498 2024-09-10T22:15:55.187 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-10T22:15:55.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:54 smithi189 ceph-mon[35784]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:15:55.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:54 smithi052 ceph-mon[34997]: pgmap v318: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:15:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:55.628 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:55.635 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:55.635 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:15:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1831036502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f64104600 msgr2=0x7f7f6410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1831036502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f64104600 0x7f7f6410caf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7f58009900 tx=0x7f7f5802a410 comp rx=0 tx=0).stop 2024-09-10T22:15:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1831036502 shutdown_connections 2024-09-10T22:15:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1831036502 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f6410d140 0x7f7f6410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:55.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1831036502 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f64104600 0x7f7f6410caf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1831036502 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f64103ce0 0x7f7f641040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.903+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1831036502 >> 172.21.15.5:0/1831036502 conn(0x7f7f640fd700 msgr2=0x7f7f640ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1831036502 shutdown_connections 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1831036502 wait complete. 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 Processor -- start 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 -- start start 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64103ce0 0x7f7f64101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f64104600 0x7f7f64101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 0x7f7f64102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7f64112db0 con 0x7f7f6410d140 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7f64112c30 con 0x7f7f64104600 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f6b8ee640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7f64112f30 con 0x7f7f64103ce0 2024-09-10T22:15:55.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.904+0000 7f7f69e8b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 0x7f7f64102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 0x7f7f64102410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53502/0 (socket says 172.21.15.5:53502) 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 -- 172.21.15.5:0/1049095972 learned_addr learned my addr 172.21.15.5:0/1049095972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f6968a640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64103ce0 0x7f7f64101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f68e89640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f64104600 0x7f7f64101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 -- 172.21.15.5:0/1049095972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64103ce0 msgr2=0x7f7f64101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64103ce0 0x7f7f64101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 -- 172.21.15.5:0/1049095972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f64104600 msgr2=0x7f7f64101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f64104600 0x7f7f64101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 -- 172.21.15.5:0/1049095972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f641a7690 con 0x7f7f6410d140 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f69e8b640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 0x7f7f64102410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00cce0 tx=0x7f7f5c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00f450 con 0x7f7f6410d140 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f5c00faa0 con 0x7f7f6410d140 2024-09-10T22:15:55.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c018b70 con 0x7f7f6410d140 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f641a7980 con 0x7f7f6410d140 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.905+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f641a7e40 con 0x7f7f6410d140 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.906+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f641040c0 con 0x7f7f6410d140 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.908+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f7f5c00f5f0 con 0x7f7f6410d140 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.909+0000 7f7f627fc640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7f4c0b53f0 0x7f7f4c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.909+0000 7f7f6968a640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7f4c0b53f0 0x7f7f4c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.909+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7f5c0e63c0 con 0x7f7f6410d140 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.909+0000 7f7f6968a640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7f4c0b53f0 0x7f7f4c0b78b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f540058c0 tx=0x7f7f5400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:55.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:55.912+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7f5c014030 con 0x7f7f6410d140 2024-09-10T22:15:56.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.105+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f7f6402e5c0 con 0x7f7f6410d140 2024-09-10T22:15:56.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.105+0000 7f7f627fc640 1 -- 172.21.15.5:0/1049095972 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f7f5c0ad260 con 0x7f7f6410d140 2024-09-10T22:15:56.107 INFO:teuthology.orchestra.run.smithi005.stdout:274877906974 2024-09-10T22:15:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7f4c0b53f0 msgr2=0x7f7f4c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7f4c0b53f0 0x7f7f4c0b78b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7f540058c0 tx=0x7f7f5400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 msgr2=0x7f7f64102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 0x7f7f64102410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00cce0 tx=0x7f7f5c00a620 comp rx=0 tx=0).stop 2024-09-10T22:15:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 shutdown_connections 2024-09-10T22:15:56.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7f4c0b53f0 0x7f7f4c0b78b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7f6410d140 0x7f7f64102410 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7f64104600 0x7f7f64101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 --2- 172.21.15.5:0/1049095972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7f64103ce0 0x7f7f64101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 >> 172.21.15.5:0/1049095972 conn(0x7f7f640fd700 msgr2=0x7f7f640fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 shutdown_connections 2024-09-10T22:15:56.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.108+0000 7f7f6b8ee640 1 -- 172.21.15.5:0/1049095972 wait complete. 2024-09-10T22:15:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 -- 172.21.15.5:0/790455827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec901076a0 msgr2=0x7fec90107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 --2- 172.21.15.5:0/790455827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec901076a0 0x7fec90107ae0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fec84009900 tx=0x7fec8402a410 comp rx=0 tx=0).stop 2024-09-10T22:15:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 -- 172.21.15.5:0/790455827 shutdown_connections 2024-09-10T22:15:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 --2- 172.21.15.5:0/790455827 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90108020 0x7fec9010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.166 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 --2- 172.21.15.5:0/790455827 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec901076a0 0x7fec90107ae0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 --2- 172.21.15.5:0/790455827 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec90101c90 0x7fec90102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 -- 172.21.15.5:0/790455827 >> 172.21.15.5:0/790455827 conn(0x7fec900fd700 msgr2=0x7fec900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 -- 172.21.15.5:0/790455827 shutdown_connections 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.149+0000 7fec9502f640 1 -- 172.21.15.5:0/790455827 wait complete. 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 Processor -- start 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 -- start start 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90101c90 0x7fec901992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec901076a0 0x7fec90199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 0x7fec9019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111ca0 con 0x7fec90108020 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111b20 con 0x7fec90101c90 2024-09-10T22:15:56.167 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec9502f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fec90111e20 con 0x7fec901076a0 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec8f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 0x7fec9019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec8f59e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 0x7fec9019ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53524/0 (socket says 172.21.15.5:53524) 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec8f59e640 1 -- 172.21.15.5:0/2331460989 learned_addr learned my addr 172.21.15.5:0/2331460989 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.150+0000 7fec8ed9d640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90101c90 0x7fec901992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8e59c640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec901076a0 0x7fec90199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8f59e640 1 -- 172.21.15.5:0/2331460989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec901076a0 msgr2=0x7fec90199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8f59e640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec901076a0 0x7fec90199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8f59e640 1 -- 172.21.15.5:0/2331460989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90101c90 msgr2=0x7fec901992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8f59e640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90101c90 0x7fec901992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8f59e640 1 -- 172.21.15.5:0/2331460989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9019f390 con 0x7fec90108020 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec8f59e640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 0x7fec9019ebc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fec8800eb10 tx=0x7fec8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88004b20 con 0x7fec90108020 2024-09-10T22:15:56.168 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9019f680 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec88004cc0 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88010670 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.151+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec901a5d40 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.152+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec90102070 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.154+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fec88005000 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.154+0000 7fec77fff640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec780b5370 0x7fec780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.155+0000 7fec8ed9d640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec780b5370 0x7fec780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.155+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fec880e6490 con 0x7fec90108020 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.155+0000 7fec8ed9d640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec780b5370 0x7fec780b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec80009bd0 tx=0x7fec80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:56.169 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.158+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec88056220 con 0x7fec90108020 2024-09-10T22:15:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.348+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fec901a6060 con 0x7fec90108020 2024-09-10T22:15:56.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.348+0000 7fec77fff640 1 -- 172.21.15.5:0/2331460989 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fec880ad220 con 0x7fec90108020 2024-09-10T22:15:56.350 INFO:teuthology.orchestra.run.smithi005.stdout:154618822711 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.350+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec780b5370 msgr2=0x7fec780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.350+0000 7fec9502f640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec780b5370 0x7fec780b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec80009bd0 tx=0x7fec80005f90 comp rx=0 tx=0).stop 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.350+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 msgr2=0x7fec9019ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.350+0000 7fec9502f640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 0x7fec9019ebc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fec8800eb10 tx=0x7fec8800c2d0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 shutdown_connections 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec780b5370 0x7fec780b7830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec90108020 0x7fec9019ebc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec901076a0 0x7fec90199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 --2- 172.21.15.5:0/2331460989 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec90101c90 0x7fec901992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 >> 172.21.15.5:0/2331460989 conn(0x7fec900fd700 msgr2=0x7fec901047c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 shutdown_connections 2024-09-10T22:15:56.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:56.351+0000 7fec9502f640 1 -- 172.21.15.5:0/2331460989 wait complete. 2024-09-10T22:15:57.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822708 got 154618822711 for osd.5 2024-09-10T22:15:57.005 DEBUG:teuthology.parallel:result is None 2024-09-10T22:15:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:56 smithi005 ceph-mon[31115]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:15:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:56 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1049095972' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T22:15:57.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:56 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2331460989' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T22:15:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:56 smithi189 ceph-mon[35784]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:15:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:56 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1049095972' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T22:15:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:56 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2331460989' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T22:15:57.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:56 smithi052 ceph-mon[34997]: pgmap v319: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:15:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:56 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1049095972' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-10T22:15:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:56 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2331460989' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-10T22:15:58.069 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:57 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:15:58.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:57 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:15:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 -- 172.21.15.5:0/1260316918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0102dc0 msgr2=0x7f03e01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 --2- 172.21.15.5:0/1260316918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0102dc0 0x7f03e01031a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f03d0009900 tx=0x7f03d002a410 comp rx=0 tx=0).stop 2024-09-10T22:15:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 -- 172.21.15.5:0/1260316918 shutdown_connections 2024-09-10T22:15:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 --2- 172.21.15.5:0/1260316918 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03e0109150 0x7f03e010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 --2- 172.21.15.5:0/1260316918 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03e01087d0 0x7f03e0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.194 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 --2- 172.21.15.5:0/1260316918 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0102dc0 0x7f03e01031a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 -- 172.21.15.5:0/1260316918 >> 172.21.15.5:0/1260316918 conn(0x7f03e00fe830 msgr2=0x7f03e0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 -- 172.21.15.5:0/1260316918 shutdown_connections 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.169+0000 7f03e6a09640 1 -- 172.21.15.5:0/1260316918 wait complete. 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 Processor -- start 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 -- start start 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03e0102dc0 0x7f03e0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03e01087d0 0x7f03e0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 0x7f03e019ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0112e10 con 0x7f03e0109150 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0112c90 con 0x7f03e01087d0 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e6a09640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f03e0112f90 con 0x7f03e0102dc0 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 0x7f03e019ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.195 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 0x7f03e019ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53532/0 (socket says 172.21.15.5:53532) 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 -- 172.21.15.5:0/2871589484 learned_addr learned my addr 172.21.15.5:0/2871589484 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03dffff640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03e0102dc0 0x7f03e0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03d7fff640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03e01087d0 0x7f03e0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 -- 172.21.15.5:0/2871589484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03e0102dc0 msgr2=0x7f03e0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03e0102dc0 0x7f03e0199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 -- 172.21.15.5:0/2871589484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03e01087d0 msgr2=0x7f03e0199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03e01087d0 0x7f03e0199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 -- 172.21.15.5:0/2871589484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e019f3b0 con 0x7f03e0109150 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.170+0000 7f03e4fa6640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 0x7f03e019ebe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f03d800eaa0 tx=0x7f03d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.171+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d800cdb0 con 0x7f03e0109150 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.171+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e019f6a0 con 0x7f03e0109150 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.171+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03d8005020 con 0x7f03e0109150 2024-09-10T22:15:58.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.171+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d80116d0 con 0x7f03e0109150 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.171+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e01a5d60 con 0x7f03e0109150 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.172+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e01031a0 con 0x7f03e0109150 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.174+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f03d800f040 con 0x7f03e0109150 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.175+0000 7f03ddffb640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03cc0b5370 0x7f03cc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.175+0000 7f03dffff640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03cc0b5370 0x7f03cc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.175+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f03d80e5fa0 con 0x7f03e0109150 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.175+0000 7f03dffff640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03cc0b5370 0x7f03cc0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f03d0031440 tx=0x7f03d0005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:58.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.178+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f03d8016030 con 0x7f03e0109150 2024-09-10T22:15:58.210 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:57 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:15:58.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.368+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f03e019a430 con 0x7f03e0109150 2024-09-10T22:15:58.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.368+0000 7f03ddffb640 1 -- 172.21.15.5:0/2871589484 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f03e019a430 con 0x7f03e0109150 2024-09-10T22:15:58.370 INFO:teuthology.orchestra.run.smithi005.stdout:34359738449 2024-09-10T22:15:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03cc0b5370 msgr2=0x7f03cc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03cc0b5370 0x7f03cc0b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f03d0031440 tx=0x7f03d0005b50 comp rx=0 tx=0).stop 2024-09-10T22:15:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 msgr2=0x7f03e019ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 0x7f03e019ebe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f03d800eaa0 tx=0x7f03d800ef60 comp rx=0 tx=0).stop 2024-09-10T22:15:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 shutdown_connections 2024-09-10T22:15:58.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03cc0b5370 0x7f03cc0b7830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f03e0109150 0x7f03e019ebe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03e01087d0 0x7f03e0199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 --2- 172.21.15.5:0/2871589484 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03e0102dc0 0x7f03e0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 >> 172.21.15.5:0/2871589484 conn(0x7f03e00fe830 msgr2=0x7f03e0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 shutdown_connections 2024-09-10T22:15:58.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.371+0000 7f03e6a09640 1 -- 172.21.15.5:0/2871589484 wait complete. 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 -- 172.21.15.5:0/2993340109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4103ce0 msgr2=0x7f9fc41040c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 --2- 172.21.15.5:0/2993340109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4103ce0 0x7f9fc41040c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4009900 tx=0x7f9fb402a410 comp rx=0 tx=0).stop 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 -- 172.21.15.5:0/2993340109 shutdown_connections 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 --2- 172.21.15.5:0/2993340109 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc410d140 0x7f9fc410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 --2- 172.21.15.5:0/2993340109 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fc4104600 0x7f9fc410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 --2- 172.21.15.5:0/2993340109 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4103ce0 0x7f9fc41040c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 -- 172.21.15.5:0/2993340109 >> 172.21.15.5:0/2993340109 conn(0x7f9fc40fd700 msgr2=0x7f9fc40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 -- 172.21.15.5:0/2993340109 shutdown_connections 2024-09-10T22:15:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.663+0000 7f9fca293640 1 -- 172.21.15.5:0/2993340109 wait complete. 2024-09-10T22:15:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 Processor -- start 2024-09-10T22:15:58.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 -- start start 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4103ce0 0x7f9fc4101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 0x7f9fc4101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fc410d140 0x7f9fc4102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4112db0 con 0x7f9fc4104600 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4112c30 con 0x7f9fc4103ce0 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fca293640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4112f30 con 0x7f9fc410d140 2024-09-10T22:15:58.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 0x7f9fc4101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fc37fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 0x7f9fc4101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53546/0 (socket says 172.21.15.5:53546) 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.664+0000 7f9fc37fe640 1 -- 172.21.15.5:0/3125487006 learned_addr learned my addr 172.21.15.5:0/3125487006 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc8830640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fc410d140 0x7f9fc4102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc3fff640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4103ce0 0x7f9fc4101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc37fe640 1 -- 172.21.15.5:0/3125487006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fc410d140 msgr2=0x7f9fc4102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc37fe640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fc410d140 0x7f9fc4102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc37fe640 1 -- 172.21.15.5:0/3125487006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4103ce0 msgr2=0x7f9fc4101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc37fe640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4103ce0 0x7f9fc4101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc37fe640 1 -- 172.21.15.5:0/3125487006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc41a7720 con 0x7f9fc4104600 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc37fe640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 0x7f9fc4101ed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800d750 tx=0x7f9fb800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8017070 con 0x7f9fc4104600 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fb8004020 con 0x7f9fc4104600 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8003c00 con 0x7f9fc4104600 2024-09-10T22:15:58.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc41a7a10 con 0x7f9fc4104600 2024-09-10T22:15:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.665+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc41a7f50 con 0x7f9fc4104600 2024-09-10T22:15:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.666+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc41040c0 con 0x7f9fc4104600 2024-09-10T22:15:58.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.668+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f9fb8009a30 con 0x7f9fc4104600 2024-09-10T22:15:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.669+0000 7f9fc17fa640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9fac0b5370 0x7f9fac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.669+0000 7f9fc3fff640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9fac0b5370 0x7f9fac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.669+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f9fb80e5970 con 0x7f9fc4104600 2024-09-10T22:15:58.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.670+0000 7f9fc3fff640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9fac0b5370 0x7f9fac0b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4031440 tx=0x7f9fb4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:58.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.672+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fb80ac0b0 con 0x7f9fc4104600 2024-09-10T22:15:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 -- 172.21.15.5:0/4277109887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081087d0 msgr2=0x7fc108108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 --2- 172.21.15.5:0/4277109887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081087d0 0x7fc108108c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009900 tx=0x7fc0fc02a410 comp rx=0 tx=0).stop 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 -- 172.21.15.5:0/4277109887 shutdown_connections 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 --2- 172.21.15.5:0/4277109887 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108109150 0x7fc10810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 --2- 172.21.15.5:0/4277109887 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc1081087d0 0x7fc108108c10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 --2- 172.21.15.5:0/4277109887 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc108102dc0 0x7fc1081031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 -- 172.21.15.5:0/4277109887 >> 172.21.15.5:0/4277109887 conn(0x7fc1080fe830 msgr2=0x7fc108100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 -- 172.21.15.5:0/4277109887 shutdown_connections 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.830+0000 7fc10d88a640 1 -- 172.21.15.5:0/4277109887 wait complete. 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 Processor -- start 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 -- start start 2024-09-10T22:15:58.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108102dc0 0x7fc108199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1081087d0 0x7fc1081997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 0x7fc10819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc108112e10 con 0x7fc108109150 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc108112c90 con 0x7fc108102dc0 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc10d88a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc108112f90 con 0x7fc1081087d0 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 0x7fc10819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc106ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108102dc0 0x7fc108199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc1077fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 0x7fc10819eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53574/0 (socket says 172.21.15.5:53574) 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc1077fe640 1 -- 172.21.15.5:0/2449230886 learned_addr learned my addr 172.21.15.5:0/2449230886 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.831+0000 7fc1067fc640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1081087d0 0x7fc1081997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc1077fe640 1 -- 172.21.15.5:0/2449230886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1081087d0 msgr2=0x7fc1081997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc1077fe640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1081087d0 0x7fc1081997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc1077fe640 1 -- 172.21.15.5:0/2449230886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108102dc0 msgr2=0x7fc108199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc1077fe640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108102dc0 0x7fc108199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc1077fe640 1 -- 172.21.15.5:0/2449230886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10819f330 con 0x7fc108109150 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc106ffd640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108102dc0 0x7fc108199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc1077fe640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 0x7fc10819eb60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc10000eb10 tx=0x7fc10000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100004b20 con 0x7fc108109150 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc100004cc0 con 0x7fc108109150 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10819f620 con 0x7fc108109150 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc100010670 con 0x7fc108109150 2024-09-10T22:15:58.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.832+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1081a5ce0 con 0x7fc108109150 2024-09-10T22:15:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.833+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc108104070 con 0x7fc108109150 2024-09-10T22:15:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.835+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc100005000 con 0x7fc108109150 2024-09-10T22:15:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.836+0000 7fc10c888640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0f00b5370 0x7fc0f00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.836+0000 7fc106ffd640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0f00b5370 0x7fc0f00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.836+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc1000e6590 con 0x7fc108109150 2024-09-10T22:15:58.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.836+0000 7fc106ffd640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0f00b5370 0x7fc0f00b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009fc0 tx=0x7fc0f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:58.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.843+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc1000ad3b0 con 0x7fc108109150 2024-09-10T22:15:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.867+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9fc41a8340 con 0x7f9fc4104600 2024-09-10T22:15:58.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.868+0000 7f9fc17fa640 1 -- 172.21.15.5:0/3125487006 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9fb80b0ae0 con 0x7f9fc4104600 2024-09-10T22:15:58.869 INFO:teuthology.orchestra.run.smithi005.stdout:77309411399 2024-09-10T22:15:58.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9fac0b5370 msgr2=0x7f9fac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9fac0b5370 0x7f9fac0b7830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4031440 tx=0x7f9fb4005b50 comp rx=0 tx=0).stop 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 msgr2=0x7f9fc4101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 0x7f9fc4101ed0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800d750 tx=0x7f9fb800dc10 comp rx=0 tx=0).stop 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 shutdown_connections 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9fac0b5370 0x7f9fac0b7830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fc410d140 0x7f9fc4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fc4104600 0x7f9fc4101ed0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 --2- 172.21.15.5:0/3125487006 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fc4103ce0 0x7f9fc4101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.870+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 >> 172.21.15.5:0/3125487006 conn(0x7f9fc40fd700 msgr2=0x7f9fc40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.871+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 shutdown_connections 2024-09-10T22:15:58.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:58.871+0000 7f9fca293640 1 -- 172.21.15.5:0/3125487006 wait complete. 2024-09-10T22:15:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:58 smithi005 ceph-mon[31115]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:15:58.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:58 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2871589484' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T22:15:58.999 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906972 got 274877906974 for osd.10 2024-09-10T22:15:59.000 DEBUG:teuthology.parallel:result is None 2024-09-10T22:15:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.040+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc1081031a0 con 0x7fc108109150 2024-09-10T22:15:59.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.040+0000 7fc10c888640 1 -- 172.21.15.5:0/2449230886 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc1000accb0 con 0x7fc108109150 2024-09-10T22:15:59.041 INFO:teuthology.orchestra.run.smithi005.stdout:180388626482 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0f00b5370 msgr2=0x7fc0f00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0f00b5370 0x7fc0f00b7830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8009fc0 tx=0x7fc0f8005f90 comp rx=0 tx=0).stop 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 msgr2=0x7fc10819eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 0x7fc10819eb60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc10000eb10 tx=0x7fc10000c2d0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 shutdown_connections 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0f00b5370 0x7fc0f00b7830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc108109150 0x7fc10819eb60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc1081087d0 0x7fc1081997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 --2- 172.21.15.5:0/2449230886 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc108102dc0 0x7fc108199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.042+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 >> 172.21.15.5:0/2449230886 conn(0x7fc1080fe830 msgr2=0x7fc108100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:59.044 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.043+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 shutdown_connections 2024-09-10T22:15:59.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.043+0000 7fc10d88a640 1 -- 172.21.15.5:0/2449230886 wait complete. 2024-09-10T22:15:59.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:58 smithi189 ceph-mon[35784]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:15:59.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:58 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2871589484' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T22:15:59.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:58 smithi052 ceph-mon[34997]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:15:59.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:58 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2871589484' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-10T22:15:59.650 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411397 got 77309411399 for osd.2 2024-09-10T22:15:59.651 DEBUG:teuthology.parallel:result is None 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 -- 172.21.15.5:0/2165279149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 msgr2=0x7f159410f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 --2- 172.21.15.5:0/2165279149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f159410f950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ca0 tx=0x7f158c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 -- 172.21.15.5:0/2165279149 shutdown_connections 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 --2- 172.21.15.5:0/2165279149 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f159410f950 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 --2- 172.21.15.5:0/2165279149 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f15941087d0 0x7f1594108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 --2- 172.21.15.5:0/2165279149 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1594102dc0 0x7f15941031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 -- 172.21.15.5:0/2165279149 >> 172.21.15.5:0/2165279149 conn(0x7f15940fe830 msgr2=0x7f1594100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 -- 172.21.15.5:0/2165279149 shutdown_connections 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.771+0000 7f159bbc3640 1 -- 172.21.15.5:0/2165279149 wait complete. 2024-09-10T22:15:59.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 Processor -- start 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 -- start start 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1594102dc0 0x7f15940754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15941087d0 0x7f15940759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f1594075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1594112dd0 con 0x7f1594109150 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1594112c50 con 0x7f15941087d0 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159bbc3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1594112f50 con 0x7f1594102dc0 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159a160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f1594075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159a160640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f1594075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53604/0 (socket says 172.21.15.5:53604) 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159a160640 1 -- 172.21.15.5:0/1001326833 learned_addr learned my addr 172.21.15.5:0/1001326833 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159915e640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15941087d0 0x7f15940759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.772+0000 7f159995f640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1594102dc0 0x7f15940754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:59.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159a160640 1 -- 172.21.15.5:0/1001326833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1594102dc0 msgr2=0x7f15940754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159a160640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1594102dc0 0x7f15940754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159a160640 1 -- 172.21.15.5:0/1001326833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15941087d0 msgr2=0x7f15940759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159a160640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15941087d0 0x7f15940759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159a160640 1 -- 172.21.15.5:0/1001326833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15941a7640 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159a160640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f1594075f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f158c0098d0 tx=0x7f158c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c003b70 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f158c003d10 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15941a78d0 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c02fa20 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.773+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15941a7e60 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.774+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15941031a0 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.776+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f158c02fbe0 con 0x7f1594109150 2024-09-10T22:15:59.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.776+0000 7f158affd640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f15800b53f0 0x7f15800b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:15:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.776+0000 7f159995f640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f15800b53f0 0x7f15800b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:15:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.776+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f158c1070a0 con 0x7f1594109150 2024-09-10T22:15:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.777+0000 7f159995f640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f15800b53f0 0x7f15800b78b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f159000bbe0 tx=0x7f159000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:15:59.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.779+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f158c0cdec0 con 0x7f1594109150 2024-09-10T22:15:59.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.969+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f159402e5c0 con 0x7f1594109150 2024-09-10T22:15:59.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:59 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3125487006' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T22:15:59.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:59 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:15:59.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:59 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:15:59.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:59 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2449230886' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T22:15:59.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:59 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:15:59.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:15:59 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:15:59.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.969+0000 7f158affd640 1 -- 172.21.15.5:0/1001326833 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f158c0cd7c0 con 0x7f1594109150 2024-09-10T22:15:59.972 INFO:teuthology.orchestra.run.smithi005.stdout:227633266728 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f15800b53f0 msgr2=0x7f15800b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f15800b53f0 0x7f15800b78b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f159000bbe0 tx=0x7f159000b390 comp rx=0 tx=0).stop 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 msgr2=0x7f1594075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f1594075f20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f158c0098d0 tx=0x7f158c0317b0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 shutdown_connections 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f15800b53f0 0x7f15800b78b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1594109150 0x7f1594075f20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f15941087d0 0x7f15940759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 --2- 172.21.15.5:0/1001326833 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1594102dc0 0x7f15940754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.972+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 >> 172.21.15.5:0/1001326833 conn(0x7f15940fe830 msgr2=0x7f15940ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:15:59.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.973+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 shutdown_connections 2024-09-10T22:15:59.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:15:59.973+0000 7f159bbc3640 1 -- 172.21.15.5:0/1001326833 wait complete. 2024-09-10T22:16:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:59 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3125487006' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T22:16:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:59 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:59 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:59 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2449230886' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T22:16:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:59 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:15:59 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.247 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:00.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:59 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3125487006' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-10T22:16:00.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:59 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:59 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:59 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2449230886' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-10T22:16:00.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:59 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:15:59 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:00.672 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:00.704 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738449 for osd.0 2024-09-10T22:16:00.704 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:00.971 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:00 smithi005 ceph-mon[31115]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:00.972 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:00 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1001326833' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T22:16:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:00 smithi189 ceph-mon[35784]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:00 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1001326833' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T22:16:01.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:00 smithi052 ceph-mon[34997]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:01.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:00 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1001326833' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-10T22:16:01.301 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266725 got 227633266728 for osd.8 2024-09-10T22:16:01.301 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:01.499 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:01.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626482 for osd.6 2024-09-10T22:16:01.954 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 -- 172.21.15.5:0/926903450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d4104530 msgr2=0x7fb0d410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/926903450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d4104530 0x7fb0d410cb10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009900 tx=0x7fb0bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 -- 172.21.15.5:0/926903450 shutdown_connections 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/926903450 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0d410d0e0 0x7fb0d410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/926903450 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d4104530 0x7fb0d410cb10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/926903450 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d4103b30 0x7fb0d4103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.228+0000 7fb0da1c9640 1 -- 172.21.15.5:0/926903450 >> 172.21.15.5:0/926903450 conn(0x7fb0d40fd700 msgr2=0x7fb0d40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.229+0000 7fb0da1c9640 1 -- 172.21.15.5:0/926903450 shutdown_connections 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.229+0000 7fb0da1c9640 1 -- 172.21.15.5:0/926903450 wait complete. 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.229+0000 7fb0da1c9640 1 Processor -- start 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.229+0000 7fb0da1c9640 1 -- start start 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0d4103b30 0x7fb0d419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d4104530 0x7fb0d419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 0x7fb0d41a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4112d60 con 0x7fb0d410d0e0 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4112be0 con 0x7fb0d4103b30 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d4112ee0 con 0x7fb0d4104530 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 0x7fb0d41a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 0x7fb0d41a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54580/0 (socket says 172.21.15.5:54580) 2024-09-10T22:16:02.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 -- 172.21.15.5:0/435748619 learned_addr learned my addr 172.21.15.5:0/435748619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d37fe640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0d4103b30 0x7fb0d419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0cbfff640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d4104530 0x7fb0d419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 -- 172.21.15.5:0/435748619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d4104530 msgr2=0x7fb0d419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d4104530 0x7fb0d419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 -- 172.21.15.5:0/435748619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0d4103b30 msgr2=0x7fb0d419b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0d4103b30 0x7fb0d419b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 -- 172.21.15.5:0/435748619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d41a15a0 con 0x7fb0d410d0e0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d3fff640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 0x7fb0d41a0dd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00eaa0 tx=0x7fb0cc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc004d20 con 0x7fb0d410d0e0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0cc005020 con 0x7fb0d410d0e0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.230+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d41a1890 con 0x7fb0d410d0e0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.231+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0116b0 con 0x7fb0d410d0e0 2024-09-10T22:16:02.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.231+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d41a7f50 con 0x7fb0d410d0e0 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.232+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d4103f10 con 0x7fb0d410d0e0 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.233+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fb0cc00f040 con 0x7fb0d410d0e0 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.234+0000 7fb0d17fa640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb0c00b5370 0x7fb0c00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.234+0000 7fb0d37fe640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb0c00b5370 0x7fb0c00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.234+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb0cc0e5e80 con 0x7fb0d410d0e0 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.234+0000 7fb0d37fe640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb0c00b5370 0x7fb0c00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400abe0 tx=0x7fb0c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:02.265 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.237+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb0cc016030 con 0x7fb0d410d0e0 2024-09-10T22:16:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.427+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb0d419c620 con 0x7fb0d410d0e0 2024-09-10T22:16:02.429 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.428+0000 7fb0d17fa640 1 -- 172.21.15.5:0/435748619 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb0d419c620 con 0x7fb0d410d0e0 2024-09-10T22:16:02.429 INFO:teuthology.orchestra.run.smithi005.stdout:133143986238 2024-09-10T22:16:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb0c00b5370 msgr2=0x7fb0c00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb0c00b5370 0x7fb0c00b7830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400abe0 tx=0x7fb0c400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 msgr2=0x7fb0d41a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 0x7fb0d41a0dd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00eaa0 tx=0x7fb0cc00eea0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 shutdown_connections 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb0c00b5370 0x7fb0c00b7830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb0d410d0e0 0x7fb0d41a0dd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb0d4104530 0x7fb0d419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 --2- 172.21.15.5:0/435748619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb0d4103b30 0x7fb0d419b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 >> 172.21.15.5:0/435748619 conn(0x7fb0d40fd700 msgr2=0x7fb0d410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 shutdown_connections 2024-09-10T22:16:02.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:02.430+0000 7fb0da1c9640 1 -- 172.21.15.5:0/435748619 wait complete. 2024-09-10T22:16:03.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:02 smithi005 ceph-mon[31115]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:03.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:02 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/435748619' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T22:16:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:02 smithi189 ceph-mon[35784]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:03.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:02 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/435748619' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T22:16:03.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:02 smithi052 ceph-mon[34997]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:03.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:02 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/435748619' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-10T22:16:03.251 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986234 got 133143986238 for osd.4 2024-09-10T22:16:03.252 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/842210169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc1087d0 msgr2=0x7f1cbc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:03.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/842210169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc108c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0009900 tx=0x7f1cb002a410 comp rx=0 tx=0).stop 2024-09-10T22:16:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/842210169 shutdown_connections 2024-09-10T22:16:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/842210169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cbc109150 0x7f1cbc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/842210169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc108c10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/842210169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/842210169 >> 172.21.15.5:0/842210169 conn(0x7f1cbc0fe830 msgr2=0x7f1cbc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/842210169 shutdown_connections 2024-09-10T22:16:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.428+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/842210169 wait complete. 2024-09-10T22:16:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 Processor -- start 2024-09-10T22:16:03.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 -- start start 2024-09-10T22:16:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cbc109150 0x7f1cbc19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc112e10 con 0x7f1cbc102dc0 2024-09-10T22:16:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc112c90 con 0x7f1cbc1087d0 2024-09-10T22:16:03.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cc1c9b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1cbc112f90 con 0x7f1cbc109150 2024-09-10T22:16:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54592/0 (socket says 172.21.15.5:54592) 2024-09-10T22:16:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cbb7fe640 1 -- 172.21.15.5:0/1174942356 learned_addr learned my addr 172.21.15.5:0/1174942356 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.429+0000 7f1cbbfff640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cbc109150 0x7f1cbc19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbaffd640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:03.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbb7fe640 1 -- 172.21.15.5:0/1174942356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cbc109150 msgr2=0x7f1cbc19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbb7fe640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cbc109150 0x7f1cbc19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbb7fe640 1 -- 172.21.15.5:0/1174942356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc1087d0 msgr2=0x7f1cbc199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbb7fe640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbb7fe640 1 -- 172.21.15.5:0/1174942356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cbc19f2b0 con 0x7f1cbc102dc0 2024-09-10T22:16:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbaffd640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:03.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cbb7fe640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc199200 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00e9f0 tx=0x7f1cac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00cd80 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cac0108e0 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cac018980 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cbc19f5a0 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.430+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cbc1a5c60 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.431+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cbc1031a0 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.432+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f1cac010430 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.433+0000 7f1cb8ff9640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1ca40b53f0 0x7f1ca40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.433+0000 7f1cbaffd640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1ca40b53f0 0x7f1ca40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.433+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f1cac0e6640 con 0x7f1cbc102dc0 2024-09-10T22:16:03.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.434+0000 7f1cbaffd640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1ca40b53f0 0x7f1ca40b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0000c00 tx=0x7f1cb0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:03.444 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.436+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1cac0ad370 con 0x7f1cbc102dc0 2024-09-10T22:16:03.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.623+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f1cbc1a5ff0 con 0x7f1cbc102dc0 2024-09-10T22:16:03.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.623+0000 7f1cb8ff9640 1 -- 172.21.15.5:0/1174942356 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1cac0acc70 con 0x7f1cbc102dc0 2024-09-10T22:16:03.625 INFO:teuthology.orchestra.run.smithi005.stdout:201863462957 2024-09-10T22:16:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1ca40b53f0 msgr2=0x7f1ca40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1ca40b53f0 0x7f1ca40b78b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0000c00 tx=0x7f1cb0031400 comp rx=0 tx=0).stop 2024-09-10T22:16:03.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 msgr2=0x7f1cbc199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc199200 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00e9f0 tx=0x7f1cac00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 shutdown_connections 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1ca40b53f0 0x7f1ca40b78b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1cbc109150 0x7f1cbc19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1cbc1087d0 0x7f1cbc199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 --2- 172.21.15.5:0/1174942356 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1cbc102dc0 0x7f1cbc199200 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 >> 172.21.15.5:0/1174942356 conn(0x7f1cbc0fe830 msgr2=0x7f1cbc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 shutdown_connections 2024-09-10T22:16:03.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:03.625+0000 7f1cc1c9b640 1 -- 172.21.15.5:0/1174942356 wait complete. 2024-09-10T22:16:03.887 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:03 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1174942356' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T22:16:04.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:03 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1174942356' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T22:16:04.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:03 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1174942356' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-10T22:16:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/1491301659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f81080c0 msgr2=0x7fe5f810e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/1491301659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f81080c0 0x7fe5f810e8c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009ca0 tx=0x7fe5f002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/1491301659 shutdown_connections 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/1491301659 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f81080c0 0x7fe5f810e8c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/1491301659 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5f8107740 0x7fe5f8107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/1491301659 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f8101d30 0x7fe5f8102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/1491301659 >> 172.21.15.5:0/1491301659 conn(0x7fe5f80fd7e0 msgr2=0x7fe5f80ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/1491301659 shutdown_connections 2024-09-10T22:16:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.300+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/1491301659 wait complete. 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 Processor -- start 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 -- start start 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 0x7fe5f81980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5f8107740 0x7fe5f8198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f81080c0 0x7fe5f819d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8111d40 con 0x7fe5f8101d30 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8111bc0 con 0x7fe5f8107740 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5ff4a6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8111ec0 con 0x7fe5f81080c0 2024-09-10T22:16:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5fd242640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 0x7fe5f81980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5fd242640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 0x7fe5f81980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54616/0 (socket says 172.21.15.5:54616) 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5fd242640 1 -- 172.21.15.5:0/2062031126 learned_addr learned my addr 172.21.15.5:0/2062031126 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.301+0000 7fe5fca41640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5f8107740 0x7fe5f8198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fd242640 1 -- 172.21.15.5:0/2062031126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f81080c0 msgr2=0x7fe5f819d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fda43640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f81080c0 0x7fe5f819d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fd242640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f81080c0 0x7fe5f819d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fd242640 1 -- 172.21.15.5:0/2062031126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5f8107740 msgr2=0x7fe5f8198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fd242640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5f8107740 0x7fe5f8198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fd242640 1 -- 172.21.15.5:0/2062031126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f819e1a0 con 0x7fe5f8101d30 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5fd242640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 0x7fe5f81980f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c920 tx=0x7fe5f400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4007bb0 con 0x7fe5f8101d30 2024-09-10T22:16:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5f4007d50 con 0x7fe5f8101d30 2024-09-10T22:16:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f819e490 con 0x7fe5f8101d30 2024-09-10T22:16:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4018730 con 0x7fe5f8101d30 2024-09-10T22:16:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.302+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f81a4b50 con 0x7fe5f8101d30 2024-09-10T22:16:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.303+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f8102110 con 0x7fe5f8101d30 2024-09-10T22:16:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.306+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fe5f400f450 con 0x7fe5f8101d30 2024-09-10T22:16:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.306+0000 7fe5ee7fc640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe5e40b5370 0x7fe5e40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.307+0000 7fe5fca41640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe5e40b5370 0x7fe5e40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.307+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe5f40e6130 con 0x7fe5f8101d30 2024-09-10T22:16:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.307+0000 7fe5fca41640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe5e40b5370 0x7fe5e40b7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5f81000f0 tx=0x7fe5e800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.308+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe5f4014030 con 0x7fe5f8101d30 2024-09-10T22:16:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 -- 172.21.15.5:0/2554898163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65841076e0 msgr2=0x7f6584107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 --2- 172.21.15.5:0/2554898163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65841076e0 0x7f6584107b20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6578009900 tx=0x7f657802a410 comp rx=0 tx=0).stop 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 -- 172.21.15.5:0/2554898163 shutdown_connections 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 --2- 172.21.15.5:0/2554898163 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 0x7f658410e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 --2- 172.21.15.5:0/2554898163 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f65841076e0 0x7f6584107b20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 --2- 172.21.15.5:0/2554898163 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6584101cd0 0x7f65841020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 -- 172.21.15.5:0/2554898163 >> 172.21.15.5:0/2554898163 conn(0x7f65840fd700 msgr2=0x7f65840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 -- 172.21.15.5:0/2554898163 shutdown_connections 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.181+0000 7f658a522640 1 -- 172.21.15.5:0/2554898163 wait complete. 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 Processor -- start 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 -- start start 2024-09-10T22:16:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 0x7f6584198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65841076e0 0x7f65841986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 0x7f658419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6584111ce0 con 0x7f6584101cd0 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6584111b60 con 0x7f65841076e0 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.182+0000 7f658a522640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6584111e60 con 0x7f6584108060 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 0x7f6584198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 0x7f6584198170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54600/0 (socket says 172.21.15.5:54600) 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 -- 172.21.15.5:0/2829213028 learned_addr learned my addr 172.21.15.5:0/2829213028 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f65837fe640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65841076e0 0x7f65841986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6588abf640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 0x7f658419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 -- 172.21.15.5:0/2829213028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 msgr2=0x7f658419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 0x7f658419da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 -- 172.21.15.5:0/2829213028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65841076e0 msgr2=0x7f65841986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65841076e0 0x7f65841986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 -- 172.21.15.5:0/2829213028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658419e220 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6588abf640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 0x7f658419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f6583fff640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 0x7f6584198170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f657400c890 tx=0x7f657400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574004220 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658419e510 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65740043c0 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6574004a00 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.183+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65841a4da0 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.184+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65841020b0 con 0x7f6584101cd0 2024-09-10T22:16:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.186+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f65740079b0 con 0x7f6584101cd0 2024-09-10T22:16:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.187+0000 7f65817fa640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f656c0b5370 0x7f656c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:04.440 INFO:teuthology.orchestra.run.smithi005.stdout:107374182467 2024-09-10T22:16:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.187+0000 7f65837fe640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f656c0b5370 0x7f656c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.187+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f65740e5f00 con 0x7f6584101cd0 2024-09-10T22:16:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.187+0000 7f65837fe640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f656c0b5370 0x7f656c0b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6578031440 tx=0x7f6578005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.190+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6574014030 con 0x7f6584101cd0 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.384+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6584109e40 con 0x7f6584101cd0 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.384+0000 7f65817fa640 1 -- 172.21.15.5:0/2829213028 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f65740acc30 con 0x7f6584101cd0 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f656c0b5370 msgr2=0x7f656c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f656c0b5370 0x7f656c0b7830 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6578031440 tx=0x7f6578005b50 comp rx=0 tx=0).stop 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 msgr2=0x7f6584198170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 0x7f6584198170 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f657400c890 tx=0x7f657400cd50 comp rx=0 tx=0).stop 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 shutdown_connections 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f656c0b5370 0x7f656c0b7830 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6584108060 0x7f658419da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f65841076e0 0x7f65841986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 --2- 172.21.15.5:0/2829213028 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6584101cd0 0x7f6584198170 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 >> 172.21.15.5:0/2829213028 conn(0x7f65840fd700 msgr2=0x7f65840ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 shutdown_connections 2024-09-10T22:16:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.387+0000 7f658a522640 1 -- 172.21.15.5:0/2829213028 wait complete. 2024-09-10T22:16:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.507+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fe5f81a4ed0 con 0x7fe5f8101d30 2024-09-10T22:16:04.509 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.507+0000 7fe5ee7fc640 1 -- 172.21.15.5:0/2062031126 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fe5f40acf50 con 0x7fe5f8101d30 2024-09-10T22:16:04.510 INFO:teuthology.orchestra.run.smithi005.stdout:300647710746 2024-09-10T22:16:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe5e40b5370 msgr2=0x7fe5e40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe5e40b5370 0x7fe5e40b7830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5f81000f0 tx=0x7fe5e800a2d0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 msgr2=0x7fe5f81980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 0x7fe5f81980f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe5f400c920 tx=0x7fe5f400cd20 comp rx=0 tx=0).stop 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 shutdown_connections 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe5e40b5370 0x7fe5e40b7830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe5f81080c0 0x7fe5f819d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe5f8107740 0x7fe5f8198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 --2- 172.21.15.5:0/2062031126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe5f8101d30 0x7fe5f81980f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 >> 172.21.15.5:0/2062031126 conn(0x7fe5f80fd7e0 msgr2=0x7fe5f80fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 shutdown_connections 2024-09-10T22:16:04.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:04.509+0000 7fe5ff4a6640 1 -- 172.21.15.5:0/2062031126 wait complete. 2024-09-10T22:16:05.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:04 smithi005 ceph-mon[31115]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:05.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:04 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2829213028' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T22:16:05.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:04 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2062031126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T22:16:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:04 smithi189 ceph-mon[35784]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:04 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2829213028' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T22:16:05.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:04 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2062031126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T22:16:05.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:04 smithi052 ceph-mon[34997]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:05.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:04 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2829213028' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-10T22:16:05.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:04 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2062031126' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-10T22:16:05.777 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:05.800 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710743 got 300647710746 for osd.11 2024-09-10T22:16:05.800 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:05.906 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462956 got 201863462957 for osd.7 2024-09-10T22:16:05.907 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 -- 172.21.15.5:0/3515581749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda0108020 msgr2=0x7fbda010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 --2- 172.21.15.5:0/3515581749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda0108020 0x7fbda010e820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009ca0 tx=0x7fbd9802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 -- 172.21.15.5:0/3515581749 shutdown_connections 2024-09-10T22:16:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 --2- 172.21.15.5:0/3515581749 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda0108020 0x7fbda010e820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 --2- 172.21.15.5:0/3515581749 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbda01076a0 0x7fbda0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 --2- 172.21.15.5:0/3515581749 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda0101c90 0x7fbda0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 -- 172.21.15.5:0/3515581749 >> 172.21.15.5:0/3515581749 conn(0x7fbda00fd700 msgr2=0x7fbda00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 -- 172.21.15.5:0/3515581749 shutdown_connections 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.359+0000 7fbda8286640 1 -- 172.21.15.5:0/3515581749 wait complete. 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.360+0000 7fbda8286640 1 Processor -- start 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.360+0000 7fbda8286640 1 -- start start 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.360+0000 7fbda8286640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda0101c90 0x7fbda00fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda8286640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 0x7fbda00fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda8286640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbda0108020 0x7fbda00fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda8286640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fbda0111d30 con 0x7fbda01076a0 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda8286640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fbda0111bb0 con 0x7fbda0108020 2024-09-10T22:16:06.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda8286640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fbda0111eb0 con 0x7fbda0101c90 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 0x7fbda00fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 0x7fbda00fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54624/0 (socket says 172.21.15.5:54624) 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 -- 172.21.15.5:0/3912808836 learned_addr learned my addr 172.21.15.5:0/3912808836 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda6022640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda0101c90 0x7fbda00fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda6823640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbda0108020 0x7fbda00fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 -- 172.21.15.5:0/3912808836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda0101c90 msgr2=0x7fbda00fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda0101c90 0x7fbda00fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 -- 172.21.15.5:0/3912808836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbda0108020 msgr2=0x7fbda00fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbda0108020 0x7fbda00fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 -- 172.21.15.5:0/3912808836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda01a76e0 con 0x7fbda01076a0 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.361+0000 7fbda5821640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 0x7fbda00fe140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000e9f0 tx=0x7fbd9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.362+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9000cd80 con 0x7fbda01076a0 2024-09-10T22:16:06.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.362+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd900108e0 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.362+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90018980 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.362+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda01a79d0 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.362+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda01a7ec0 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.363+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda0102070 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.365+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fbd90010430 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.366+0000 7fbd977fe640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbd8c0b53f0 0x7fbd8c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.366+0000 7fbda6022640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbd8c0b53f0 0x7fbd8c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.366+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fbd900e6480 con 0x7fbda01076a0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.366+0000 7fbda6022640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbd8c0b53f0 0x7fbd8c0b78b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009bd0 tx=0x7fbd9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:06.380 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.369+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbd900ad210 con 0x7fbda01076a0 2024-09-10T22:16:06.384 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:06.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.568+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbda002e5c0 con 0x7fbda01076a0 2024-09-10T22:16:06.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.568+0000 7fbd977fe640 1 -- 172.21.15.5:0/3912808836 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd900acb10 con 0x7fbda01076a0 2024-09-10T22:16:06.571 INFO:teuthology.orchestra.run.smithi005.stdout:55834574925 2024-09-10T22:16:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbd8c0b53f0 msgr2=0x7fbd8c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbd8c0b53f0 0x7fbd8c0b78b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009bd0 tx=0x7fbd9c005f90 comp rx=0 tx=0).stop 2024-09-10T22:16:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 msgr2=0x7fbda00fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 0x7fbda00fe140 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbd9000e9f0 tx=0x7fbd9000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 shutdown_connections 2024-09-10T22:16:06.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fbd8c0b53f0 0x7fbd8c0b78b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fbda0108020 0x7fbda00fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fbda01076a0 0x7fbda00fe140 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 --2- 172.21.15.5:0/3912808836 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fbda0101c90 0x7fbda00fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 >> 172.21.15.5:0/3912808836 conn(0x7fbda00fd700 msgr2=0x7fbda006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 shutdown_connections 2024-09-10T22:16:06.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:06.571+0000 7fbda8286640 1 -- 172.21.15.5:0/3912808836 wait complete. 2024-09-10T22:16:07.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:06 smithi189 ceph-mon[35784]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:07.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:06 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3912808836' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T22:16:07.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:06 smithi052 ceph-mon[34997]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:07.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:06 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3912808836' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T22:16:07.285 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:06 smithi005 ceph-mon[31115]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:07.285 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:06 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3912808836' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-10T22:16:07.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574925 for osd.1 2024-09-10T22:16:07.314 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 -- 172.21.15.5:0/3087947360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c108020 msgr2=0x7f809c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:07.519 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3087947360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c108020 0x7f809c10e820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8094009ca0 tx=0x7f809402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 -- 172.21.15.5:0/3087947360 shutdown_connections 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3087947360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c108020 0x7f809c10e820 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3087947360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c1076a0 0x7f809c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3087947360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 0x7f809c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 -- 172.21.15.5:0/3087947360 >> 172.21.15.5:0/3087947360 conn(0x7f809c0fd700 msgr2=0x7f809c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 -- 172.21.15.5:0/3087947360 shutdown_connections 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 -- 172.21.15.5:0/3087947360 wait complete. 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 Processor -- start 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.503+0000 7f80a18ef640 1 -- start start 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 0x7f809c198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 0x7f809c198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:07.520 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c108020 0x7f809c19da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f809c111cf0 con 0x7f809c1076a0 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f809c111b70 con 0x7f809c101c90 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f809c111e70 con 0x7f809c108020 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 0x7f809c198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 0x7f809c198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54636/0 (socket says 172.21.15.5:54636) 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 -- 172.21.15.5:0/3451621037 learned_addr learned my addr 172.21.15.5:0/3451621037 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f809affd640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 0x7f809c198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f809b7fe640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c108020 0x7f809c19da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 -- 172.21.15.5:0/3451621037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c108020 msgr2=0x7f809c19da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c108020 0x7f809c19da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 -- 172.21.15.5:0/3451621037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 msgr2=0x7f809c198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 0x7f809c198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.521 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 -- 172.21.15.5:0/3451621037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c19e1f0 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f809affd640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 0x7f809c198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f8093fff640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 0x7f809c198680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80840078f0 tx=0x7f8084007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084019020 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c19e4e0 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80840054d0 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400e650 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.504+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c06aab0 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.505+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c102070 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.507+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f8084014070 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.508+0000 7f80a08ed640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f80880b5370 0x7f80880b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.508+0000 7f809affd640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f80880b5370 0x7f80880b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.508+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f80840e7160 con 0x7f809c1076a0 2024-09-10T22:16:07.522 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.508+0000 7f809affd640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f80880b5370 0x7f80880b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f808c0058c0 tx=0x7f808c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:07.523 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.512+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8084023020 con 0x7f809c1076a0 2024-09-10T22:16:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.711+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f809c06b640 con 0x7f809c1076a0 2024-09-10T22:16:07.714 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.712+0000 7f80a08ed640 1 -- 172.21.15.5:0/3451621037 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f80840adf80 con 0x7f809c1076a0 2024-09-10T22:16:07.714 INFO:teuthology.orchestra.run.smithi005.stdout:253403070500 2024-09-10T22:16:07.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f80880b5370 msgr2=0x7f80880b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:07.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f80880b5370 0x7f80880b7830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f808c0058c0 tx=0x7f808c005ec0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.716 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 msgr2=0x7f809c198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 0x7f809c198680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f80840078f0 tx=0x7f8084007db0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 shutdown_connections 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f80880b5370 0x7f80880b7830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f809c108020 0x7f809c19da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f809c1076a0 0x7f809c198680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 --2- 172.21.15.5:0/3451621037 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f809c101c90 0x7f809c198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 >> 172.21.15.5:0/3451621037 conn(0x7f809c0fd700 msgr2=0x7f809c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 shutdown_connections 2024-09-10T22:16:07.717 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:07.714+0000 7f80a18ef640 1 -- 172.21.15.5:0/3451621037 wait complete. 2024-09-10T22:16:08.065 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:07 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3451621037' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T22:16:08.095 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182464 got 107374182467 for osd.3 2024-09-10T22:16:08.096 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:08.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:07 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3451621037' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T22:16:08.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:07 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3451621037' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-10T22:16:09.013 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:08 smithi005 ceph-mon[31115]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:09.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070498 got 253403070500 for osd.9 2024-09-10T22:16:09.043 DEBUG:teuthology.parallel:result is None 2024-09-10T22:16:09.043 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-10T22:16:09.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:16:09.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:08 smithi189 ceph-mon[35784]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:09.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:08 smithi052 ceph-mon[34997]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:09.490 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 -- 172.21.15.5:0/1364125362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50108060 msgr2=0x7f3c5010e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 --2- 172.21.15.5:0/1364125362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50108060 0x7f3c5010e860 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009ca0 tx=0x7f3c4802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 -- 172.21.15.5:0/1364125362 shutdown_connections 2024-09-10T22:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 --2- 172.21.15.5:0/1364125362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c50108060 0x7f3c5010e860 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 --2- 172.21.15.5:0/1364125362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c501076e0 0x7f3c50107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.028 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 --2- 172.21.15.5:0/1364125362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c50101cd0 0x7f3c501020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 -- 172.21.15.5:0/1364125362 >> 172.21.15.5:0/1364125362 conn(0x7f3c500fd700 msgr2=0x7f3c500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 -- 172.21.15.5:0/1364125362 shutdown_connections 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.000+0000 7f3c55356640 1 -- 172.21.15.5:0/1364125362 wait complete. 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 Processor -- start 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 -- start start 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c50101cd0 0x7f3c50199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 0x7f3c50199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c50108060 0x7f3c5019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50112e40 con 0x7f3c501076e0 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50112cc0 con 0x7f3c50108060 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c55356640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3c50112fc0 con 0x7f3c50101cd0 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c467fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 0x7f3c50199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:10.029 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c467fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 0x7f3c50199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54650/0 (socket says 172.21.15.5:54650) 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c467fc640 1 -- 172.21.15.5:0/2913636656 learned_addr learned my addr 172.21.15.5:0/2913636656 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c4f7fe640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c50108060 0x7f3c5019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.001+0000 7f3c4effd640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c50101cd0 0x7f3c50199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c467fc640 1 -- 172.21.15.5:0/2913636656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c50101cd0 msgr2=0x7f3c50199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c467fc640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c50101cd0 0x7f3c50199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c467fc640 1 -- 172.21.15.5:0/2913636656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c50108060 msgr2=0x7f3c5019eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c467fc640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c50108060 0x7f3c5019eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c467fc640 1 -- 172.21.15.5:0/2913636656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5019f300 con 0x7f3c501076e0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c467fc640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 0x7f3c50199790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800d770 tx=0x7f3c3800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38017070 con 0x7f3c501076e0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5019f5f0 con 0x7f3c501076e0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c380054d0 con 0x7f3c501076e0 2024-09-10T22:16:10.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c38004c30 con 0x7f3c501076e0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.002+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c501a5cb0 con 0x7f3c501076e0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.003+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c501020b0 con 0x7f3c501076e0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.005+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f3c38004dd0 con 0x7f3c501076e0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.006+0000 7f3c4cff9640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3c3c0b5370 0x7f3c3c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.006+0000 7f3c4effd640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3c3c0b5370 0x7f3c3c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.006+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3c380e5d20 con 0x7f3c501076e0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.007+0000 7f3c4effd640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3c3c0b5370 0x7f3c3c0b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009b60 tx=0x7f3c40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:10.031 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.009+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c380aca50 con 0x7f3c501076e0 2024-09-10T22:16:10.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.204+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c50104ca0 con 0x7f3c3c0b5370 2024-09-10T22:16:10.216 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.211+0000 7f3c4cff9640 1 -- 172.21.15.5:0/2913636656 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258916 (secure 0 0 0) 0x7f3c50104ca0 con 0x7f3c3c0b5370 2024-09-10T22:16:10.219 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:10.220 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:16:10.222 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3c3c0b5370 msgr2=0x7f3c3c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3c3c0b5370 0x7f3c3c0b7830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009b60 tx=0x7f3c40005f90 comp rx=0 tx=0).stop 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 msgr2=0x7f3c50199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 0x7f3c50199790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800d770 tx=0x7f3c3800dc30 comp rx=0 tx=0).stop 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 shutdown_connections 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3c3c0b5370 0x7f3c3c0b7830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3c50108060 0x7f3c5019eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3c501076e0 0x7f3c50199790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 --2- 172.21.15.5:0/2913636656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3c50101cd0 0x7f3c50199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 >> 172.21.15.5:0/2913636656 conn(0x7f3c500fd700 msgr2=0x7f3c500ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 shutdown_connections 2024-09-10T22:16:10.223 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:10.215+0000 7f3c55356640 1 -- 172.21.15.5:0/2913636656 wait complete. 2024-09-10T22:16:10.971 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-10T22:16:09.725340+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655220,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":420,"num_read_kb":303,"num_write":289,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363844,"kb_used_data":10356,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577980,"statfs":{"total":1151940427776,"available":1151567851520,"internally_reserved":0,"allocated":10604544,"data_stored":6862224,"data_compressed":113286,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003159"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481192+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:15:35.481192+0000","last_peered":"2024-09-10T22:15:35.481192+0000","last_clean":"2024-09-10T22:15:35.481192+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:15:35.481192+0000","last_undegraded":"2024-09-10T22:15:35.481192+0000","last_fullsized":"2024-09-10T22:15:35.481192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482226+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:15:35.482226+0000","last_peered":"2024-09-10T22:15:35.482226+0000","last_clean":"2024-09-10T22:15:35.482226+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:15:35.482226+0000","last_undegraded":"2024-09-10T22:15:35.482226+0000","last_fullsized":"2024-09-10T22:15:35.482226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481959+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:15:35.481959+0000","last_peered":"2024-09-10T22:15:35.481959+0000","last_clean":"2024-09-10T22:15:35.481959+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:15:35.481959+0000","last_undegraded":"2024-09-10T22:15:35.481959+0000","last_fullsized":"2024-09-10T22:15:35.481959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477802+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:15:35.477802+0000","last_peered":"2024-09-10T22:15:35.477802+0000","last_clean":"2024-09-10T22:15:35.477802+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:15:35.477802+0000","last_undegraded":"2024-09-10T22:15:35.477802+0000","last_fullsized":"2024-09-10T22:15:35.477802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481208+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:15:35.481208+0000","last_peered":"2024-09-10T22:15:35.481208+0000","last_clean":"2024-09-10T22:15:35.481208+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:15:35.481208+0000","last_undegraded":"2024-09-10T22:15:35.481208+0000","last_fullsized":"2024-09-10T22:15:35.481208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480433+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:15:35.480433+0000","last_peered":"2024-09-10T22:15:35.480433+0000","last_clean":"2024-09-10T22:15:35.480433+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:15:35.480433+0000","last_undegraded":"2024-09-10T22:15:35.480433+0000","last_fullsized":"2024-09-10T22:15:35.480433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847562+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:15:36.847562+0000","last_peered":"2024-09-10T22:15:36.847562+0000","last_clean":"2024-09-10T22:15:36.847562+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:15:36.847562+0000","last_undegraded":"2024-09-10T22:15:36.847562+0000","last_fullsized":"2024-09-10T22:15:36.847562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102745+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:15:36.102745+0000","last_peered":"2024-09-10T22:15:36.102745+0000","last_clean":"2024-09-10T22:15:36.102745+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:15:36.102745+0000","last_undegraded":"2024-09-10T22:15:36.102745+0000","last_fullsized":"2024-09-10T22:15:36.102745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480400+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:15:35.480400+0000","last_peered":"2024-09-10T22:15:35.480400+0000","last_clean":"2024-09-10T22:15:35.480400+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:15:35.480400+0000","last_undegraded":"2024-09-10T22:15:35.480400+0000","last_fullsized":"2024-09-10T22:15:35.480400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481054+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:15:35.481054+0000","last_peered":"2024-09-10T22:15:35.481054+0000","last_clean":"2024-09-10T22:15:35.481054+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:15:35.481054+0000","last_undegraded":"2024-09-10T22:15:35.481054+0000","last_fullsized":"2024-09-10T22:15:35.481054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847827+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:15:36.847827+0000","last_peered":"2024-09-10T22:15:36.847827+0000","last_clean":"2024-09-10T22:15:36.847827+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:15:36.847827+0000","last_undegraded":"2024-09-10T22:15:36.847827+0000","last_fullsized":"2024-09-10T22:15:36.847827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477965+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:15:35.477965+0000","last_peered":"2024-09-10T22:15:35.477965+0000","last_clean":"2024-09-10T22:15:35.477965+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:15:35.477965+0000","last_undegraded":"2024-09-10T22:15:35.477965+0000","last_fullsized":"2024-09-10T22:15:35.477965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477005+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:15:35.477005+0000","last_peered":"2024-09-10T22:15:35.477005+0000","last_clean":"2024-09-10T22:15:35.477005+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:15:35.477005+0000","last_undegraded":"2024-09-10T22:15:35.477005+0000","last_fullsized":"2024-09-10T22:15:35.477005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481830+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:15:35.481830+0000","last_peered":"2024-09-10T22:15:35.481830+0000","last_clean":"2024-09-10T22:15:35.481830+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:15:35.481830+0000","last_undegraded":"2024-09-10T22:15:35.481830+0000","last_fullsized":"2024-09-10T22:15:35.481830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481718+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:15:35.481718+0000","last_peered":"2024-09-10T22:15:35.481718+0000","last_clean":"2024-09-10T22:15:35.481718+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:15:35.481718+0000","last_undegraded":"2024-09-10T22:15:35.481718+0000","last_fullsized":"2024-09-10T22:15:35.481718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479342+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:15:35.479342+0000","last_peered":"2024-09-10T22:15:35.479342+0000","last_clean":"2024-09-10T22:15:35.479342+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:15:35.479342+0000","last_undegraded":"2024-09-10T22:15:35.479342+0000","last_fullsized":"2024-09-10T22:15:35.479342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481261+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:15:35.481261+0000","last_peered":"2024-09-10T22:15:35.481261+0000","last_clean":"2024-09-10T22:15:35.481261+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:15:35.481261+0000","last_undegraded":"2024-09-10T22:15:35.481261+0000","last_fullsized":"2024-09-10T22:15:35.481261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483173+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:15:35.483173+0000","last_peered":"2024-09-10T22:15:35.483173+0000","last_clean":"2024-09-10T22:15:35.483173+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:15:35.483173+0000","last_undegraded":"2024-09-10T22:15:35.483173+0000","last_fullsized":"2024-09-10T22:15:35.483173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.484987+0000","last_change":"2024-09-10T22:15:35.484878+0000","last_active":"2024-09-10T22:15:35.484987+0000","last_peered":"2024-09-10T22:15:35.484987+0000","last_clean":"2024-09-10T22:15:35.484987+0000","last_became_active":"2024-09-10T22:15:35.484434+0000","last_became_peered":"2024-09-10T22:15:35.484434+0000","last_unstale":"2024-09-10T22:15:35.484987+0000","last_undegraded":"2024-09-10T22:15:35.484987+0000","last_fullsized":"2024-09-10T22:15:35.484987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:12.935958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.484805+0000","last_change":"2024-09-10T22:15:35.484696+0000","last_active":"2024-09-10T22:15:35.484805+0000","last_peered":"2024-09-10T22:15:35.484805+0000","last_clean":"2024-09-10T22:15:35.484805+0000","last_became_active":"2024-09-10T22:15:35.484342+0000","last_became_peered":"2024-09-10T22:15:35.484342+0000","last_unstale":"2024-09-10T22:15:35.484805+0000","last_undegraded":"2024-09-10T22:15:35.484805+0000","last_fullsized":"2024-09-10T22:15:35.484805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:44.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477043+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:15:35.477043+0000","last_peered":"2024-09-10T22:15:35.477043+0000","last_clean":"2024-09-10T22:15:35.477043+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:15:35.477043+0000","last_undegraded":"2024-09-10T22:15:35.477043+0000","last_fullsized":"2024-09-10T22:15:35.477043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479480+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:15:35.479480+0000","last_peered":"2024-09-10T22:15:35.479480+0000","last_clean":"2024-09-10T22:15:35.479480+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:15:35.479480+0000","last_undegraded":"2024-09-10T22:15:35.479480+0000","last_fullsized":"2024-09-10T22:15:35.479480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102522+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:15:36.102522+0000","last_peered":"2024-09-10T22:15:36.102522+0000","last_clean":"2024-09-10T22:15:36.102522+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:15:36.102522+0000","last_undegraded":"2024-09-10T22:15:36.102522+0000","last_fullsized":"2024-09-10T22:15:36.102522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.104717+0000","last_change":"2024-09-10T22:15:36.104261+0000","last_active":"2024-09-10T22:15:36.104717+0000","last_peered":"2024-09-10T22:15:36.104717+0000","last_clean":"2024-09-10T22:15:36.104717+0000","last_became_active":"2024-09-10T22:15:36.103864+0000","last_became_peered":"2024-09-10T22:15:36.103864+0000","last_unstale":"2024-09-10T22:15:36.104717+0000","last_undegraded":"2024-09-10T22:15:36.104717+0000","last_fullsized":"2024-09-10T22:15:36.104717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:24.892850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103347+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:15:36.103347+0000","last_peered":"2024-09-10T22:15:36.103347+0000","last_clean":"2024-09-10T22:15:36.103347+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:15:36.103347+0000","last_undegraded":"2024-09-10T22:15:36.103347+0000","last_fullsized":"2024-09-10T22:15:36.103347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480753+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:15:35.480753+0000","last_peered":"2024-09-10T22:15:35.480753+0000","last_clean":"2024-09-10T22:15:35.480753+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:15:35.480753+0000","last_undegraded":"2024-09-10T22:15:35.480753+0000","last_fullsized":"2024-09-10T22:15:35.480753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480765+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:15:35.480765+0000","last_peered":"2024-09-10T22:15:35.480765+0000","last_clean":"2024-09-10T22:15:35.480765+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:15:35.480765+0000","last_undegraded":"2024-09-10T22:15:35.480765+0000","last_fullsized":"2024-09-10T22:15:35.480765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477024+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:15:35.477024+0000","last_peered":"2024-09-10T22:15:35.477024+0000","last_clean":"2024-09-10T22:15:35.477024+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:15:35.477024+0000","last_undegraded":"2024-09-10T22:15:35.477024+0000","last_fullsized":"2024-09-10T22:15:35.477024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481950+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:15:35.481950+0000","last_peered":"2024-09-10T22:15:35.481950+0000","last_clean":"2024-09-10T22:15:35.481950+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:15:35.481950+0000","last_undegraded":"2024-09-10T22:15:35.481950+0000","last_fullsized":"2024-09-10T22:15:35.481950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479319+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:15:35.479319+0000","last_peered":"2024-09-10T22:15:35.479319+0000","last_clean":"2024-09-10T22:15:35.479319+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:15:35.479319+0000","last_undegraded":"2024-09-10T22:15:35.479319+0000","last_fullsized":"2024-09-10T22:15:35.479319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480842+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:15:35.480842+0000","last_peered":"2024-09-10T22:15:35.480842+0000","last_clean":"2024-09-10T22:15:35.480842+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:15:35.480842+0000","last_undegraded":"2024-09-10T22:15:35.480842+0000","last_fullsized":"2024-09-10T22:15:35.480842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479988+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:15:35.479988+0000","last_peered":"2024-09-10T22:15:35.479988+0000","last_clean":"2024-09-10T22:15:35.479988+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:15:35.479988+0000","last_undegraded":"2024-09-10T22:15:35.479988+0000","last_fullsized":"2024-09-10T22:15:35.479988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:04.482821+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:16:04.482821+0000","last_peered":"2024-09-10T22:16:04.482821+0000","last_clean":"2024-09-10T22:16:04.482821+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:16:04.482821+0000","last_undegraded":"2024-09-10T22:16:04.482821+0000","last_fullsized":"2024-09-10T22:16:04.482821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478358+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:15:35.478358+0000","last_peered":"2024-09-10T22:15:35.478358+0000","last_clean":"2024-09-10T22:15:35.478358+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:15:35.478358+0000","last_undegraded":"2024-09-10T22:15:35.478358+0000","last_fullsized":"2024-09-10T22:15:35.478358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480566+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:35.480566+0000","last_peered":"2024-09-10T22:15:35.480566+0000","last_clean":"2024-09-10T22:15:35.480566+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:35.480566+0000","last_undegraded":"2024-09-10T22:15:35.480566+0000","last_fullsized":"2024-09-10T22:15:35.480566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476737+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:35.476737+0000","last_peered":"2024-09-10T22:15:35.476737+0000","last_clean":"2024-09-10T22:15:35.476737+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:35.476737+0000","last_undegraded":"2024-09-10T22:15:35.476737+0000","last_fullsized":"2024-09-10T22:15:35.476737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103107+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:15:36.103107+0000","last_peered":"2024-09-10T22:15:36.103107+0000","last_clean":"2024-09-10T22:15:36.103107+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:15:36.103107+0000","last_undegraded":"2024-09-10T22:15:36.103107+0000","last_fullsized":"2024-09-10T22:15:36.103107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478017+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:35.478017+0000","last_peered":"2024-09-10T22:15:35.478017+0000","last_clean":"2024-09-10T22:15:35.478017+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:35.478017+0000","last_undegraded":"2024-09-10T22:15:35.478017+0000","last_fullsized":"2024-09-10T22:15:35.478017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482809+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:15:35.482809+0000","last_peered":"2024-09-10T22:15:35.482809+0000","last_clean":"2024-09-10T22:15:35.482809+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:15:35.482809+0000","last_undegraded":"2024-09-10T22:15:35.482809+0000","last_fullsized":"2024-09-10T22:15:35.482809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:03.480736+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:16:03.480736+0000","last_peered":"2024-09-10T22:16:03.480736+0000","last_clean":"2024-09-10T22:16:03.480736+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:16:03.480736+0000","last_undegraded":"2024-09-10T22:16:03.480736+0000","last_fullsized":"2024-09-10T22:16:03.480736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480177+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:15:35.480177+0000","last_peered":"2024-09-10T22:15:35.480177+0000","last_clean":"2024-09-10T22:15:35.480177+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:15:35.480177+0000","last_undegraded":"2024-09-10T22:15:35.480177+0000","last_fullsized":"2024-09-10T22:15:35.480177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847900+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:36.847900+0000","last_peered":"2024-09-10T22:15:36.847900+0000","last_clean":"2024-09-10T22:15:36.847900+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:36.847900+0000","last_undegraded":"2024-09-10T22:15:36.847900+0000","last_fullsized":"2024-09-10T22:15:36.847900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482506+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:15:35.482506+0000","last_peered":"2024-09-10T22:15:35.482506+0000","last_clean":"2024-09-10T22:15:35.482506+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:15:35.482506+0000","last_undegraded":"2024-09-10T22:15:35.482506+0000","last_fullsized":"2024-09-10T22:15:35.482506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478635+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:35.478635+0000","last_peered":"2024-09-10T22:15:35.478635+0000","last_clean":"2024-09-10T22:15:35.478635+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:35.478635+0000","last_undegraded":"2024-09-10T22:15:35.478635+0000","last_fullsized":"2024-09-10T22:15:35.478635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483437+0000","last_change":"2024-09-10T22:15:35.483364+0000","last_active":"2024-09-10T22:15:35.483437+0000","last_peered":"2024-09-10T22:15:35.483437+0000","last_clean":"2024-09-10T22:15:35.483437+0000","last_became_active":"2024-09-10T22:15:35.482977+0000","last_became_peered":"2024-09-10T22:15:35.482977+0000","last_unstale":"2024-09-10T22:15:35.483437+0000","last_undegraded":"2024-09-10T22:15:35.483437+0000","last_fullsized":"2024-09-10T22:15:35.483437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:04.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":164,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:04.482222+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:16:04.482222+0000","last_peered":"2024-09-10T22:16:04.482222+0000","last_clean":"2024-09-10T22:16:04.482222+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:16:04.482222+0000","last_undegraded":"2024-09-10T22:16:04.482222+0000","last_fullsized":"2024-09-10T22:16:04.482222+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60617,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":114,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481825+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:15:35.481825+0000","last_peered":"2024-09-10T22:15:35.481825+0000","last_clean":"2024-09-10T22:15:35.481825+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:15:35.481825+0000","last_undegraded":"2024-09-10T22:15:35.481825+0000","last_fullsized":"2024-09-10T22:15:35.481825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479200+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:35.479200+0000","last_peered":"2024-09-10T22:15:35.479200+0000","last_clean":"2024-09-10T22:15:35.479200+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:35.479200+0000","last_undegraded":"2024-09-10T22:15:35.479200+0000","last_fullsized":"2024-09-10T22:15:35.479200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476841+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:15:35.476841+0000","last_peered":"2024-09-10T22:15:35.476841+0000","last_clean":"2024-09-10T22:15:35.476841+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:15:35.476841+0000","last_undegraded":"2024-09-10T22:15:35.476841+0000","last_fullsized":"2024-09-10T22:15:35.476841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847729+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:15:36.847729+0000","last_peered":"2024-09-10T22:15:36.847729+0000","last_clean":"2024-09-10T22:15:36.847729+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:15:36.847729+0000","last_undegraded":"2024-09-10T22:15:36.847729+0000","last_fullsized":"2024-09-10T22:15:36.847729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":81,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:04.482263+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:16:04.482263+0000","last_peered":"2024-09-10T22:16:04.482263+0000","last_clean":"2024-09-10T22:16:04.482263+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:16:04.482263+0000","last_undegraded":"2024-09-10T22:16:04.482263+0000","last_fullsized":"2024-09-10T22:16:04.482263+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847495+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:15:36.847495+0000","last_peered":"2024-09-10T22:15:36.847495+0000","last_clean":"2024-09-10T22:15:36.847495+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:15:36.847495+0000","last_undegraded":"2024-09-10T22:15:36.847495+0000","last_fullsized":"2024-09-10T22:15:36.847495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480414+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:35.480414+0000","last_peered":"2024-09-10T22:15:35.480414+0000","last_clean":"2024-09-10T22:15:35.480414+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:35.480414+0000","last_undegraded":"2024-09-10T22:15:35.480414+0000","last_fullsized":"2024-09-10T22:15:35.480414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478706+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:15:35.478706+0000","last_peered":"2024-09-10T22:15:35.478706+0000","last_clean":"2024-09-10T22:15:35.478706+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:15:35.478706+0000","last_undegraded":"2024-09-10T22:15:35.478706+0000","last_fullsized":"2024-09-10T22:15:35.478706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481875+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:35.481875+0000","last_peered":"2024-09-10T22:15:35.481875+0000","last_clean":"2024-09-10T22:15:35.481875+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:35.481875+0000","last_undegraded":"2024-09-10T22:15:35.481875+0000","last_fullsized":"2024-09-10T22:15:35.481875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480930+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:15:35.480930+0000","last_peered":"2024-09-10T22:15:35.480930+0000","last_clean":"2024-09-10T22:15:35.480930+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:15:35.480930+0000","last_undegraded":"2024-09-10T22:15:35.480930+0000","last_fullsized":"2024-09-10T22:15:35.480930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477187+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:35.477187+0000","last_peered":"2024-09-10T22:15:35.477187+0000","last_clean":"2024-09-10T22:15:35.477187+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:35.477187+0000","last_undegraded":"2024-09-10T22:15:35.477187+0000","last_fullsized":"2024-09-10T22:15:35.477187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847962+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:15:36.847962+0000","last_peered":"2024-09-10T22:15:36.847962+0000","last_clean":"2024-09-10T22:15:36.847962+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:15:36.847962+0000","last_undegraded":"2024-09-10T22:15:36.847962+0000","last_fullsized":"2024-09-10T22:15:36.847962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478753+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:35.478753+0000","last_peered":"2024-09-10T22:15:35.478753+0000","last_clean":"2024-09-10T22:15:35.478753+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:35.478753+0000","last_undegraded":"2024-09-10T22:15:35.478753+0000","last_fullsized":"2024-09-10T22:15:35.478753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847816+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:15:36.847816+0000","last_peered":"2024-09-10T22:15:36.847816+0000","last_clean":"2024-09-10T22:15:36.847816+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:15:36.847816+0000","last_undegraded":"2024-09-10T22:15:36.847816+0000","last_fullsized":"2024-09-10T22:15:36.847816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479310+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:35.479310+0000","last_peered":"2024-09-10T22:15:35.479310+0000","last_clean":"2024-09-10T22:15:35.479310+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:35.479310+0000","last_undegraded":"2024-09-10T22:15:35.479310+0000","last_fullsized":"2024-09-10T22:15:35.479310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847958+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:15:36.847958+0000","last_peered":"2024-09-10T22:15:36.847958+0000","last_clean":"2024-09-10T22:15:36.847958+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:15:36.847958+0000","last_undegraded":"2024-09-10T22:15:36.847958+0000","last_fullsized":"2024-09-10T22:15:36.847958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847694+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:36.847694+0000","last_peered":"2024-09-10T22:15:36.847694+0000","last_clean":"2024-09-10T22:15:36.847694+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:36.847694+0000","last_undegraded":"2024-09-10T22:15:36.847694+0000","last_fullsized":"2024-09-10T22:15:36.847694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477570+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:35.477570+0000","last_peered":"2024-09-10T22:15:35.477570+0000","last_clean":"2024-09-10T22:15:35.477570+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:35.477570+0000","last_undegraded":"2024-09-10T22:15:35.477570+0000","last_fullsized":"2024-09-10T22:15:35.477570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102713+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:15:36.102713+0000","last_peered":"2024-09-10T22:15:36.102713+0000","last_clean":"2024-09-10T22:15:36.102713+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:15:36.102713+0000","last_undegraded":"2024-09-10T22:15:36.102713+0000","last_fullsized":"2024-09-10T22:15:36.102713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847681+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:36.847681+0000","last_peered":"2024-09-10T22:15:36.847681+0000","last_clean":"2024-09-10T22:15:36.847681+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:36.847681+0000","last_undegraded":"2024-09-10T22:15:36.847681+0000","last_fullsized":"2024-09-10T22:15:36.847681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476723+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:15:35.476723+0000","last_peered":"2024-09-10T22:15:35.476723+0000","last_clean":"2024-09-10T22:15:35.476723+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:15:35.476723+0000","last_undegraded":"2024-09-10T22:15:35.476723+0000","last_fullsized":"2024-09-10T22:15:35.476723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":82,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:06.484397+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:16:06.484397+0000","last_peered":"2024-09-10T22:16:06.484397+0000","last_clean":"2024-09-10T22:16:06.484397+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:16:06.484397+0000","last_undegraded":"2024-09-10T22:16:06.484397+0000","last_fullsized":"2024-09-10T22:16:06.484397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477831+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:15:35.477831+0000","last_peered":"2024-09-10T22:15:35.477831+0000","last_clean":"2024-09-10T22:15:35.477831+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:15:35.477831+0000","last_undegraded":"2024-09-10T22:15:35.477831+0000","last_fullsized":"2024-09-10T22:15:35.477831+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847841+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:36.847841+0000","last_peered":"2024-09-10T22:15:36.847841+0000","last_clean":"2024-09-10T22:15:36.847841+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:36.847841+0000","last_undegraded":"2024-09-10T22:15:36.847841+0000","last_fullsized":"2024-09-10T22:15:36.847841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.484850+0000","last_change":"2024-09-10T22:15:35.484767+0000","last_active":"2024-09-10T22:15:35.484850+0000","last_peered":"2024-09-10T22:15:35.484850+0000","last_clean":"2024-09-10T22:15:35.484850+0000","last_became_active":"2024-09-10T22:15:35.484427+0000","last_became_peered":"2024-09-10T22:15:35.484427+0000","last_unstale":"2024-09-10T22:15:35.484850+0000","last_undegraded":"2024-09-10T22:15:35.484850+0000","last_fullsized":"2024-09-10T22:15:35.484850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:35.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483370+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:35.483370+0000","last_peered":"2024-09-10T22:15:35.483370+0000","last_clean":"2024-09-10T22:15:35.483370+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:35.483370+0000","last_undegraded":"2024-09-10T22:15:35.483370+0000","last_fullsized":"2024-09-10T22:15:35.483370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480669+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:15:35.480669+0000","last_peered":"2024-09-10T22:15:35.480669+0000","last_clean":"2024-09-10T22:15:35.480669+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:15:35.480669+0000","last_undegraded":"2024-09-10T22:15:35.480669+0000","last_fullsized":"2024-09-10T22:15:35.480669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.489459+0000","last_change":"2024-09-10T22:15:35.488995+0000","last_active":"2024-09-10T22:15:35.489459+0000","last_peered":"2024-09-10T22:15:35.489459+0000","last_clean":"2024-09-10T22:15:35.489459+0000","last_became_active":"2024-09-10T22:15:35.484278+0000","last_became_peered":"2024-09-10T22:15:35.484278+0000","last_unstale":"2024-09-10T22:15:35.489459+0000","last_undegraded":"2024-09-10T22:15:35.489459+0000","last_fullsized":"2024-09-10T22:15:35.489459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:00.474920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477156+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:15:35.477156+0000","last_peered":"2024-09-10T22:15:35.477156+0000","last_clean":"2024-09-10T22:15:35.477156+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:15:35.477156+0000","last_undegraded":"2024-09-10T22:15:35.477156+0000","last_fullsized":"2024-09-10T22:15:35.477156+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'12","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483287+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:15:35.483287+0000","last_peered":"2024-09-10T22:15:35.483287+0000","last_clean":"2024-09-10T22:15:35.483287+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:15:35.483287+0000","last_undegraded":"2024-09-10T22:15:35.483287+0000","last_fullsized":"2024-09-10T22:15:35.483287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103406+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:15:36.103406+0000","last_peered":"2024-09-10T22:15:36.103406+0000","last_clean":"2024-09-10T22:15:36.103406+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:15:36.103406+0000","last_undegraded":"2024-09-10T22:15:36.103406+0000","last_fullsized":"2024-09-10T22:15:36.103406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477897+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:35.477897+0000","last_peered":"2024-09-10T22:15:35.477897+0000","last_clean":"2024-09-10T22:15:35.477897+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:35.477897+0000","last_undegraded":"2024-09-10T22:15:35.477897+0000","last_fullsized":"2024-09-10T22:15:35.477897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482257+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:15:35.482257+0000","last_peered":"2024-09-10T22:15:35.482257+0000","last_clean":"2024-09-10T22:15:35.482257+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:15:35.482257+0000","last_undegraded":"2024-09-10T22:15:35.482257+0000","last_fullsized":"2024-09-10T22:15:35.482257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.486805+0000","last_change":"2024-09-10T22:15:35.486730+0000","last_active":"2024-09-10T22:15:35.486805+0000","last_peered":"2024-09-10T22:15:35.486805+0000","last_clean":"2024-09-10T22:15:35.486805+0000","last_became_active":"2024-09-10T22:15:35.483148+0000","last_became_peered":"2024-09-10T22:15:35.483148+0000","last_unstale":"2024-09-10T22:15:35.486805+0000","last_undegraded":"2024-09-10T22:15:35.486805+0000","last_fullsized":"2024-09-10T22:15:35.486805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:10.166666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480421+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:15:35.480421+0000","last_peered":"2024-09-10T22:15:35.480421+0000","last_clean":"2024-09-10T22:15:35.480421+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:15:35.480421+0000","last_undegraded":"2024-09-10T22:15:35.480421+0000","last_fullsized":"2024-09-10T22:15:35.480421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102639+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:36.102639+0000","last_peered":"2024-09-10T22:15:36.102639+0000","last_clean":"2024-09-10T22:15:36.102639+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:36.102639+0000","last_undegraded":"2024-09-10T22:15:36.102639+0000","last_fullsized":"2024-09-10T22:15:36.102639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480940+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:15:35.480940+0000","last_peered":"2024-09-10T22:15:35.480940+0000","last_clean":"2024-09-10T22:15:35.480940+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:15:35.480940+0000","last_undegraded":"2024-09-10T22:15:35.480940+0000","last_fullsized":"2024-09-10T22:15:35.480940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479161+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:35.479161+0000","last_peered":"2024-09-10T22:15:35.479161+0000","last_clean":"2024-09-10T22:15:35.479161+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:35.479161+0000","last_undegraded":"2024-09-10T22:15:35.479161+0000","last_fullsized":"2024-09-10T22:15:35.479161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103147+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:15:36.103147+0000","last_peered":"2024-09-10T22:15:36.103147+0000","last_clean":"2024-09-10T22:15:36.103147+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:15:36.103147+0000","last_undegraded":"2024-09-10T22:15:36.103147+0000","last_fullsized":"2024-09-10T22:15:36.103147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481286+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:35.481286+0000","last_peered":"2024-09-10T22:15:35.481286+0000","last_clean":"2024-09-10T22:15:35.481286+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:35.481286+0000","last_undegraded":"2024-09-10T22:15:35.481286+0000","last_fullsized":"2024-09-10T22:15:35.481286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847688+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:15:36.847688+0000","last_peered":"2024-09-10T22:15:36.847688+0000","last_clean":"2024-09-10T22:15:36.847688+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:15:36.847688+0000","last_undegraded":"2024-09-10T22:15:36.847688+0000","last_fullsized":"2024-09-10T22:15:36.847688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478207+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:15:35.478207+0000","last_peered":"2024-09-10T22:15:35.478207+0000","last_clean":"2024-09-10T22:15:35.478207+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:15:35.478207+0000","last_undegraded":"2024-09-10T22:15:35.478207+0000","last_fullsized":"2024-09-10T22:15:35.478207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482561+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:35.482561+0000","last_peered":"2024-09-10T22:15:35.482561+0000","last_clean":"2024-09-10T22:15:35.482561+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:35.482561+0000","last_undegraded":"2024-09-10T22:15:35.482561+0000","last_fullsized":"2024-09-10T22:15:35.482561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479827+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:15:35.479827+0000","last_peered":"2024-09-10T22:15:35.479827+0000","last_clean":"2024-09-10T22:15:35.479827+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:15:35.479827+0000","last_undegraded":"2024-09-10T22:15:35.479827+0000","last_fullsized":"2024-09-10T22:15:35.479827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481854+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:35.481854+0000","last_peered":"2024-09-10T22:15:35.481854+0000","last_clean":"2024-09-10T22:15:35.481854+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:35.481854+0000","last_undegraded":"2024-09-10T22:15:35.481854+0000","last_fullsized":"2024-09-10T22:15:35.481854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482468+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:15:35.482468+0000","last_peered":"2024-09-10T22:15:35.482468+0000","last_clean":"2024-09-10T22:15:35.482468+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:15:35.482468+0000","last_undegraded":"2024-09-10T22:15:35.482468+0000","last_fullsized":"2024-09-10T22:15:35.482468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103492+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:36.103492+0000","last_peered":"2024-09-10T22:15:36.103492+0000","last_clean":"2024-09-10T22:15:36.103492+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:36.103492+0000","last_undegraded":"2024-09-10T22:15:36.103492+0000","last_fullsized":"2024-09-10T22:15:36.103492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103349+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:15:36.103349+0000","last_peered":"2024-09-10T22:15:36.103349+0000","last_clean":"2024-09-10T22:15:36.103349+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:15:36.103349+0000","last_undegraded":"2024-09-10T22:15:36.103349+0000","last_fullsized":"2024-09-10T22:15:36.103349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483426+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:35.483426+0000","last_peered":"2024-09-10T22:15:35.483426+0000","last_clean":"2024-09-10T22:15:35.483426+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:35.483426+0000","last_undegraded":"2024-09-10T22:15:35.483426+0000","last_fullsized":"2024-09-10T22:15:35.483426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64618,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":344,"num_read_kb":239,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":193854,"data_compressed":5442,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710747,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":843776,"data_stored":408651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":1060727,"data_compressed":37762,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":408865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":408763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":1000715,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":408254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1000399,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":408691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182468,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":408565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":470405,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":468664,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":409525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":60617,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62358,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62195,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:16:10.975 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-10T22:16:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:10 smithi189 ceph-mon[35784]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:10 smithi189 ceph-mon[35784]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:10 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:10 smithi052 ceph-mon[34997]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:10 smithi052 ceph-mon[34997]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:10 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:11.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:10 smithi005 ceph-mon[31115]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:11.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:10 smithi005 ceph-mon[31115]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:11.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:10 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 -- 172.21.15.5:0/3359715360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 msgr2=0x7f1b8c10e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 --2- 172.21.15.5:0/3359715360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10e860 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009ca0 tx=0x7f1b8402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 -- 172.21.15.5:0/3359715360 shutdown_connections 2024-09-10T22:16:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 --2- 172.21.15.5:0/3359715360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10e860 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.747 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 --2- 172.21.15.5:0/3359715360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 0x7f1b8c107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 --2- 172.21.15.5:0/3359715360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 -- 172.21.15.5:0/3359715360 >> 172.21.15.5:0/3359715360 conn(0x7f1b8c0fd700 msgr2=0x7f1b8c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 -- 172.21.15.5:0/3359715360 shutdown_connections 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.742+0000 7f1b92f50640 1 -- 172.21.15.5:0/3359715360 wait complete. 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 Processor -- start 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 -- start start 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 0x7f1b8c10f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:11.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112e40 con 0x7f1b8c108060 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112cc0 con 0x7f1b8c1076e0 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b92f50640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8c112fc0 con 0x7f1b8c101cd0 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b914ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b914ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54672/0 (socket says 172.21.15.5:54672) 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b914ed640 1 -- 172.21.15.5:0/1690423536 learned_addr learned my addr 172.21.15.5:0/1690423536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b90cec640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.743+0000 7f1b8bfff640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 0x7f1b8c10f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:11.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b914ed640 1 -- 172.21.15.5:0/1690423536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c101cd0 msgr2=0x7f1b8c10f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b914ed640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c10f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b914ed640 1 -- 172.21.15.5:0/1690423536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 msgr2=0x7f1b8c10f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b914ed640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 0x7f1b8c10f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b914ed640 1 -- 172.21.15.5:0/1690423536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8c1a7730 con 0x7f1b8c108060 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b8bfff640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 0x7f1b8c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b914ed640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10fdf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b84005cc0 tx=0x7f1b8402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b84003cf0 con 0x7f1b8c108060 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b8c1a79c0 con 0x7f1b8c108060 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b840044f0 con 0x7f1b8c108060 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b8402fc30 con 0x7f1b8c108060 2024-09-10T22:16:11.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.744+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b8c1a7f50 con 0x7f1b8c108060 2024-09-10T22:16:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.745+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b8c1020b0 con 0x7f1b8c108060 2024-09-10T22:16:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.747+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f1b84004040 con 0x7f1b8c108060 2024-09-10T22:16:11.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.747+0000 7f1b89ffb640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1b780b5370 0x7f1b780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.748+0000 7f1b90cec640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1b780b5370 0x7f1b780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.748+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f1b841071d0 con 0x7f1b8c108060 2024-09-10T22:16:11.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.748+0000 7f1b90cec640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1b780b5370 0x7f1b780b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009990 tx=0x7f1b74009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:11.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.752+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1b840cdf60 con 0x7f1b8c108060 2024-09-10T22:16:11.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.936+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b8c063590 con 0x7f1b780b5370 2024-09-10T22:16:11.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:11 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:16:11.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:11 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:16:11.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:11 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:11.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.941+0000 7f1b89ffb640 1 -- 172.21.15.5:0/1690423536 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258916 (secure 0 0 0) 0x7f1b8c063590 con 0x7f1b780b5370 2024-09-10T22:16:11.945 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:11.946 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:16:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1b780b5370 msgr2=0x7f1b780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1b780b5370 0x7f1b780b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009990 tx=0x7f1b74009110 comp rx=0 tx=0).stop 2024-09-10T22:16:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 msgr2=0x7f1b8c10fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10fdf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b84005cc0 tx=0x7f1b8402f470 comp rx=0 tx=0).stop 2024-09-10T22:16:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 shutdown_connections 2024-09-10T22:16:11.948 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1b780b5370 0x7f1b780b7830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1b8c108060 0x7f1b8c10fdf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1b8c1076e0 0x7f1b8c10f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 --2- 172.21.15.5:0/1690423536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1b8c101cd0 0x7f1b8c10f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 >> 172.21.15.5:0/1690423536 conn(0x7f1b8c0fd700 msgr2=0x7f1b8c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 shutdown_connections 2024-09-10T22:16:11.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:11.944+0000 7f1b92f50640 1 -- 172.21.15.5:0/1690423536 wait complete. 2024-09-10T22:16:12.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:11 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:16:12.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:11 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:16:12.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:11 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:12.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:11 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:16:12.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:11 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:16:12.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:11 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:16:12.691 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2024-09-10T22:16:11.725914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655220,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":445,"num_read_kb":313,"num_write":289,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363844,"kb_used_data":10356,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124577980,"statfs":{"total":1151940427776,"available":1151567851520,"internally_reserved":0,"allocated":10604544,"data_stored":6862224,"data_compressed":113286,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003253"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481192+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:15:35.481192+0000","last_peered":"2024-09-10T22:15:35.481192+0000","last_clean":"2024-09-10T22:15:35.481192+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:15:35.481192+0000","last_undegraded":"2024-09-10T22:15:35.481192+0000","last_fullsized":"2024-09-10T22:15:35.481192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482226+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:15:35.482226+0000","last_peered":"2024-09-10T22:15:35.482226+0000","last_clean":"2024-09-10T22:15:35.482226+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:15:35.482226+0000","last_undegraded":"2024-09-10T22:15:35.482226+0000","last_fullsized":"2024-09-10T22:15:35.482226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481959+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:15:35.481959+0000","last_peered":"2024-09-10T22:15:35.481959+0000","last_clean":"2024-09-10T22:15:35.481959+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:15:35.481959+0000","last_undegraded":"2024-09-10T22:15:35.481959+0000","last_fullsized":"2024-09-10T22:15:35.481959+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477802+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:15:35.477802+0000","last_peered":"2024-09-10T22:15:35.477802+0000","last_clean":"2024-09-10T22:15:35.477802+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:15:35.477802+0000","last_undegraded":"2024-09-10T22:15:35.477802+0000","last_fullsized":"2024-09-10T22:15:35.477802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481208+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:15:35.481208+0000","last_peered":"2024-09-10T22:15:35.481208+0000","last_clean":"2024-09-10T22:15:35.481208+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:15:35.481208+0000","last_undegraded":"2024-09-10T22:15:35.481208+0000","last_fullsized":"2024-09-10T22:15:35.481208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480433+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:15:35.480433+0000","last_peered":"2024-09-10T22:15:35.480433+0000","last_clean":"2024-09-10T22:15:35.480433+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:15:35.480433+0000","last_undegraded":"2024-09-10T22:15:35.480433+0000","last_fullsized":"2024-09-10T22:15:35.480433+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847562+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:15:36.847562+0000","last_peered":"2024-09-10T22:15:36.847562+0000","last_clean":"2024-09-10T22:15:36.847562+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:15:36.847562+0000","last_undegraded":"2024-09-10T22:15:36.847562+0000","last_fullsized":"2024-09-10T22:15:36.847562+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102745+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:15:36.102745+0000","last_peered":"2024-09-10T22:15:36.102745+0000","last_clean":"2024-09-10T22:15:36.102745+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:15:36.102745+0000","last_undegraded":"2024-09-10T22:15:36.102745+0000","last_fullsized":"2024-09-10T22:15:36.102745+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480400+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:15:35.480400+0000","last_peered":"2024-09-10T22:15:35.480400+0000","last_clean":"2024-09-10T22:15:35.480400+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:15:35.480400+0000","last_undegraded":"2024-09-10T22:15:35.480400+0000","last_fullsized":"2024-09-10T22:15:35.480400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481054+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:15:35.481054+0000","last_peered":"2024-09-10T22:15:35.481054+0000","last_clean":"2024-09-10T22:15:35.481054+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:15:35.481054+0000","last_undegraded":"2024-09-10T22:15:35.481054+0000","last_fullsized":"2024-09-10T22:15:35.481054+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847827+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:15:36.847827+0000","last_peered":"2024-09-10T22:15:36.847827+0000","last_clean":"2024-09-10T22:15:36.847827+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:15:36.847827+0000","last_undegraded":"2024-09-10T22:15:36.847827+0000","last_fullsized":"2024-09-10T22:15:36.847827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477965+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:15:35.477965+0000","last_peered":"2024-09-10T22:15:35.477965+0000","last_clean":"2024-09-10T22:15:35.477965+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:15:35.477965+0000","last_undegraded":"2024-09-10T22:15:35.477965+0000","last_fullsized":"2024-09-10T22:15:35.477965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477005+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:15:35.477005+0000","last_peered":"2024-09-10T22:15:35.477005+0000","last_clean":"2024-09-10T22:15:35.477005+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:15:35.477005+0000","last_undegraded":"2024-09-10T22:15:35.477005+0000","last_fullsized":"2024-09-10T22:15:35.477005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481830+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:15:35.481830+0000","last_peered":"2024-09-10T22:15:35.481830+0000","last_clean":"2024-09-10T22:15:35.481830+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:15:35.481830+0000","last_undegraded":"2024-09-10T22:15:35.481830+0000","last_fullsized":"2024-09-10T22:15:35.481830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481718+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:15:35.481718+0000","last_peered":"2024-09-10T22:15:35.481718+0000","last_clean":"2024-09-10T22:15:35.481718+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:15:35.481718+0000","last_undegraded":"2024-09-10T22:15:35.481718+0000","last_fullsized":"2024-09-10T22:15:35.481718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479342+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:15:35.479342+0000","last_peered":"2024-09-10T22:15:35.479342+0000","last_clean":"2024-09-10T22:15:35.479342+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:15:35.479342+0000","last_undegraded":"2024-09-10T22:15:35.479342+0000","last_fullsized":"2024-09-10T22:15:35.479342+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481261+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:15:35.481261+0000","last_peered":"2024-09-10T22:15:35.481261+0000","last_clean":"2024-09-10T22:15:35.481261+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:15:35.481261+0000","last_undegraded":"2024-09-10T22:15:35.481261+0000","last_fullsized":"2024-09-10T22:15:35.481261+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483173+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:15:35.483173+0000","last_peered":"2024-09-10T22:15:35.483173+0000","last_clean":"2024-09-10T22:15:35.483173+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:15:35.483173+0000","last_undegraded":"2024-09-10T22:15:35.483173+0000","last_fullsized":"2024-09-10T22:15:35.483173+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.484987+0000","last_change":"2024-09-10T22:15:35.484878+0000","last_active":"2024-09-10T22:15:35.484987+0000","last_peered":"2024-09-10T22:15:35.484987+0000","last_clean":"2024-09-10T22:15:35.484987+0000","last_became_active":"2024-09-10T22:15:35.484434+0000","last_became_peered":"2024-09-10T22:15:35.484434+0000","last_unstale":"2024-09-10T22:15:35.484987+0000","last_undegraded":"2024-09-10T22:15:35.484987+0000","last_fullsized":"2024-09-10T22:15:35.484987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:12.935958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.484805+0000","last_change":"2024-09-10T22:15:35.484696+0000","last_active":"2024-09-10T22:15:35.484805+0000","last_peered":"2024-09-10T22:15:35.484805+0000","last_clean":"2024-09-10T22:15:35.484805+0000","last_became_active":"2024-09-10T22:15:35.484342+0000","last_became_peered":"2024-09-10T22:15:35.484342+0000","last_unstale":"2024-09-10T22:15:35.484805+0000","last_undegraded":"2024-09-10T22:15:35.484805+0000","last_fullsized":"2024-09-10T22:15:35.484805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:44.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477043+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:15:35.477043+0000","last_peered":"2024-09-10T22:15:35.477043+0000","last_clean":"2024-09-10T22:15:35.477043+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:15:35.477043+0000","last_undegraded":"2024-09-10T22:15:35.477043+0000","last_fullsized":"2024-09-10T22:15:35.477043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479480+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:15:35.479480+0000","last_peered":"2024-09-10T22:15:35.479480+0000","last_clean":"2024-09-10T22:15:35.479480+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:15:35.479480+0000","last_undegraded":"2024-09-10T22:15:35.479480+0000","last_fullsized":"2024-09-10T22:15:35.479480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102522+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:15:36.102522+0000","last_peered":"2024-09-10T22:15:36.102522+0000","last_clean":"2024-09-10T22:15:36.102522+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:15:36.102522+0000","last_undegraded":"2024-09-10T22:15:36.102522+0000","last_fullsized":"2024-09-10T22:15:36.102522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.104717+0000","last_change":"2024-09-10T22:15:36.104261+0000","last_active":"2024-09-10T22:15:36.104717+0000","last_peered":"2024-09-10T22:15:36.104717+0000","last_clean":"2024-09-10T22:15:36.104717+0000","last_became_active":"2024-09-10T22:15:36.103864+0000","last_became_peered":"2024-09-10T22:15:36.103864+0000","last_unstale":"2024-09-10T22:15:36.104717+0000","last_undegraded":"2024-09-10T22:15:36.104717+0000","last_fullsized":"2024-09-10T22:15:36.104717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:24.892850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103347+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:15:36.103347+0000","last_peered":"2024-09-10T22:15:36.103347+0000","last_clean":"2024-09-10T22:15:36.103347+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:15:36.103347+0000","last_undegraded":"2024-09-10T22:15:36.103347+0000","last_fullsized":"2024-09-10T22:15:36.103347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480753+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:15:35.480753+0000","last_peered":"2024-09-10T22:15:35.480753+0000","last_clean":"2024-09-10T22:15:35.480753+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:15:35.480753+0000","last_undegraded":"2024-09-10T22:15:35.480753+0000","last_fullsized":"2024-09-10T22:15:35.480753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480765+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:15:35.480765+0000","last_peered":"2024-09-10T22:15:35.480765+0000","last_clean":"2024-09-10T22:15:35.480765+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:15:35.480765+0000","last_undegraded":"2024-09-10T22:15:35.480765+0000","last_fullsized":"2024-09-10T22:15:35.480765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477024+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:15:35.477024+0000","last_peered":"2024-09-10T22:15:35.477024+0000","last_clean":"2024-09-10T22:15:35.477024+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:15:35.477024+0000","last_undegraded":"2024-09-10T22:15:35.477024+0000","last_fullsized":"2024-09-10T22:15:35.477024+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481950+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:15:35.481950+0000","last_peered":"2024-09-10T22:15:35.481950+0000","last_clean":"2024-09-10T22:15:35.481950+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:15:35.481950+0000","last_undegraded":"2024-09-10T22:15:35.481950+0000","last_fullsized":"2024-09-10T22:15:35.481950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479319+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:15:35.479319+0000","last_peered":"2024-09-10T22:15:35.479319+0000","last_clean":"2024-09-10T22:15:35.479319+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:15:35.479319+0000","last_undegraded":"2024-09-10T22:15:35.479319+0000","last_fullsized":"2024-09-10T22:15:35.479319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480842+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:15:35.480842+0000","last_peered":"2024-09-10T22:15:35.480842+0000","last_clean":"2024-09-10T22:15:35.480842+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:15:35.480842+0000","last_undegraded":"2024-09-10T22:15:35.480842+0000","last_fullsized":"2024-09-10T22:15:35.480842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479988+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:15:35.479988+0000","last_peered":"2024-09-10T22:15:35.479988+0000","last_clean":"2024-09-10T22:15:35.479988+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:15:35.479988+0000","last_undegraded":"2024-09-10T22:15:35.479988+0000","last_fullsized":"2024-09-10T22:15:35.479988+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":90,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:09.490054+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:16:09.490054+0000","last_peered":"2024-09-10T22:16:09.490054+0000","last_clean":"2024-09-10T22:16:09.490054+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:16:09.490054+0000","last_undegraded":"2024-09-10T22:16:09.490054+0000","last_fullsized":"2024-09-10T22:16:09.490054+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478358+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:15:35.478358+0000","last_peered":"2024-09-10T22:15:35.478358+0000","last_clean":"2024-09-10T22:15:35.478358+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:15:35.478358+0000","last_undegraded":"2024-09-10T22:15:35.478358+0000","last_fullsized":"2024-09-10T22:15:35.478358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480566+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:35.480566+0000","last_peered":"2024-09-10T22:15:35.480566+0000","last_clean":"2024-09-10T22:15:35.480566+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:35.480566+0000","last_undegraded":"2024-09-10T22:15:35.480566+0000","last_fullsized":"2024-09-10T22:15:35.480566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476737+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:35.476737+0000","last_peered":"2024-09-10T22:15:35.476737+0000","last_clean":"2024-09-10T22:15:35.476737+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:35.476737+0000","last_undegraded":"2024-09-10T22:15:35.476737+0000","last_fullsized":"2024-09-10T22:15:35.476737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103107+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:15:36.103107+0000","last_peered":"2024-09-10T22:15:36.103107+0000","last_clean":"2024-09-10T22:15:36.103107+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:15:36.103107+0000","last_undegraded":"2024-09-10T22:15:36.103107+0000","last_fullsized":"2024-09-10T22:15:36.103107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478017+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:35.478017+0000","last_peered":"2024-09-10T22:15:35.478017+0000","last_clean":"2024-09-10T22:15:35.478017+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:35.478017+0000","last_undegraded":"2024-09-10T22:15:35.478017+0000","last_fullsized":"2024-09-10T22:15:35.478017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482809+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:15:35.482809+0000","last_peered":"2024-09-10T22:15:35.482809+0000","last_clean":"2024-09-10T22:15:35.482809+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:15:35.482809+0000","last_undegraded":"2024-09-10T22:15:35.482809+0000","last_fullsized":"2024-09-10T22:15:35.482809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'3","reported_seq":83,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:08.487798+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:16:08.487798+0000","last_peered":"2024-09-10T22:16:08.487798+0000","last_clean":"2024-09-10T22:16:08.487798+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:16:08.487798+0000","last_undegraded":"2024-09-10T22:16:08.487798+0000","last_fullsized":"2024-09-10T22:16:08.487798+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480177+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:15:35.480177+0000","last_peered":"2024-09-10T22:15:35.480177+0000","last_clean":"2024-09-10T22:15:35.480177+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:15:35.480177+0000","last_undegraded":"2024-09-10T22:15:35.480177+0000","last_fullsized":"2024-09-10T22:15:35.480177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847900+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:36.847900+0000","last_peered":"2024-09-10T22:15:36.847900+0000","last_clean":"2024-09-10T22:15:36.847900+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:36.847900+0000","last_undegraded":"2024-09-10T22:15:36.847900+0000","last_fullsized":"2024-09-10T22:15:36.847900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482506+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:15:35.482506+0000","last_peered":"2024-09-10T22:15:35.482506+0000","last_clean":"2024-09-10T22:15:35.482506+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:15:35.482506+0000","last_undegraded":"2024-09-10T22:15:35.482506+0000","last_fullsized":"2024-09-10T22:15:35.482506+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478635+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:35.478635+0000","last_peered":"2024-09-10T22:15:35.478635+0000","last_clean":"2024-09-10T22:15:35.478635+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:35.478635+0000","last_undegraded":"2024-09-10T22:15:35.478635+0000","last_fullsized":"2024-09-10T22:15:35.478635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483437+0000","last_change":"2024-09-10T22:15:35.483364+0000","last_active":"2024-09-10T22:15:35.483437+0000","last_peered":"2024-09-10T22:15:35.483437+0000","last_clean":"2024-09-10T22:15:35.483437+0000","last_became_active":"2024-09-10T22:15:35.482977+0000","last_became_peered":"2024-09-10T22:15:35.482977+0000","last_unstale":"2024-09-10T22:15:35.483437+0000","last_undegraded":"2024-09-10T22:15:35.483437+0000","last_fullsized":"2024-09-10T22:15:35.483437+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:04.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'28","reported_seq":174,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:09.489377+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:16:09.489377+0000","last_peered":"2024-09-10T22:16:09.489377+0000","last_clean":"2024-09-10T22:16:09.489377+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:16:09.489377+0000","last_undegraded":"2024-09-10T22:16:09.489377+0000","last_fullsized":"2024-09-10T22:16:09.489377+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60617,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":119,"num_write":29,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481825+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:15:35.481825+0000","last_peered":"2024-09-10T22:15:35.481825+0000","last_clean":"2024-09-10T22:15:35.481825+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:15:35.481825+0000","last_undegraded":"2024-09-10T22:15:35.481825+0000","last_fullsized":"2024-09-10T22:15:35.481825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479200+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:35.479200+0000","last_peered":"2024-09-10T22:15:35.479200+0000","last_clean":"2024-09-10T22:15:35.479200+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:35.479200+0000","last_undegraded":"2024-09-10T22:15:35.479200+0000","last_fullsized":"2024-09-10T22:15:35.479200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476841+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:15:35.476841+0000","last_peered":"2024-09-10T22:15:35.476841+0000","last_clean":"2024-09-10T22:15:35.476841+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:15:35.476841+0000","last_undegraded":"2024-09-10T22:15:35.476841+0000","last_fullsized":"2024-09-10T22:15:35.476841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847729+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:15:36.847729+0000","last_peered":"2024-09-10T22:15:36.847729+0000","last_clean":"2024-09-10T22:15:36.847729+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:15:36.847729+0000","last_undegraded":"2024-09-10T22:15:36.847729+0000","last_fullsized":"2024-09-10T22:15:36.847729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":86,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:09.489196+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:16:09.489196+0000","last_peered":"2024-09-10T22:16:09.489196+0000","last_clean":"2024-09-10T22:16:09.489196+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:16:09.489196+0000","last_undegraded":"2024-09-10T22:16:09.489196+0000","last_fullsized":"2024-09-10T22:16:09.489196+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847495+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:15:36.847495+0000","last_peered":"2024-09-10T22:15:36.847495+0000","last_clean":"2024-09-10T22:15:36.847495+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:15:36.847495+0000","last_undegraded":"2024-09-10T22:15:36.847495+0000","last_fullsized":"2024-09-10T22:15:36.847495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480414+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:35.480414+0000","last_peered":"2024-09-10T22:15:35.480414+0000","last_clean":"2024-09-10T22:15:35.480414+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:35.480414+0000","last_undegraded":"2024-09-10T22:15:35.480414+0000","last_fullsized":"2024-09-10T22:15:35.480414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478706+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:15:35.478706+0000","last_peered":"2024-09-10T22:15:35.478706+0000","last_clean":"2024-09-10T22:15:35.478706+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:15:35.478706+0000","last_undegraded":"2024-09-10T22:15:35.478706+0000","last_fullsized":"2024-09-10T22:15:35.478706+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481875+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:35.481875+0000","last_peered":"2024-09-10T22:15:35.481875+0000","last_clean":"2024-09-10T22:15:35.481875+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:35.481875+0000","last_undegraded":"2024-09-10T22:15:35.481875+0000","last_fullsized":"2024-09-10T22:15:35.481875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480930+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:15:35.480930+0000","last_peered":"2024-09-10T22:15:35.480930+0000","last_clean":"2024-09-10T22:15:35.480930+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:15:35.480930+0000","last_undegraded":"2024-09-10T22:15:35.480930+0000","last_fullsized":"2024-09-10T22:15:35.480930+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477187+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:35.477187+0000","last_peered":"2024-09-10T22:15:35.477187+0000","last_clean":"2024-09-10T22:15:35.477187+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:35.477187+0000","last_undegraded":"2024-09-10T22:15:35.477187+0000","last_fullsized":"2024-09-10T22:15:35.477187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847962+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:15:36.847962+0000","last_peered":"2024-09-10T22:15:36.847962+0000","last_clean":"2024-09-10T22:15:36.847962+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:15:36.847962+0000","last_undegraded":"2024-09-10T22:15:36.847962+0000","last_fullsized":"2024-09-10T22:15:36.847962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478753+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:35.478753+0000","last_peered":"2024-09-10T22:15:35.478753+0000","last_clean":"2024-09-10T22:15:35.478753+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:35.478753+0000","last_undegraded":"2024-09-10T22:15:35.478753+0000","last_fullsized":"2024-09-10T22:15:35.478753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847816+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:15:36.847816+0000","last_peered":"2024-09-10T22:15:36.847816+0000","last_clean":"2024-09-10T22:15:36.847816+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:15:36.847816+0000","last_undegraded":"2024-09-10T22:15:36.847816+0000","last_fullsized":"2024-09-10T22:15:36.847816+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479310+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:35.479310+0000","last_peered":"2024-09-10T22:15:35.479310+0000","last_clean":"2024-09-10T22:15:35.479310+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:35.479310+0000","last_undegraded":"2024-09-10T22:15:35.479310+0000","last_fullsized":"2024-09-10T22:15:35.479310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847958+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:15:36.847958+0000","last_peered":"2024-09-10T22:15:36.847958+0000","last_clean":"2024-09-10T22:15:36.847958+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:15:36.847958+0000","last_undegraded":"2024-09-10T22:15:36.847958+0000","last_fullsized":"2024-09-10T22:15:36.847958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847694+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:36.847694+0000","last_peered":"2024-09-10T22:15:36.847694+0000","last_clean":"2024-09-10T22:15:36.847694+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:36.847694+0000","last_undegraded":"2024-09-10T22:15:36.847694+0000","last_fullsized":"2024-09-10T22:15:36.847694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477570+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:35.477570+0000","last_peered":"2024-09-10T22:15:35.477570+0000","last_clean":"2024-09-10T22:15:35.477570+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:35.477570+0000","last_undegraded":"2024-09-10T22:15:35.477570+0000","last_fullsized":"2024-09-10T22:15:35.477570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102713+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:15:36.102713+0000","last_peered":"2024-09-10T22:15:36.102713+0000","last_clean":"2024-09-10T22:15:36.102713+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:15:36.102713+0000","last_undegraded":"2024-09-10T22:15:36.102713+0000","last_fullsized":"2024-09-10T22:15:36.102713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847681+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:36.847681+0000","last_peered":"2024-09-10T22:15:36.847681+0000","last_clean":"2024-09-10T22:15:36.847681+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:36.847681+0000","last_undegraded":"2024-09-10T22:15:36.847681+0000","last_fullsized":"2024-09-10T22:15:36.847681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476723+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:15:35.476723+0000","last_peered":"2024-09-10T22:15:35.476723+0000","last_clean":"2024-09-10T22:15:35.476723+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:15:35.476723+0000","last_undegraded":"2024-09-10T22:15:35.476723+0000","last_fullsized":"2024-09-10T22:15:35.476723+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":82,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:06.484397+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:16:06.484397+0000","last_peered":"2024-09-10T22:16:06.484397+0000","last_clean":"2024-09-10T22:16:06.484397+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:16:06.484397+0000","last_undegraded":"2024-09-10T22:16:06.484397+0000","last_fullsized":"2024-09-10T22:16:06.484397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477831+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:15:35.477831+0000","last_peered":"2024-09-10T22:15:35.477831+0000","last_clean":"2024-09-10T22:15:35.477831+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:15:35.477831+0000","last_undegraded":"2024-09-10T22:15:35.477831+0000","last_fullsized":"2024-09-10T22:15:35.477831+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847841+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:36.847841+0000","last_peered":"2024-09-10T22:15:36.847841+0000","last_clean":"2024-09-10T22:15:36.847841+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:36.847841+0000","last_undegraded":"2024-09-10T22:15:36.847841+0000","last_fullsized":"2024-09-10T22:15:36.847841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.484850+0000","last_change":"2024-09-10T22:15:35.484767+0000","last_active":"2024-09-10T22:15:35.484850+0000","last_peered":"2024-09-10T22:15:35.484850+0000","last_clean":"2024-09-10T22:15:35.484850+0000","last_became_active":"2024-09-10T22:15:35.484427+0000","last_became_peered":"2024-09-10T22:15:35.484427+0000","last_unstale":"2024-09-10T22:15:35.484850+0000","last_undegraded":"2024-09-10T22:15:35.484850+0000","last_fullsized":"2024-09-10T22:15:35.484850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:35.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483370+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:35.483370+0000","last_peered":"2024-09-10T22:15:35.483370+0000","last_clean":"2024-09-10T22:15:35.483370+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:35.483370+0000","last_undegraded":"2024-09-10T22:15:35.483370+0000","last_fullsized":"2024-09-10T22:15:35.483370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":19,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480669+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:15:35.480669+0000","last_peered":"2024-09-10T22:15:35.480669+0000","last_clean":"2024-09-10T22:15:35.480669+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:15:35.480669+0000","last_undegraded":"2024-09-10T22:15:35.480669+0000","last_fullsized":"2024-09-10T22:15:35.480669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.489459+0000","last_change":"2024-09-10T22:15:35.488995+0000","last_active":"2024-09-10T22:15:35.489459+0000","last_peered":"2024-09-10T22:15:35.489459+0000","last_clean":"2024-09-10T22:15:35.489459+0000","last_became_active":"2024-09-10T22:15:35.484278+0000","last_became_peered":"2024-09-10T22:15:35.484278+0000","last_unstale":"2024-09-10T22:15:35.489459+0000","last_undegraded":"2024-09-10T22:15:35.489459+0000","last_fullsized":"2024-09-10T22:15:35.489459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:00.474920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477156+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:15:35.477156+0000","last_peered":"2024-09-10T22:15:35.477156+0000","last_clean":"2024-09-10T22:15:35.477156+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:15:35.477156+0000","last_undegraded":"2024-09-10T22:15:35.477156+0000","last_fullsized":"2024-09-10T22:15:35.477156+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'12","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483287+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:15:35.483287+0000","last_peered":"2024-09-10T22:15:35.483287+0000","last_clean":"2024-09-10T22:15:35.483287+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:15:35.483287+0000","last_undegraded":"2024-09-10T22:15:35.483287+0000","last_fullsized":"2024-09-10T22:15:35.483287+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103406+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:15:36.103406+0000","last_peered":"2024-09-10T22:15:36.103406+0000","last_clean":"2024-09-10T22:15:36.103406+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:15:36.103406+0000","last_undegraded":"2024-09-10T22:15:36.103406+0000","last_fullsized":"2024-09-10T22:15:36.103406+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477897+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:35.477897+0000","last_peered":"2024-09-10T22:15:35.477897+0000","last_clean":"2024-09-10T22:15:35.477897+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:35.477897+0000","last_undegraded":"2024-09-10T22:15:35.477897+0000","last_fullsized":"2024-09-10T22:15:35.477897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482257+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:15:35.482257+0000","last_peered":"2024-09-10T22:15:35.482257+0000","last_clean":"2024-09-10T22:15:35.482257+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:15:35.482257+0000","last_undegraded":"2024-09-10T22:15:35.482257+0000","last_fullsized":"2024-09-10T22:15:35.482257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.486805+0000","last_change":"2024-09-10T22:15:35.486730+0000","last_active":"2024-09-10T22:15:35.486805+0000","last_peered":"2024-09-10T22:15:35.486805+0000","last_clean":"2024-09-10T22:15:35.486805+0000","last_became_active":"2024-09-10T22:15:35.483148+0000","last_became_peered":"2024-09-10T22:15:35.483148+0000","last_unstale":"2024-09-10T22:15:35.486805+0000","last_undegraded":"2024-09-10T22:15:35.486805+0000","last_fullsized":"2024-09-10T22:15:35.486805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:10.166666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480421+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:15:35.480421+0000","last_peered":"2024-09-10T22:15:35.480421+0000","last_clean":"2024-09-10T22:15:35.480421+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:15:35.480421+0000","last_undegraded":"2024-09-10T22:15:35.480421+0000","last_fullsized":"2024-09-10T22:15:35.480421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102639+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:36.102639+0000","last_peered":"2024-09-10T22:15:36.102639+0000","last_clean":"2024-09-10T22:15:36.102639+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:36.102639+0000","last_undegraded":"2024-09-10T22:15:36.102639+0000","last_fullsized":"2024-09-10T22:15:36.102639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480940+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:15:35.480940+0000","last_peered":"2024-09-10T22:15:35.480940+0000","last_clean":"2024-09-10T22:15:35.480940+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:15:35.480940+0000","last_undegraded":"2024-09-10T22:15:35.480940+0000","last_fullsized":"2024-09-10T22:15:35.480940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479161+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:35.479161+0000","last_peered":"2024-09-10T22:15:35.479161+0000","last_clean":"2024-09-10T22:15:35.479161+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:35.479161+0000","last_undegraded":"2024-09-10T22:15:35.479161+0000","last_fullsized":"2024-09-10T22:15:35.479161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103147+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:15:36.103147+0000","last_peered":"2024-09-10T22:15:36.103147+0000","last_clean":"2024-09-10T22:15:36.103147+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:15:36.103147+0000","last_undegraded":"2024-09-10T22:15:36.103147+0000","last_fullsized":"2024-09-10T22:15:36.103147+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481286+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:35.481286+0000","last_peered":"2024-09-10T22:15:35.481286+0000","last_clean":"2024-09-10T22:15:35.481286+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:35.481286+0000","last_undegraded":"2024-09-10T22:15:35.481286+0000","last_fullsized":"2024-09-10T22:15:35.481286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847688+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:15:36.847688+0000","last_peered":"2024-09-10T22:15:36.847688+0000","last_clean":"2024-09-10T22:15:36.847688+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:15:36.847688+0000","last_undegraded":"2024-09-10T22:15:36.847688+0000","last_fullsized":"2024-09-10T22:15:36.847688+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478207+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:15:35.478207+0000","last_peered":"2024-09-10T22:15:35.478207+0000","last_clean":"2024-09-10T22:15:35.478207+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:15:35.478207+0000","last_undegraded":"2024-09-10T22:15:35.478207+0000","last_fullsized":"2024-09-10T22:15:35.478207+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482561+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:35.482561+0000","last_peered":"2024-09-10T22:15:35.482561+0000","last_clean":"2024-09-10T22:15:35.482561+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:35.482561+0000","last_undegraded":"2024-09-10T22:15:35.482561+0000","last_fullsized":"2024-09-10T22:15:35.482561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479827+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:15:35.479827+0000","last_peered":"2024-09-10T22:15:35.479827+0000","last_clean":"2024-09-10T22:15:35.479827+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:15:35.479827+0000","last_undegraded":"2024-09-10T22:15:35.479827+0000","last_fullsized":"2024-09-10T22:15:35.479827+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481854+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:35.481854+0000","last_peered":"2024-09-10T22:15:35.481854+0000","last_clean":"2024-09-10T22:15:35.481854+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:35.481854+0000","last_undegraded":"2024-09-10T22:15:35.481854+0000","last_fullsized":"2024-09-10T22:15:35.481854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482468+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:15:35.482468+0000","last_peered":"2024-09-10T22:15:35.482468+0000","last_clean":"2024-09-10T22:15:35.482468+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:15:35.482468+0000","last_undegraded":"2024-09-10T22:15:35.482468+0000","last_fullsized":"2024-09-10T22:15:35.482468+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103492+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:36.103492+0000","last_peered":"2024-09-10T22:15:36.103492+0000","last_clean":"2024-09-10T22:15:36.103492+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:36.103492+0000","last_undegraded":"2024-09-10T22:15:36.103492+0000","last_fullsized":"2024-09-10T22:15:36.103492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103349+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:15:36.103349+0000","last_peered":"2024-09-10T22:15:36.103349+0000","last_clean":"2024-09-10T22:15:36.103349+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:15:36.103349+0000","last_undegraded":"2024-09-10T22:15:36.103349+0000","last_fullsized":"2024-09-10T22:15:36.103349+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483426+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:35.483426+0000","last_peered":"2024-09-10T22:15:35.483426+0000","last_clean":"2024-09-10T22:15:35.483426+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:35.483426+0000","last_undegraded":"2024-09-10T22:15:35.483426+0000","last_fullsized":"2024-09-10T22:15:35.483426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64618,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":369,"num_read_kb":249,"num_write":164,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":193854,"data_compressed":5442,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710748,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":843776,"data_stored":408651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906977,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":987136,"data_stored":1060727,"data_compressed":37762,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070501,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":856064,"data_stored":408865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266730,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":408763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36232,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708920,"statfs":{"total":95995035648,"available":95957934080,"internally_reserved":0,"allocated":905216,"data_stored":1000715,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":843776,"data_stored":408254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822714,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1000399,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986240,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":847872,"data_stored":408691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":408565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":925696,"data_stored":470405,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":468664,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":864256,"data_stored":409525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":60617,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62358,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62195,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:16:12.696 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-10T22:16:12.696 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T22:16:12.696 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-10T22:16:12.696 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-10T22:16:12.958 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:13.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:13 smithi005 ceph-mon[31115]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:13.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:13 smithi005 ceph-mon[31115]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:13.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 -- 172.21.15.5:0/2680087447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc1076a0 msgr2=0x7fccbc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 --2- 172.21.15.5:0/2680087447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc1076a0 0x7fccbc107ae0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009900 tx=0x7fcca402a410 comp rx=0 tx=0).stop 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 -- 172.21.15.5:0/2680087447 shutdown_connections 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 --2- 172.21.15.5:0/2680087447 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc108020 0x7fccbc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 --2- 172.21.15.5:0/2680087447 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc1076a0 0x7fccbc107ae0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 --2- 172.21.15.5:0/2680087447 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccbc101c90 0x7fccbc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 -- 172.21.15.5:0/2680087447 >> 172.21.15.5:0/2680087447 conn(0x7fccbc0fd700 msgr2=0x7fccbc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 -- 172.21.15.5:0/2680087447 shutdown_connections 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.401+0000 7fccc204d640 1 -- 172.21.15.5:0/2680087447 wait complete. 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 Processor -- start 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 -- start start 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 0x7fccbc19a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccbc1076a0 0x7fccbc19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:13.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc108020 0x7fccbc1a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111ce0 con 0x7fccbc101c90 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111b60 con 0x7fccbc108020 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccc204d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fccbc111e60 con 0x7fccbc1076a0 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 0x7fccbc19a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccbb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 0x7fccbc19a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42956/0 (socket says 172.21.15.5:42956) 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccbb7fe640 1 -- 172.21.15.5:0/2224931822 learned_addr learned my addr 172.21.15.5:0/2224931822 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccbbfff640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc108020 0x7fccbc1a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.402+0000 7fccbaffd640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccbc1076a0 0x7fccbc19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccbb7fe640 1 -- 172.21.15.5:0/2224931822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccbc1076a0 msgr2=0x7fccbc19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccbb7fe640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccbc1076a0 0x7fccbc19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccbb7fe640 1 -- 172.21.15.5:0/2224931822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc108020 msgr2=0x7fccbc1a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccbb7fe640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc108020 0x7fccbc1a50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccbb7fe640 1 -- 172.21.15.5:0/2224931822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccbc1a5610 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccbb7fe640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 0x7fccbc19a050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fccac00e9f0 tx=0x7fccac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac00cd80 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccac0108e0 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccbc1a57e0 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccac018980 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.403+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccbc1a5c90 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.404+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccbc102070 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.405+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fccac010430 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.406+0000 7fccb8ff9640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcca80b5370 0x7fcca80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.406+0000 7fccbaffd640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcca80b5370 0x7fcca80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.406+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fccac0e64c0 con 0x7fccbc101c90 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.407+0000 7fccbaffd640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcca80b5370 0x7fcca80b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcca4031440 tx=0x7fcca4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:13.440 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.409+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fccac0acc00 con 0x7fccbc101c90 2024-09-10T22:16:13.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:13 smithi189 ceph-mon[35784]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:13.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:13 smithi189 ceph-mon[35784]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:13 smithi052 ceph-mon[34997]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:13.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:13 smithi052 ceph-mon[34997]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:13.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.637+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fccbc06af20 con 0x7fccbc101c90 2024-09-10T22:16:13.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.637+0000 7fccb8ff9640 1 -- 172.21.15.5:0/2224931822 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fccac0b1630 con 0x7fccbc101c90 2024-09-10T22:16:13.640 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:13.640 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T22:16:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcca80b5370 msgr2=0x7fcca80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcca80b5370 0x7fcca80b7830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcca4031440 tx=0x7fcca4005b50 comp rx=0 tx=0).stop 2024-09-10T22:16:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 msgr2=0x7fccbc19a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 0x7fccbc19a050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fccac00e9f0 tx=0x7fccac00eeb0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 shutdown_connections 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcca80b5370 0x7fcca80b7830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fccbc108020 0x7fccbc1a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fccbc1076a0 0x7fccbc19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 --2- 172.21.15.5:0/2224931822 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fccbc101c90 0x7fccbc19a050 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 >> 172.21.15.5:0/2224931822 conn(0x7fccbc0fd700 msgr2=0x7fccbc0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 shutdown_connections 2024-09-10T22:16:13.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:13.640+0000 7fccc204d640 1 -- 172.21.15.5:0/2224931822 wait complete. 2024-09-10T22:16:14.292 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:14 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2224931822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T22:16:14.322 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-10T22:16:14.322 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:14.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:14 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2224931822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T22:16:14.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:14 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2224931822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-10T22:16:14.585 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 -- 172.21.15.5:0/3472921653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 msgr2=0x7fa7a810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 --2- 172.21.15.5:0/3472921653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a810e860 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009ca0 tx=0x7fa7a002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 -- 172.21.15.5:0/3472921653 shutdown_connections 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 --2- 172.21.15.5:0/3472921653 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a810e860 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 --2- 172.21.15.5:0/3472921653 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81076e0 0x7fa7a8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 --2- 172.21.15.5:0/3472921653 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 0x7fa7a81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 -- 172.21.15.5:0/3472921653 >> 172.21.15.5:0/3472921653 conn(0x7fa7a80fd720 msgr2=0x7fa7a80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:15.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 -- 172.21.15.5:0/3472921653 shutdown_connections 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.100+0000 7fa7aed03640 1 -- 172.21.15.5:0/3472921653 wait complete. 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 Processor -- start 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 -- start start 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 0x7fa7a8198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81076e0 0x7fa7a8198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8111ce0 con 0x7fa7a8108060 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8111b60 con 0x7fa7a8101cd0 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aed03640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a8111e60 con 0x7fa7a81076e0 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7ad2a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7ad2a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a819da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42976/0 (socket says 172.21.15.5:42976) 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7ad2a0640 1 -- 172.21.15.5:0/513447345 learned_addr learned my addr 172.21.15.5:0/513447345 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:15.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa7aca9f640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 0x7fa7a8198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.101+0000 7fa79ffff640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81076e0 0x7fa7a8198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7ad2a0640 1 -- 172.21.15.5:0/513447345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81076e0 msgr2=0x7fa7a8198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7ad2a0640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81076e0 0x7fa7a8198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7ad2a0640 1 -- 172.21.15.5:0/513447345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 msgr2=0x7fa7a8198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7ad2a0640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 0x7fa7a8198150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7ad2a0640 1 -- 172.21.15.5:0/513447345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a819e200 con 0x7fa7a8108060 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7aca9f640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 0x7fa7a8198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7ad2a0640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a819da30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0005cc0 tx=0x7fa7a002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a0003bf0 con 0x7fa7a8108060 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7a0003d90 con 0x7fa7a8108060 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a819e490 con 0x7fa7a8108060 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a002fbc0 con 0x7fa7a8108060 2024-09-10T22:16:15.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.102+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a81a4bb0 con 0x7fa7a8108060 2024-09-10T22:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.103+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a81020b0 con 0x7fa7a8108060 2024-09-10T22:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.106+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fa7a0004610 con 0x7fa7a8108060 2024-09-10T22:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.106+0000 7fa79dffb640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7900b53f0 0x7fa7900b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.106+0000 7fa7aca9f640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7900b53f0 0x7fa7900b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.106+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fa7a0107420 con 0x7fa7a8108060 2024-09-10T22:16:15.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.106+0000 7fa7aca9f640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7900b53f0 0x7fa7900b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400abe0 tx=0x7fa7a400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:15.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.108+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa7a00ce1b0 con 0x7fa7a8108060 2024-09-10T22:16:15.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:15 smithi005 ceph-mon[31115]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:15.333 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.331+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7a8199280 con 0x7fa7a8108060 2024-09-10T22:16:15.334 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.332+0000 7fa79dffb640 1 -- 172.21.15.5:0/513447345 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7fa7a8199280 con 0x7fa7a8108060 2024-09-10T22:16:15.334 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:15.335 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-10T22:15:15:399259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:15:15.075706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24562,24563,24578]},"id":1}]} 2024-09-10T22:16:15.335 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7900b53f0 msgr2=0x7fa7900b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7900b53f0 0x7fa7900b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400abe0 tx=0x7fa7a400a5c0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 msgr2=0x7fa7a819da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a819da30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0005cc0 tx=0x7fa7a002f380 comp rx=0 tx=0).stop 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 shutdown_connections 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7900b53f0 0x7fa7900b78b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7a8108060 0x7fa7a819da30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7a81076e0 0x7fa7a8198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 --2- 172.21.15.5:0/513447345 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7a8101cd0 0x7fa7a8198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:15.337 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 >> 172.21.15.5:0/513447345 conn(0x7fa7a80fd720 msgr2=0x7fa7a80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 shutdown_connections 2024-09-10T22:16:15.338 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:15.334+0000 7fa7aed03640 1 -- 172.21.15.5:0/513447345 wait complete. 2024-09-10T22:16:15.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:15 smithi189 ceph-mon[35784]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:15.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:15 smithi052 ceph-mon[34997]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:16.043 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:16.304 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:16.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:16 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/513447345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:16.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:16 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/513447345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:16.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:16 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/513447345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 -- 172.21.15.5:0/655833064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634102dc0 msgr2=0x7f06341031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 --2- 172.21.15.5:0/655833064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634102dc0 0x7f06341031a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0624009900 tx=0x7f062402a410 comp rx=0 tx=0).stop 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 -- 172.21.15.5:0/655833064 shutdown_connections 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 --2- 172.21.15.5:0/655833064 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0634109150 0x7f063410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 --2- 172.21.15.5:0/655833064 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f06341087d0 0x7f0634108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 --2- 172.21.15.5:0/655833064 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634102dc0 0x7f06341031a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:16.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 -- 172.21.15.5:0/655833064 >> 172.21.15.5:0/655833064 conn(0x7f06340fe830 msgr2=0x7f0634100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 -- 172.21.15.5:0/655833064 shutdown_connections 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.811+0000 7f0639354640 1 -- 172.21.15.5:0/655833064 wait complete. 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 Processor -- start 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 -- start start 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0634102dc0 0x7f0634199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06341087d0 0x7f0634199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 0x7f063419ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0634112e10 con 0x7f0634109150 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0634112c90 con 0x7f06341087d0 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f0639354640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0634112f90 con 0x7f0634102dc0 2024-09-10T22:16:16.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.812+0000 7f06337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 0x7f063419ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 0x7f063419ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43006/0 (socket says 172.21.15.5:43006) 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 -- 172.21.15.5:0/2306016537 learned_addr learned my addr 172.21.15.5:0/2306016537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f0632ffd640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0634102dc0 0x7f0634199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06327fc640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06341087d0 0x7f0634199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 -- 172.21.15.5:0/2306016537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0634102dc0 msgr2=0x7f0634199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0634102dc0 0x7f0634199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 -- 172.21.15.5:0/2306016537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06341087d0 msgr2=0x7f0634199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06341087d0 0x7f0634199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 -- 172.21.15.5:0/2306016537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063419f3b0 con 0x7f0634109150 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f06337fe640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 0x7f063419ebe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f062c00eaa0 tx=0x7f062c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c00cdb0 con 0x7f0634109150 2024-09-10T22:16:16.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063419f6a0 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062c005020 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c0116d0 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.813+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06341a5de0 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.814+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06341031a0 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.816+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f062c00f040 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.817+0000 7f061bfff640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f061c0b5370 0x7f061c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.817+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f062c0e5fc0 con 0x7f0634109150 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.817+0000 7f0632ffd640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f061c0b5370 0x7f061c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.817+0000 7f0632ffd640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f061c0b5370 0x7f061c0b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0624031440 tx=0x7f06240095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:16.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:16.820+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f062c016030 con 0x7f0634109150 2024-09-10T22:16:17.045 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.044+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f063402e5c0 con 0x7f0634109150 2024-09-10T22:16:17.046 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.045+0000 7f061bfff640 1 -- 172.21.15.5:0/2306016537 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7f062c0acdf0 con 0x7f0634109150 2024-09-10T22:16:17.046 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:17.046 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-10T22:15:15:399259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:15:15.075706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24562,24563,24578]},"id":1}]} 2024-09-10T22:16:17.047 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:16:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f061c0b5370 msgr2=0x7f061c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:17.048 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f061c0b5370 0x7f061c0b7830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0624031440 tx=0x7f06240095f0 comp rx=0 tx=0).stop 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 msgr2=0x7f063419ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 0x7f063419ebe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f062c00eaa0 tx=0x7f062c00ef60 comp rx=0 tx=0).stop 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 shutdown_connections 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f061c0b5370 0x7f061c0b7830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0634109150 0x7f063419ebe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f06341087d0 0x7f0634199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 --2- 172.21.15.5:0/2306016537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0634102dc0 0x7f0634199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 >> 172.21.15.5:0/2306016537 conn(0x7f06340fe830 msgr2=0x7f0634100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 shutdown_connections 2024-09-10T22:16:17.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:17.047+0000 7f0639354640 1 -- 172.21.15.5:0/2306016537 wait complete. 2024-09-10T22:16:17.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:17 smithi005 ceph-mon[31115]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:17.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:17 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2306016537' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:17.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:17 smithi189 ceph-mon[35784]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:17.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:17 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2306016537' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:17.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:17 smithi052 ceph-mon[34997]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:17.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:17 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2306016537' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:17.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:16:17.959 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 -- 172.21.15.5:0/2553640769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f673810d100 msgr2=0x7f673810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 --2- 172.21.15.5:0/2553640769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f673810d100 0x7f673810f560 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6730009ca0 tx=0x7f673002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 -- 172.21.15.5:0/2553640769 shutdown_connections 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 --2- 172.21.15.5:0/2553640769 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f673810d100 0x7f673810f560 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 --2- 172.21.15.5:0/2553640769 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f67381045c0 0x7f673810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 --2- 172.21.15.5:0/2553640769 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6738103ca0 0x7f6738104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 -- 172.21.15.5:0/2553640769 >> 172.21.15.5:0/2553640769 conn(0x7f67380fd700 msgr2=0x7f67380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 -- 172.21.15.5:0/2553640769 shutdown_connections 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 -- 172.21.15.5:0/2553640769 wait complete. 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.477+0000 7f673d279640 1 Processor -- start 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 -- start start 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103ca0 0x7f6738199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 0x7f67381997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f673810d100 0x7f673819eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6738112db0 con 0x7f67381045c0 2024-09-10T22:16:18.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6738112c30 con 0x7f6738103ca0 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f673d279640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6738112f30 con 0x7f673810d100 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 0x7f67381997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 0x7f67381997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43028/0 (socket says 172.21.15.5:43028) 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 -- 172.21.15.5:0/3817544972 learned_addr learned my addr 172.21.15.5:0/3817544972 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f6736ffd640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103ca0 0x7f6738199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67377fe640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f673810d100 0x7f673819eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 -- 172.21.15.5:0/3817544972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f673810d100 msgr2=0x7f673819eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f673810d100 0x7f673819eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 -- 172.21.15.5:0/3817544972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103ca0 msgr2=0x7f6738199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103ca0 0x7f6738199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67367fc640 1 -- 172.21.15.5:0/3817544972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673819f310 con 0x7f67381045c0 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.478+0000 7f67377fe640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f673810d100 0x7f673819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:18.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.479+0000 7f67367fc640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 0x7f67381997a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f672c00d750 tx=0x7f672c00db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.479+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c017070 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.479+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673819f600 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.479+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f672c009cd0 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.479+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f672c003b50 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.479+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67381a5d40 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.480+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6738104080 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.481+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f672c003cf0 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.482+0000 7f671ffff640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67200b5370 0x7f67200b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.482+0000 7f6736ffd640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67200b5370 0x7f67200b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.482+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f672c0e5680 con 0x7f67381045c0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.482+0000 7f6736ffd640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67200b5370 0x7f67200b7830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6728009990 tx=0x7f6728009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:18.500 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.486+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f672c0ac410 con 0x7f67381045c0 2024-09-10T22:16:18.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.674+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67381a60b0 con 0x7f67381045c0 2024-09-10T22:16:18.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.676+0000 7f671ffff640 1 -- 172.21.15.5:0/3817544972 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7f672c0abd10 con 0x7f67381045c0 2024-09-10T22:16:18.678 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:18.678 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67200b5370 msgr2=0x7f67200b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67200b5370 0x7f67200b7830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6728009990 tx=0x7f6728009110 comp rx=0 tx=0).stop 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 msgr2=0x7f67381997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 0x7f67381997a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f672c00d750 tx=0x7f672c00db50 comp rx=0 tx=0).stop 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 shutdown_connections 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f67200b5370 0x7f67200b7830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f673810d100 0x7f673819eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f67381045c0 0x7f67381997a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 --2- 172.21.15.5:0/3817544972 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6738103ca0 0x7f6738199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 >> 172.21.15.5:0/3817544972 conn(0x7f67380fd700 msgr2=0x7f673810f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 shutdown_connections 2024-09-10T22:16:18.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:18.678+0000 7f673d279640 1 -- 172.21.15.5:0/3817544972 wait complete. 2024-09-10T22:16:19.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:19 smithi005 ceph-mon[31115]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:19.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3817544972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:19.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:19.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:19 smithi189 ceph-mon[35784]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:19.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3817544972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:19.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:19 smithi052 ceph-mon[34997]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:19.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:19 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3817544972' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:19.627 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:20.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 -- 172.21.15.5:0/3752490248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c1016a0 msgr2=0x7fab8c101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 --2- 172.21.15.5:0/3752490248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c1016a0 0x7fab8c101a80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fab78009900 tx=0x7fab7802a480 comp rx=0 tx=0).stop 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 -- 172.21.15.5:0/3752490248 shutdown_connections 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 --2- 172.21.15.5:0/3752490248 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c10f250 0x7fab8c111640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 --2- 172.21.15.5:0/3752490248 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab8c101fc0 0x7fab8c10ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 --2- 172.21.15.5:0/3752490248 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c1016a0 0x7fab8c101a80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 -- 172.21.15.5:0/3752490248 >> 172.21.15.5:0/3752490248 conn(0x7fab8c0fd5b0 msgr2=0x7fab8c0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 -- 172.21.15.5:0/3752490248 shutdown_connections 2024-09-10T22:16:20.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.095+0000 7fab9359e640 1 -- 172.21.15.5:0/3752490248 wait complete. 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 Processor -- start 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 -- start start 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c1016a0 0x7fab8c19b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 0x7fab8c19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab8c10f250 0x7fab8c1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c114dd0 con 0x7fab8c101fc0 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c114c50 con 0x7fab8c1016a0 2024-09-10T22:16:20.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab9359e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c114f50 con 0x7fab8c10f250 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab91d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 0x7fab8c19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab91d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 0x7fab8c19b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43040/0 (socket says 172.21.15.5:43040) 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.096+0000 7fab91d9b640 1 -- 172.21.15.5:0/3676485150 learned_addr learned my addr 172.21.15.5:0/3676485150 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab9259c640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c1016a0 0x7fab8c19b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab91d9b640 1 -- 172.21.15.5:0/3676485150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab8c10f250 msgr2=0x7fab8c1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab92d9d640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab8c10f250 0x7fab8c1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab91d9b640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab8c10f250 0x7fab8c1a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab91d9b640 1 -- 172.21.15.5:0/3676485150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c1016a0 msgr2=0x7fab8c19b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab91d9b640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c1016a0 0x7fab8c19b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab91d9b640 1 -- 172.21.15.5:0/3676485150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c1a12f0 con 0x7fab8c101fc0 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab9259c640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c1016a0 0x7fab8c19b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab91d9b640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 0x7fab8c19b780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab8000d770 tx=0x7fab8000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:20.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80017070 con 0x7fab8c101fc0 2024-09-10T22:16:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1a15e0 con 0x7fab8c101fc0 2024-09-10T22:16:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab800054d0 con 0x7fab8c101fc0 2024-09-10T22:16:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab80004c30 con 0x7fab8c101fc0 2024-09-10T22:16:20.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.097+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1a7ca0 con 0x7fab8c101fc0 2024-09-10T22:16:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.098+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c101a80 con 0x7fab8c101fc0 2024-09-10T22:16:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.100+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fab80004dd0 con 0x7fab8c101fc0 2024-09-10T22:16:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.100+0000 7fab877fe640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fab7c0b5410 0x7fab7c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.101+0000 7fab9259c640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fab7c0b5410 0x7fab7c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.101+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fab800e5cc0 con 0x7fab8c101fc0 2024-09-10T22:16:20.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.101+0000 7fab9259c640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fab7c0b5410 0x7fab7c0b78d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:20.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.104+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fab800aca50 con 0x7fab8c101fc0 2024-09-10T22:16:20.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.355+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab8c1a7fd0 con 0x7fab8c101fc0 2024-09-10T22:16:20.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.356+0000 7fab877fe640 1 -- 172.21.15.5:0/3676485150 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7fab800b5030 con 0x7fab8c101fc0 2024-09-10T22:16:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:20.358 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-10T22:15:15:399259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:15:15.075706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24562,24563,24578]},"id":1}]} 2024-09-10T22:16:20.358 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fab7c0b5410 msgr2=0x7fab7c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fab7c0b5410 0x7fab7c0b78d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78031400 comp rx=0 tx=0).stop 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 msgr2=0x7fab8c19b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 0x7fab8c19b780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fab8000d770 tx=0x7fab8000dc30 comp rx=0 tx=0).stop 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 shutdown_connections 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fab7c0b5410 0x7fab7c0b78d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fab8c10f250 0x7fab8c1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fab8c101fc0 0x7fab8c19b780 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 --2- 172.21.15.5:0/3676485150 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fab8c1016a0 0x7fab8c19b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:20.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.358+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 >> 172.21.15.5:0/3676485150 conn(0x7fab8c0fd5b0 msgr2=0x7fab8c110590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.359+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 shutdown_connections 2024-09-10T22:16:20.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:20.359+0000 7fab9359e640 1 -- 172.21.15.5:0/3676485150 wait complete. 2024-09-10T22:16:21.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T22:15:03.043229+0000', 'modified': '2024-09-10T22:15:15.075706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24578, 'mds_1': 24563, 'mds_2': 24562}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24536': {'gid': 24536, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6835/4020193542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 4020193542}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 4020193542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/1432375899', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 1432375899}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 1432375899}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24544': {'gid': 24544, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/2390982285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2390982285}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2390982285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.189:6839/3637381557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 3637381557}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 3637381557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.52:6837/992786234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 992786234}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 992786234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6839/3172231401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 3172231401}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 3172231401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24578, 'qdb_cluster': [24562, 24563, 24578]} 2024-09-10T22:16:21.033 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:16:21.033 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T22:16:21.292 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:21.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:21 smithi005 ceph-mon[31115]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:21.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:21 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3676485150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:21 smithi189 ceph-mon[35784]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:21.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:21 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3676485150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:21.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:21 smithi052 ceph-mon[34997]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:21.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:21 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3676485150' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:21.831 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 -- 172.21.15.5:0/3702853327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac101cd0 msgr2=0x7f46ac1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/3702853327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac101cd0 0x7f46ac1020b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f469c009900 tx=0x7f469c02a410 comp rx=0 tx=0).stop 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 -- 172.21.15.5:0/3702853327 shutdown_connections 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/3702853327 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac108060 0x7f46ac10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/3702853327 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac1076e0 0x7f46ac107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/3702853327 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac101cd0 0x7f46ac1020b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 -- 172.21.15.5:0/3702853327 >> 172.21.15.5:0/3702853327 conn(0x7f46ac0fd700 msgr2=0x7f46ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 -- 172.21.15.5:0/3702853327 shutdown_connections 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 -- 172.21.15.5:0/3702853327 wait complete. 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.812+0000 7f46b1fe5640 1 Processor -- start 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 -- start start 2024-09-10T22:16:21.832 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 0x7f46ac1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac1076e0 0x7f46ac199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac108060 0x7f46ac19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac112e40 con 0x7f46ac108060 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac112cc0 con 0x7f46ac101cd0 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46b1fe5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac112fc0 con 0x7f46ac1076e0 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 0x7f46ac1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46abfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac108060 0x7f46ac19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46ab7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 0x7f46ac1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:40288/0 (socket says 172.21.15.5:40288) 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46ab7fe640 1 -- 172.21.15.5:0/2456599224 learned_addr learned my addr 172.21.15.5:0/2456599224 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac1076e0 0x7f46ac199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46abfff640 1 -- 172.21.15.5:0/2456599224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac1076e0 msgr2=0x7f46ac199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46abfff640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac1076e0 0x7f46ac199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46abfff640 1 -- 172.21.15.5:0/2456599224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 msgr2=0x7f46ac1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46abfff640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 0x7f46ac1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46abfff640 1 -- 172.21.15.5:0/2456599224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac19f3a0 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac1076e0 0x7f46ac199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.813+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 0x7f46ac1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.814+0000 7f46abfff640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac108060 0x7f46ac19ebd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46a400be20 tx=0x7f46a400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.814+0000 7f46a8ff9640 1 -- 172.21.15.5:0/2456599224 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4019070 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.814+0000 7f46a8ff9640 1 -- 172.21.15.5:0/2456599224 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a40148f0 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.814+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac19f690 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.814+0000 7f46a8ff9640 1 -- 172.21.15.5:0/2456599224 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a4012840 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.814+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac1a5dd0 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.816+0000 7f46a8ff9640 1 -- 172.21.15.5:0/2456599224 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f46a4014440 con 0x7f46ac108060 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.816+0000 7f46b43ba740 1 Processor -- start 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.816+0000 7f46b43ba740 1 -- start start 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d38d30 0x55fc45d39110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d450a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d455e0 0x55fc45d479d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46b43ba740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fc45cb0c10 con 0x55fc45d39650 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46b43ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fc45ca0040 con 0x55fc45d455e0 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46b43ba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc45ca3e50 con 0x55fc45d38d30 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d450a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43076/0 (socket says 172.21.15.5:43076) 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d455e0 0x55fc45d479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1053920193 learned_addr learned my addr 172.21.15.5:0/1053920193 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46aaffd640 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d38d30 0x55fc45d39110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46a8ff9640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f46940b5370 0x7f46940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1053920193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d38d30 msgr2=0x55fc45d39110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d38d30 0x55fc45d39110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1053920193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d455e0 msgr2=0x55fc45d479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d455e0 0x55fc45d479d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1053920193 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc459fe540 con 0x55fc45d39650 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46aaffd640 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d455e0 0x55fc45d479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46abfff640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f46940b5370 0x7f46940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d450a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f469c000c00 tx=0x7f469c0315d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542a074b55e31b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.817+0000 7f46a8ff9640 1 -- 172.21.15.5:0/2456599224 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f46a40e5710 con 0x7f46ac108060 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f4691ffb640 1 -- 172.21.15.5:0/1053920193 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c035040 con 0x55fc45d39650 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f4691ffb640 1 -- 172.21.15.5:0/1053920193 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f469c005020 con 0x55fc45d39650 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f4691ffb640 1 -- 172.21.15.5:0/1053920193 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c004b20 con 0x55fc45d39650 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 -- 172.21.15.5:0/1053920193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 msgr2=0x55fc45d450a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46abfff640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f46940b5370 0x7f46940b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46a40a83c0 tx=0x7f46a4074f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d450a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f469c000c00 tx=0x7f469c0315d0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 -- 172.21.15.5:0/1053920193 shutdown_connections 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d455e0 0x55fc45d479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d450a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1053920193 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d38d30 0x55fc45d39110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 -- 172.21.15.5:0/1053920193 >> 172.21.15.5:0/1053920193 conn(0x55fc45d36b60 msgr2=0x55fc45d37d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.818+0000 7f46b43ba740 1 -- 172.21.15.5:0/1053920193 shutdown_connections 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 -- 172.21.15.5:0/1053920193 wait complete. 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 -- start start 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 Processor -- start 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d42b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d43070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fc45b015f0 con 0x55fc45d38d30 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fc45c3b010 con 0x55fc45d39650 2024-09-10T22:16:21.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d48230 con 0x55fc45d455e0 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46b43ba740 10 client.0 _ll_register_callbacks cb 0x55fc45c9a340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d425f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43088/0 (socket says 172.21.15.5:43088) 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46aaffd640 1 -- 172.21.15.5:0/2623344545 learned_addr learned my addr 172.21.15.5:0/2623344545 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.819+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d42b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d43070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 -- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 msgr2=0x55fc45d43070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d43070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 -- 172.21.15.5:0/2623344545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 msgr2=0x55fc45d42b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d42b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 -- 172.21.15.5:0/2623344545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc45c68a00 con 0x55fc45d38d30 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d42b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d425f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f46a0013e40 tx=0x7f46a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849f7bebf2862b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:21.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f468affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f468affd640 1 -- 172.21.15.5:0/2623344545 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0004020 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f468affd640 1 -- 172.21.15.5:0/2623344545 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f46a00041c0 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f469c005020 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f468affd640 1 -- 172.21.15.5:0/2623344545 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f46a00043c0 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46b43ba740 10 client.15111 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc45d53ea0 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.820+0000 7f468affd640 1 -- 172.21.15.5:0/2623344545 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f469c005020 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f468affd640 1 -- 172.21.15.5:0/2623344545 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f46a000f040 con 0x55fc45d38d30 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46b43ba740 10 client.15111 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46b43ba740 10 client.15111 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46b43ba740 20 client.15111 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:21.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45d56500 0x55fc45d57970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46b43ba740 4 client.15111 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc45cb2b60 con 0x55fc45d56500 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.821+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45d56500 0x55fc45d57970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.822+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45d56500 0x55fc45d57970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=466b4f0e447a52e0 server_cookie=343e9829a1f5f162 in_seq=0 out_seq=0 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.822+0000 7f468affd640 10 client.15111 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.822+0000 7f468affd640 1 -- 172.21.15.5:0/2623344545 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fc45cb2b60 con 0x55fc45d56500 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.822+0000 7f468affd640 10 client.15111 handle_command_reply: tid=0 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 client.15111 shutdown 2024-09-10T22:16:21.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 msgr2=0x55fc45d425f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d425f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f46a0013e40 tx=0x7f46a0004730 comp rx=0 tx=0).stop 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 shutdown_connections 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d43070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45d56500 0x55fc45d57970 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d42b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f468affd640 0 client.15111 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2623344545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d425f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 >> 172.21.15.5:0/2623344545 conn(0x55fc45d36b60 msgr2=0x55fc45d3c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 shutdown_connections 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 1 -- 172.21.15.5:0/2623344545 wait complete. 2024-09-10T22:16:21.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.823+0000 7f46b43ba740 20 client.15111 trim_cache size 0 max 16384 2024-09-10T22:16:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.841+0000 7f46b43ba740 1 Processor -- start 2024-09-10T22:16:21.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.841+0000 7f46b43ba740 1 -- start start 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d3cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d3f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46b43ba740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d55cb0 con 0x55fc45d38d30 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46b43ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d56380 con 0x55fc45d39650 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46b43ba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d56a50 con 0x55fc45d455e0 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d3cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d3cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43102/0 (socket says 172.21.15.5:43102) 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 -- 172.21.15.5:0/2208526912 learned_addr learned my addr 172.21.15.5:0/2208526912 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d3f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 -- 172.21.15.5:0/2208526912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 msgr2=0x55fc45d3fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 -- 172.21.15.5:0/2208526912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 msgr2=0x55fc45d3f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d3f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 -- 172.21.15.5:0/2208526912 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc45d375e0 con 0x55fc45d38d30 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46aaffd640 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d3cef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f46a0010eb0 tx=0x7f46a000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0cd30b01b451a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46917fa640 1 -- 172.21.15.5:0/2208526912 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0004220 con 0x55fc45d38d30 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46917fa640 1 -- 172.21.15.5:0/2208526912 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a000b340 con 0x55fc45d38d30 2024-09-10T22:16:21.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.842+0000 7f46917fa640 1 -- 172.21.15.5:0/2208526912 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0003ce0 con 0x55fc45d38d30 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 -- 172.21.15.5:0/2208526912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 msgr2=0x55fc45d3cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d3cef0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f46a0010eb0 tx=0x7f46a000ead0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 -- 172.21.15.5:0/2208526912 shutdown_connections 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d39650 0x55fc45d3f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 --2- 172.21.15.5:0/2208526912 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d38d30 0x55fc45d3cef0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 -- 172.21.15.5:0/2208526912 >> 172.21.15.5:0/2208526912 conn(0x55fc45d36b60 msgr2=0x55fc45d3d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 -- 172.21.15.5:0/2208526912 shutdown_connections 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 -- 172.21.15.5:0/2208526912 wait complete. 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.843+0000 7f46b43ba740 1 -- start start 2024-09-10T22:16:21.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 Processor -- start 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d38d30 0x55fc45d60300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d3f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d577f0 con 0x55fc45d39650 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d57120 con 0x55fc45d38d30 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55fc45d57ec0 con 0x55fc45d455e0 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46b43ba740 10 client.0 _ll_register_callbacks cb 0x7f46a0013cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d3f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d3f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43118/0 (socket says 172.21.15.5:43118) 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1302455818 learned_addr learned my addr 172.21.15.5:0/1302455818 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46aaffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d38d30 0x55fc45d60300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46aaffd640 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 msgr2=0x55fc45d3f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1302455818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d38d30 msgr2=0x55fc45d60300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d38d30 0x55fc45d60300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 -- 172.21.15.5:0/1302455818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc45d40090 con 0x55fc45d39650 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f46ab7fe640 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d3f410 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f469c009a20 tx=0x7f469c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1620154c502ca5f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.844+0000 7f468affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f468affd640 1 -- 172.21.15.5:0/1302455818 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469c035040 con 0x55fc45d39650 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f468affd640 1 -- 172.21.15.5:0/1302455818 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f469c004450 con 0x55fc45d39650 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46a000b340 con 0x55fc45d39650 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f468affd640 1 -- 172.21.15.5:0/1302455818 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f469c009520 con 0x55fc45d39650 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 10 client.15117 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:21.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55fc45dc2e40 con 0x55fc45d39650 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f468affd640 1 -- 172.21.15.5:0/1302455818 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f46a000b340 con 0x55fc45d39650 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f468affd640 1 -- 172.21.15.5:0/1302455818 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f469c053730 con 0x55fc45d39650 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 10 client.15117 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 10 client.15117 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 20 client.15117 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45dc75c0 0x55fc45dc62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 4 client.15117 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.845+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "status"}) -- 0x55fc45cae610 con 0x55fc45dc75c0 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46aaffd640 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45dc75c0 0x55fc45dc62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:21.852 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f468affd640 10 client.15117 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46aaffd640 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45dc75c0 0x55fc45dc62d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=591a77ff4d0fd05a server_cookie=4c87b2c60fb65455 in_seq=0 out_seq=0 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f468affd640 1 -- 172.21.15.5:0/1302455818 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fc45cae610 con 0x55fc45dc75c0 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f468affd640 10 client.15117 handle_command_reply: tid=0 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 client.15117 shutdown 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 msgr2=0x55fc45d3f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d3f410 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f469c009a20 tx=0x7f469c02a410 comp rx=0 tx=0).stop 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 shutdown_connections 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55fc45d455e0 0x55fc45d3f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55fc45d39650 0x55fc45d3f410 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55fc45dc75c0 0x55fc45dc62d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 --2- 172.21.15.5:0/1302455818 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55fc45d38d30 0x55fc45d60300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 >> 172.21.15.5:0/1302455818 conn(0x55fc45d36b60 msgr2=0x55fc45d43c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f468affd640 0 client.15117 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:21.853 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.846+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 shutdown_connections 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b43ba740 1 -- 172.21.15.5:0/1302455818 wait complete. 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b43ba740 20 client.15117 trim_cache size 0 max 16384 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24562, 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 69.451188975999997, 2024-09-10T22:16:21.854 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-10T22:16:21.855 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 78, 2024-09-10T22:16:21.855 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T22:16:21.855 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 98.730111609999994 2024-09-10T22:16:21.855 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:16:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f46940b5370 msgr2=0x7f46940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.855 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f46940b5370 0x7f46940b7830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f46a40a83c0 tx=0x7f46a4074f90 comp rx=0 tx=0).stop 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac108060 msgr2=0x7f46ac19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac108060 0x7f46ac19ebd0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f46a400be20 tx=0x7f46a400bf10 comp rx=0 tx=0).stop 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 shutdown_connections 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f46940b5370 0x7f46940b7830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f46ac108060 0x7f46ac19ebd0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f46ac1076e0 0x7f46ac199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 --2- 172.21.15.5:0/2456599224 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f46ac101cd0 0x7f46ac1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 >> 172.21.15.5:0/2456599224 conn(0x7f46ac0fd700 msgr2=0x7f46ac0fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 shutdown_connections 2024-09-10T22:16:21.856 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:21.847+0000 7f46b1fe5640 1 -- 172.21.15.5:0/2456599224 wait complete. 2024-09-10T22:16:22.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T22:16:22.845 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:23.240 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:23 smithi005 ceph-mon[31115]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.323+0000 7f2681286640 1 -- 172.21.15.5:0/617967190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c109130 msgr2=0x7f267c10f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.323+0000 7f2681286640 1 --2- 172.21.15.5:0/617967190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c109130 0x7f267c10f930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f266c009900 tx=0x7f266c02a410 comp rx=0 tx=0).stop 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 -- 172.21.15.5:0/617967190 shutdown_connections 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 --2- 172.21.15.5:0/617967190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c109130 0x7f267c10f930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 --2- 172.21.15.5:0/617967190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c1087b0 0x7f267c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 --2- 172.21.15.5:0/617967190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f267c102da0 0x7f267c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 -- 172.21.15.5:0/617967190 >> 172.21.15.5:0/617967190 conn(0x7f267c0fe850 msgr2=0x7f267c100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 -- 172.21.15.5:0/617967190 shutdown_connections 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 -- 172.21.15.5:0/617967190 wait complete. 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 Processor -- start 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 -- start start 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.324+0000 7f2681286640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c102da0 0x7f267c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 0x7f267c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f267c109130 0x7f267c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f267c112df0 con 0x7f267c1087b0 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f267c112c70 con 0x7f267c109130 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f267c112f70 con 0x7f267c102da0 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 0x7f267c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 0x7f267c199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46092/0 (socket says 172.21.15.5:46092) 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 -- 172.21.15.5:0/4217281858 learned_addr learned my addr 172.21.15.5:0/4217281858 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267b7fe640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f267c109130 0x7f267c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267affd640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c102da0 0x7f267c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 -- 172.21.15.5:0/4217281858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c102da0 msgr2=0x7f267c199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c102da0 0x7f267c199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 -- 172.21.15.5:0/4217281858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f267c109130 msgr2=0x7f267c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f267c109130 0x7f267c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 -- 172.21.15.5:0/4217281858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c19f3f0 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267affd640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c102da0 0x7f267c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f267a7fc640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 0x7f267c199880 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f266400b4a0 tx=0x7f266400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2673fff640 1 -- 172.21.15.5:0/4217281858 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664014070 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2673fff640 1 -- 172.21.15.5:0/4217281858 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2664010ac0 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267c19f6e0 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2673fff640 1 -- 172.21.15.5:0/4217281858 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664017c30 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.325+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f267c1a5da0 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.328+0000 7f2673fff640 1 -- 172.21.15.5:0/4217281858 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f2664010610 con 0x7f267c1087b0 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.328+0000 7f268365b740 1 Processor -- start 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.328+0000 7f268365b740 1 -- start start 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.328+0000 7f268365b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4c3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.328+0000 7f268365b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.328+0000 7f268365b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f268365b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5609af43ac10 con 0x5609af4c3650 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f268365b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609af42a040 con 0x5609af4d39f0 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f268365b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609af42de50 con 0x5609af4c2d30 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4d34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46094/0 (socket says 172.21.15.5:46094) 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 -- 172.21.15.5:0/4256621863 learned_addr learned my addr 172.21.15.5:0/4256621863 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267a7fc640 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267b7fe640 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 -- 172.21.15.5:0/4256621863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 msgr2=0x5609af4c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f2673fff640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26680b5370 0x7f26680b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4c3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 -- 172.21.15.5:0/4256621863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 msgr2=0x5609af4d5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 -- 172.21.15.5:0/4256621863 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af188540 con 0x5609af4c3650 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267b7fe640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26680b5370 0x7f26680b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f2673fff640 1 -- 172.21.15.5:0/4217281858 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f26640e5620 con 0x7f267c1087b0 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f267affd640 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4d34b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f26740103d0 tx=0x7f2674010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a789f62006eedc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.329+0000 7f26717fa640 1 -- 172.21.15.5:0/4256621863 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674016070 con 0x5609af4c3650 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f26717fa640 1 -- 172.21.15.5:0/4256621863 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2674012bc0 con 0x5609af4c3650 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f26717fa640 1 -- 172.21.15.5:0/4256621863 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f267401bd00 con 0x5609af4c3650 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 -- 172.21.15.5:0/4256621863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 msgr2=0x5609af4d34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f267b7fe640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26680b5370 0x7f26680b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f266c006010 tx=0x7f266c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4d34b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f26740103d0 tx=0x7f2674010890 comp rx=0 tx=0).stop 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 -- 172.21.15.5:0/4256621863 shutdown_connections 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4d34b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 --2- 172.21.15.5:0/4256621863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 -- 172.21.15.5:0/4256621863 >> 172.21.15.5:0/4256621863 conn(0x5609af4c0b60 msgr2=0x5609af4c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 -- 172.21.15.5:0/4256621863 shutdown_connections 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.330+0000 7f268365b740 1 -- 172.21.15.5:0/4256621863 wait complete. 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 -- start start 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 Processor -- start 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c3650 0x5609af4d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5609af28b5f0 con 0x5609af4c2d30 2024-09-10T22:16:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609af3c5010 con 0x5609af4d39f0 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609af4d66a0 con 0x5609af4c3650 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f268365b740 10 client.0 _ll_register_callbacks cb 0x5609af424340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f267affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f267affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4d09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46104/0 (socket says 172.21.15.5:46104) 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f267affd640 1 -- 172.21.15.5:0/1432892335 learned_addr learned my addr 172.21.15.5:0/1432892335 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c3650 0x5609af4d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.331+0000 7f267b7fe640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267affd640 1 -- 172.21.15.5:0/1432892335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c3650 msgr2=0x5609af4d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267affd640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c3650 0x5609af4d0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267affd640 1 -- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 msgr2=0x5609af4d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267affd640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267affd640 1 -- 172.21.15.5:0/1432892335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609af3f2a00 con 0x5609af4c2d30 2024-09-10T22:16:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267b7fe640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c3650 0x5609af4d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f267affd640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4d09f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2674000f80 tx=0x7f2674009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02c1585dbc43a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f26627fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f26627fc640 1 -- 172.21.15.5:0/1432892335 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674016030 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f26627fc640 1 -- 172.21.15.5:0/1432892335 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f267401bc90 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2674012bc0 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f26627fc640 1 -- 172.21.15.5:0/1432892335 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2674004a40 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f268365b740 10 client.15129 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5609af4e2290 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.332+0000 7f26627fc640 1 -- 172.21.15.5:0/1432892335 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2674012bc0 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f26627fc640 1 -- 172.21.15.5:0/1432892335 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f267400f040 con 0x5609af4c2d30 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f268365b740 10 client.15129 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f268365b740 10 client.15129 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f268365b740 20 client.15129 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f268365b740 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af4e46c0 0x5609af4e5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f268365b740 4 client.15129 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609af43cb60 con 0x5609af4e46c0 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.333+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af4e46c0 0x5609af4e5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af4e46c0 0x5609af4e5b30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbe7e24319d31203 server_cookie=6e6c3190c8a5406d in_seq=0 out_seq=0 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f26627fc640 10 client.15129 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f26627fc640 1 -- 172.21.15.5:0/1432892335 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5609af43cb60 con 0x5609af4e46c0 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f26627fc640 10 client.15129 handle_command_reply: tid=0 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f268365b740 1 client.15129 shutdown 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 msgr2=0x5609af4d09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.334+0000 7f268365b740 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4d09f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2674000f80 tx=0x7f2674009d70 comp rx=0 tx=0).stop 2024-09-10T22:16:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 shutdown_connections 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c3650 0x5609af4d0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af4e46c0 0x5609af4e5b30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 --2- 172.21.15.5:0/1432892335 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4d09f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f26627fc640 0 client.15129 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 >> 172.21.15.5:0/1432892335 conn(0x5609af4c0b60 msgr2=0x5609af4c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 shutdown_connections 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 1 -- 172.21.15.5:0/1432892335 wait complete. 2024-09-10T22:16:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.335+0000 7f268365b740 20 client.15129 trim_cache size 0 max 16384 2024-09-10T22:16:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.353+0000 7f268365b740 1 Processor -- start 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.353+0000 7f268365b740 1 -- start start 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f268365b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f268365b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4c3650 0x5609af4ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f268365b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4d39f0 0x5609af4bbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f268365b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5609af4e3e70 con 0x5609af4c2d30 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f268365b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609af4e4540 con 0x5609af4c3650 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f268365b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609af4e4c10 con 0x5609af4d39f0 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46118/0 (socket says 172.21.15.5:46118) 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 -- 172.21.15.5:0/2216455200 learned_addr learned my addr 172.21.15.5:0/2216455200 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267a7fc640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4c3650 0x5609af4ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267b7fe640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4d39f0 0x5609af4bbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 -- 172.21.15.5:0/2216455200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4d39f0 msgr2=0x5609af4bbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4d39f0 0x5609af4bbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 -- 172.21.15.5:0/2216455200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4c3650 msgr2=0x5609af4ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4c3650 0x5609af4ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 -- 172.21.15.5:0/2216455200 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609af4cef10 con 0x5609af4c2d30 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267a7fc640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4c3650 0x5609af4ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267b7fe640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4d39f0 0x5609af4bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.354+0000 7f267affd640 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4c04f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2674002230 tx=0x7f2674009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3aedc4bcb4e681 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f2670ff9640 1 -- 172.21.15.5:0/2216455200 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674016070 con 0x5609af4c2d30 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f2670ff9640 1 -- 172.21.15.5:0/2216455200 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2674035030 con 0x5609af4c2d30 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f2670ff9640 1 -- 172.21.15.5:0/2216455200 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2674012a00 con 0x5609af4c2d30 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 -- 172.21.15.5:0/2216455200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 msgr2=0x5609af4c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.365 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4c04f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2674002230 tx=0x7f2674009f30 comp rx=0 tx=0).stop 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 -- 172.21.15.5:0/2216455200 shutdown_connections 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4d39f0 0x5609af4bbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4c3650 0x5609af4ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 --2- 172.21.15.5:0/2216455200 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c2d30 0x5609af4c04f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 -- 172.21.15.5:0/2216455200 >> 172.21.15.5:0/2216455200 conn(0x5609af4c0b60 msgr2=0x5609af4d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 -- 172.21.15.5:0/2216455200 shutdown_connections 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.355+0000 7f268365b740 1 -- 172.21.15.5:0/2216455200 wait complete. 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 -- start start 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 Processor -- start 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5609af4e59b0 con 0x5609af4c3650 2024-09-10T22:16:23.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5609af4e52e0 con 0x5609af4d39f0 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5609af4e6080 con 0x5609af4c2d30 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f268365b740 10 client.0 _ll_register_callbacks cb 0x7f2674009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46134/0 (socket says 172.21.15.5:46134) 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 -- 172.21.15.5:0/1148759549 learned_addr learned my addr 172.21.15.5:0/1148759549 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267affd640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267b7fe640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 -- 172.21.15.5:0/1148759549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 msgr2=0x5609af4cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 -- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 msgr2=0x5609af4c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.356+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f267a7fc640 1 -- 172.21.15.5:0/1148759549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609af4ce9f0 con 0x5609af4c3650 2024-09-10T22:16:23.367 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f267b7fe640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f267a7fc640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4ce260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f266400b470 tx=0x7f26640ab4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2fbd1d2796376d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f26627fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f26627fc640 1 -- 172.21.15.5:0/1148759549 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266401e040 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f26627fc640 1 -- 172.21.15.5:0/1148759549 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f26640e3250 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2674035030 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f26627fc640 1 -- 172.21.15.5:0/1148759549 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f26640ab7c0 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f268365b740 10 client.15135 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5609af4ed350 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f26627fc640 1 -- 172.21.15.5:0/1148759549 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2674035030 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f26627fc640 1 -- 172.21.15.5:0/1148759549 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f26640a7f20 con 0x5609af4c3650 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f268365b740 10 client.15135 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.357+0000 7f268365b740 10 client.15135 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f268365b740 20 client.15135 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:23.368 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f268365b740 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af556160 0x5609af554e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f268365b740 4 client.15135 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "status"}) -- 0x5609af438610 con 0x5609af556160 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f267affd640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af556160 0x5609af554e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f267affd640 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af556160 0x5609af554e70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=754de2abc3834a4a server_cookie=dee538fb3a6ea053 in_seq=0 out_seq=0 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f26627fc640 10 client.15135 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f26627fc640 1 -- 172.21.15.5:0/1148759549 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5609af438610 con 0x5609af556160 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f26627fc640 10 client.15135 handle_command_reply: tid=0 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.358+0000 7f268365b740 1 client.15135 shutdown 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 msgr2=0x5609af4ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4ce260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f266400b470 tx=0x7f26640ab4e0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 shutdown_connections 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5609af4d39f0 0x5609af4c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5609af556160 0x5609af554e70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5609af4c3650 0x5609af4ce260 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 --2- 172.21.15.5:0/1148759549 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5609af4c2d30 0x5609af4cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f26627fc640 0 client.15135 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 >> 172.21.15.5:0/1148759549 conn(0x5609af4c0b60 msgr2=0x5609af4d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 shutdown_connections 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 1 -- 172.21.15.5:0/1148759549 wait complete. 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f268365b740 20 client.15135 trim_cache size 0 max 16384 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:16:23.370 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24563, 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 71.980573815, 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 78, 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 102.808548792 2024-09-10T22:16:23.371 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:16:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26680b5370 msgr2=0x7f26680b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26680b5370 0x7f26680b7830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f266c006010 tx=0x7f266c0058d0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 msgr2=0x7f267c199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:23.372 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 0x7f267c199880 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f266400b4a0 tx=0x7f266400b960 comp rx=0 tx=0).stop 2024-09-10T22:16:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 shutdown_connections 2024-09-10T22:16:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f26680b5370 0x7f26680b7830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.373 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f267c109130 0x7f267c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f267c1087b0 0x7f267c199880 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 --2- 172.21.15.5:0/4217281858 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f267c102da0 0x7f267c199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.359+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 >> 172.21.15.5:0/4217281858 conn(0x7f267c0fe850 msgr2=0x7f267c100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.360+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 shutdown_connections 2024-09-10T22:16:23.374 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:23.360+0000 7f2681286640 1 -- 172.21.15.5:0/4217281858 wait complete. 2024-09-10T22:16:23.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:23 smithi189 ceph-mon[35784]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:23.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:23 smithi052 ceph-mon[34997]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:24.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T22:16:24.299 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:24.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 -- 172.21.15.5:0/1922238558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79341087d0 msgr2=0x7f7934108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 --2- 172.21.15.5:0/1922238558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79341087d0 0x7f7934108c10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7920009900 tx=0x7f792002a410 comp rx=0 tx=0).stop 2024-09-10T22:16:24.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 -- 172.21.15.5:0/1922238558 shutdown_connections 2024-09-10T22:16:24.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 --2- 172.21.15.5:0/1922238558 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934109150 0x7f793410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 --2- 172.21.15.5:0/1922238558 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f79341087d0 0x7f7934108c10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 --2- 172.21.15.5:0/1922238558 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7934102dc0 0x7f79341031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 -- 172.21.15.5:0/1922238558 >> 172.21.15.5:0/1922238558 conn(0x7f79340fe830 msgr2=0x7f7934100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 -- 172.21.15.5:0/1922238558 shutdown_connections 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.805+0000 7f793b03d640 1 -- 172.21.15.5:0/1922238558 wait complete. 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 Processor -- start 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 -- start start 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 0x7f7934199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79341087d0 0x7f79341997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934109150 0x7f793419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112e60 con 0x7f7934102dc0 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112ce0 con 0x7f7934109150 2024-09-10T22:16:24.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f793b03d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112fe0 con 0x7f79341087d0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f7938dd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 0x7f7934199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f7938dd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 0x7f7934199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46166/0 (socket says 172.21.15.5:46166) 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f7938dd9640 1 -- 172.21.15.5:0/2579779107 learned_addr learned my addr 172.21.15.5:0/2579779107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.806+0000 7f7933fff640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79341087d0 0x7f79341997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f79395da640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934109150 0x7f793419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7938dd9640 1 -- 172.21.15.5:0/2579779107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79341087d0 msgr2=0x7f79341997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7938dd9640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79341087d0 0x7f79341997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7938dd9640 1 -- 172.21.15.5:0/2579779107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934109150 msgr2=0x7f793419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7938dd9640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934109150 0x7f793419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7938dd9640 1 -- 172.21.15.5:0/2579779107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793419f320 con 0x7f7934102dc0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7938dd9640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 0x7f7934199270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f792800c890 tx=0x7f792800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7931ffb640 1 -- 172.21.15.5:0/2579779107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928004220 con 0x7f7934102dc0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7931ffb640 1 -- 172.21.15.5:0/2579779107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79280043c0 con 0x7f7934102dc0 2024-09-10T22:16:24.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793419f610 con 0x7f7934102dc0 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f7931ffb640 1 -- 172.21.15.5:0/2579779107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928004a00 con 0x7f7934102dc0 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.807+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341a5ea0 con 0x7f7934102dc0 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f7931ffb640 1 -- 172.21.15.5:0/2579779107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f79280079b0 con 0x7f7934102dc0 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 Processor -- start 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 -- start start 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d62520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d6e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d70de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564e30cd5c10 con 0x564e30d6e9f0 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e30cc5040 con 0x564e30d62a60 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f793d412740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564e30cc8e50 con 0x564e30d62140 2024-09-10T22:16:24.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f7933fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d70de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f7933fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d70de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46176/0 (socket says 172.21.15.5:46176) 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f7933fff640 1 -- 172.21.15.5:0/4179693336 learned_addr learned my addr 172.21.15.5:0/4179693336 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f79395da640 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d62520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.810+0000 7f7938dd9640 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d6e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7931ffb640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f79240b53f0 0x7f79240b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7933fff640 1 -- 172.21.15.5:0/4179693336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 msgr2=0x564e30d62520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7933fff640 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d62520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7933fff640 1 -- 172.21.15.5:0/4179693336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 msgr2=0x564e30d6e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7933fff640 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d6e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7933fff640 1 -- 172.21.15.5:0/4179693336 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e30a23540 con 0x564e30d6e9f0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f79395da640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f79240b53f0 0x7f79240b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7931ffb640 1 -- 172.21.15.5:0/2579779107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f79280e59a0 con 0x7f7934102dc0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f7933fff640 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d70de0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7920009230 tx=0x7f7920004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbc3152f1a77eef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f791effd640 1 -- 172.21.15.5:0/4179693336 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920035040 con 0x564e30d6e9f0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f791effd640 1 -- 172.21.15.5:0/4179693336 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7920004770 con 0x564e30d6e9f0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.811+0000 7f791effd640 1 -- 172.21.15.5:0/4179693336 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920003850 con 0x564e30d6e9f0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 -- 172.21.15.5:0/4179693336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 msgr2=0x564e30d70de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d70de0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7920009230 tx=0x7f7920004310 comp rx=0 tx=0).stop 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f79395da640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f79240b53f0 0x7f79240b78b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098b0 tx=0x7f792c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 -- 172.21.15.5:0/4179693336 shutdown_connections 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d70de0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d6e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 --2- 172.21.15.5:0/4179693336 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d62520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 -- 172.21.15.5:0/4179693336 >> 172.21.15.5:0/4179693336 conn(0x564e30d5ff70 msgr2=0x564e30d61110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 -- 172.21.15.5:0/4179693336 shutdown_connections 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 -- 172.21.15.5:0/4179693336 wait complete. 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 -- start start 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.812+0000 7f793d412740 1 Processor -- start 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 0x564e30d6b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62a60 0x564e30d6bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d6e9f0 0x564e30d6c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564e30b265f0 con 0x564e30d62140 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e30c60010 con 0x564e30d6e9f0 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564e30d71610 con 0x564e30d62a60 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f793d412740 10 client.0 _ll_register_callbacks cb 0x564e30cbf340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 0x564e30d6b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 0x564e30d6b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46182/0 (socket says 172.21.15.5:46182) 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 -- 172.21.15.5:0/1101776644 learned_addr learned my addr 172.21.15.5:0/1101776644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f79395da640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d6e9f0 0x564e30d6c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7933fff640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62a60 0x564e30d6bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 -- 172.21.15.5:0/1101776644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62a60 msgr2=0x564e30d6bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62a60 0x564e30d6bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 -- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d6e9f0 msgr2=0x564e30d6c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d6e9f0 0x564e30d6c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 -- 172.21.15.5:0/1101776644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e30c8da00 con 0x564e30d62140 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f79395da640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d6e9f0 0x564e30d6c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7933fff640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62a60 0x564e30d6bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7938dd9640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 0x564e30d6b9b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79280a9350 tx=0x7f79280e3800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac0e7a87252247 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.813+0000 7f7913fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f7913fff640 1 -- 172.21.15.5:0/1101776644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792801d040 con 0x564e30d62140 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7920004770 con 0x564e30d62140 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f7913fff640 1 -- 172.21.15.5:0/1101776644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f79280ab540 con 0x564e30d62140 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f7913fff640 1 -- 172.21.15.5:0/1101776644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f79280ab850 con 0x564e30d62140 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 10 client.15147 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:24.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e30d7d200 con 0x564e30d62140 2024-09-10T22:16:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f7913fff640 1 -- 172.21.15.5:0/1101776644 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7920004770 con 0x564e30d62140 2024-09-10T22:16:24.825 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f7913fff640 1 -- 172.21.15.5:0/1101776644 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f79280971b0 con 0x564e30d62140 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 10 client.15147 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 20 client.15147 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30d7f840 0x564e30d80cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 4 client.15147 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.814+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e30cd7b60 con 0x564e30d7f840 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.815+0000 7f7933fff640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30d7f840 0x564e30d80cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.816+0000 7f7933fff640 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30d7f840 0x564e30d80cb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae5f5ca533fbf6bf server_cookie=22966948f75b70e1 in_seq=0 out_seq=0 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.816+0000 7f7913fff640 10 client.15147 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.816+0000 7f7913fff640 1 -- 172.21.15.5:0/1101776644 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e30cd7b60 con 0x564e30d7f840 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.816+0000 7f7913fff640 10 client.15147 handle_command_reply: tid=0 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.816+0000 7f793d412740 1 client.15147 shutdown 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 msgr2=0x564e30d6b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 0x564e30d6b9b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f79280a9350 tx=0x7f79280e3800 comp rx=0 tx=0).stop 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 shutdown_connections 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30d7f840 0x564e30d80cb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d6e9f0 0x564e30d6c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f7913fff640 0 client.15147 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62a60 0x564e30d6bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 --2- 172.21.15.5:0/1101776644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62140 0x564e30d6b9b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 >> 172.21.15.5:0/1101776644 conn(0x564e30d5ff70 msgr2=0x564e30d5ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:24.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 shutdown_connections 2024-09-10T22:16:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 1 -- 172.21.15.5:0/1101776644 wait complete. 2024-09-10T22:16:24.828 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.817+0000 7f793d412740 20 client.15147 trim_cache size 0 max 16384 2024-09-10T22:16:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 Processor -- start 2024-09-10T22:16:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 -- start start 2024-09-10T22:16:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62140 0x564e30d80cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 0x564e30d7e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d6e9f0 0x564e30d66c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564e30d7eff0 con 0x564e30d62a60 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e30d7f6c0 con 0x564e30d62140 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f793d412740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564e30d7fd90 con 0x564e30d6e9f0 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f7933fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 0x564e30d7e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f7933fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 0x564e30d7e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46196/0 (socket says 172.21.15.5:46196) 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f7933fff640 1 -- 172.21.15.5:0/1165977306 learned_addr learned my addr 172.21.15.5:0/1165977306 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.835+0000 7f7938dd9640 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62140 0x564e30d80cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f79395da640 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d6e9f0 0x564e30d66c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f7933fff640 1 -- 172.21.15.5:0/1165977306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d6e9f0 msgr2=0x564e30d66c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f7933fff640 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d6e9f0 0x564e30d66c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f7933fff640 1 -- 172.21.15.5:0/1165977306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62140 msgr2=0x564e30d80cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f7933fff640 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62140 0x564e30d80cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f7933fff640 1 -- 172.21.15.5:0/1165977306 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e30d609f0 con 0x564e30d62a60 2024-09-10T22:16:24.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f79395da640 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d6e9f0 0x564e30d66c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f7933fff640 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 0x564e30d7e670 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7920009900 tx=0x7f7920009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6cf72539f96937 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f791e7fc640 1 -- 172.21.15.5:0/1165977306 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7920035040 con 0x564e30d62a60 2024-09-10T22:16:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f791e7fc640 1 -- 172.21.15.5:0/1165977306 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7920004770 con 0x564e30d62a60 2024-09-10T22:16:24.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.836+0000 7f791e7fc640 1 -- 172.21.15.5:0/1165977306 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792003c6a0 con 0x564e30d62a60 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 -- 172.21.15.5:0/1165977306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 msgr2=0x564e30d7e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 0x564e30d7e670 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7920009900 tx=0x7f7920009260 comp rx=0 tx=0).stop 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 -- 172.21.15.5:0/1165977306 shutdown_connections 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d6e9f0 0x564e30d66c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d62a60 0x564e30d7e670 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 --2- 172.21.15.5:0/1165977306 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62140 0x564e30d80cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 -- 172.21.15.5:0/1165977306 >> 172.21.15.5:0/1165977306 conn(0x564e30d5ff70 msgr2=0x564e30d56c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 -- 172.21.15.5:0/1165977306 shutdown_connections 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 -- 172.21.15.5:0/1165977306 wait complete. 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 -- start start 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.837+0000 7f793d412740 1 Processor -- start 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d83010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d83550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d83a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564e30d80b30 con 0x564e30d6e9f0 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564e30d80460 con 0x564e30d62a60 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564e30d81200 con 0x564e30d62140 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f793d412740 10 client.0 _ll_register_callbacks cb 0x7f7928004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d83a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d83a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46210/0 (socket says 172.21.15.5:46210) 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 -- 172.21.15.5:0/2516376147 learned_addr learned my addr 172.21.15.5:0/2516376147 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f7933fff640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d83550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f7938dd9640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d83010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 -- 172.21.15.5:0/2516376147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 msgr2=0x564e30d83010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d83010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 -- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 msgr2=0x564e30d83550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d83550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 -- 172.21.15.5:0/2516376147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e30d88950 con 0x564e30d6e9f0 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f7933fff640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d83550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:16:24.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f79395da640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d83a90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f792c013a80 tx=0x7f792c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38213b15bad8133c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.838+0000 7f7913fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f7913fff640 1 -- 172.21.15.5:0/2516376147 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c01fb80 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f7913fff640 1 -- 172.21.15.5:0/2516376147 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f792c01fd20 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7920004770 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f7913fff640 1 -- 172.21.15.5:0/2516376147 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f792c01c430 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 10 client.15153 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e30dec5f0 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f7913fff640 1 -- 172.21.15.5:0/2516376147 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7920004770 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f7913fff640 1 -- 172.21.15.5:0/2516376147 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f792c00f040 con 0x564e30d6e9f0 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 10 client.15153 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 10 client.15153 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 20 client.15153 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:24.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30df1240 0x564e30deff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 4 client.15153 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.839+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "status"}) -- 0x564e30cd3610 con 0x564e30df1240 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f7938dd9640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30df1240 0x564e30deff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f7938dd9640 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30df1240 0x564e30deff50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f7ca1e7410cb08 server_cookie=3e45686f848201e7 in_seq=0 out_seq=0 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f7913fff640 10 client.15153 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f7913fff640 1 -- 172.21.15.5:0/2516376147 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564e30cd3610 con 0x564e30df1240 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f7913fff640 10 client.15153 handle_command_reply: tid=0 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f793d412740 1 client.15153 shutdown 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 msgr2=0x564e30d83a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f793d412740 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d83a90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f792c013a80 tx=0x7f792c004ab0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.840+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 shutdown_connections 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564e30df1240 0x564e30deff50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564e30d6e9f0 0x564e30d83a90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564e30d62a60 0x564e30d83550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 --2- 172.21.15.5:0/2516376147 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564e30d62140 0x564e30d83010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f7913fff640 0 client.15153 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 >> 172.21.15.5:0/2516376147 conn(0x564e30d5ff70 msgr2=0x564e30d66c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 shutdown_connections 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 1 -- 172.21.15.5:0/2516376147 wait complete. 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793d412740 20 client.15153 trim_cache size 0 max 16384 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24578, 2024-09-10T22:16:24.848 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 81.499643718000002, 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 78, 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 92.674934554999993 2024-09-10T22:16:24.849 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f79240b53f0 msgr2=0x7f79240b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793b03d640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f79240b53f0 0x7f79240b78b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f792c0098b0 tx=0x7f792c004a40 comp rx=0 tx=0).stop 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 msgr2=0x7f7934199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.841+0000 7f793b03d640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 0x7f7934199270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f792800c890 tx=0x7f792800cd50 comp rx=0 tx=0).stop 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 shutdown_connections 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f79240b53f0 0x7f79240b78b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7934109150 0x7f793419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f79341087d0 0x7f79341997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 --2- 172.21.15.5:0/2579779107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7934102dc0 0x7f7934199270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:24.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 >> 172.21.15.5:0/2579779107 conn(0x7f79340fe830 msgr2=0x7f7934100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 shutdown_connections 2024-09-10T22:16:24.851 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:24.842+0000 7f793b03d640 1 -- 172.21.15.5:0/2579779107 wait complete. 2024-09-10T22:16:25.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:25 smithi189 ceph-mon[35784]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:25.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:25 smithi052 ceph-mon[34997]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:25.504 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:25 smithi005 ceph-mon[31115]: pgmap v333: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:25.534 INFO:tasks.cephadm:Setup complete, yielding 2024-09-10T22:16:25.534 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T22:16:25.543 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:16:25.544 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-10T22:16:25.800 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 -- 172.21.15.5:0/1807634774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014106560 msgr2=0x7f4014111220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 --2- 172.21.15.5:0/1807634774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014106560 0x7f4014111220 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f400c009ca0 tx=0x7f400c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 -- 172.21.15.5:0/1807634774 shutdown_connections 2024-09-10T22:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 --2- 172.21.15.5:0/1807634774 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f4014106560 0x7f4014111220 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 --2- 172.21.15.5:0/1807634774 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4014075b20 0x7f4014075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 --2- 172.21.15.5:0/1807634774 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014076f80 0x7f40140755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 -- 172.21.15.5:0/1807634774 >> 172.21.15.5:0/1807634774 conn(0x7f40140fe2f0 msgr2=0x7f4014100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 -- 172.21.15.5:0/1807634774 shutdown_connections 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.291+0000 7f401bc4f640 1 -- 172.21.15.5:0/1807634774 wait complete. 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 Processor -- start 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 -- start start 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 0x7f401419f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4014076f80 0x7f401419f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40141a05f0 0x7f40141a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f4014114ca0 con 0x7f40141a05f0 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f4014114b20 con 0x7f4014076f80 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401bc4f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f4014114e20 con 0x7f4014075b20 2024-09-10T22:16:26.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f40199eb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 0x7f401419f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401a1ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40141a05f0 0x7f40141a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f40199eb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 0x7f401419f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:54566/0 (socket says 172.21.15.5:54566) 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f40199eb640 1 -- 172.21.15.5:0/2808920271 learned_addr learned my addr 172.21.15.5:0/2808920271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f40191ea640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4014076f80 0x7f401419f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401a1ec640 1 -- 172.21.15.5:0/2808920271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 msgr2=0x7f401419f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401a1ec640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 0x7f401419f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401a1ec640 1 -- 172.21.15.5:0/2808920271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4014076f80 msgr2=0x7f401419f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401a1ec640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4014076f80 0x7f401419f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f401a1ec640 1 -- 172.21.15.5:0/2808920271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40141a1270 con 0x7f40141a05f0 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.292+0000 7f40199eb640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 0x7f401419f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.293+0000 7f401a1ec640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40141a05f0 0x7f40141a0aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f400c031a20 tx=0x7f400c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.293+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c02f380 con 0x7f40141a05f0 2024-09-10T22:16:26.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.293+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f400c0317c0 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.293+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40141a7690 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.293+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c02fba0 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.293+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40141a7b40 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.294+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4014106560 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.296+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f400c02fd40 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.297+0000 7f400affd640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40000b5590 0x7f40000b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.297+0000 7f40199eb640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40000b5590 0x7f40000b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.297+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f400c107100 con 0x7f40141a05f0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.297+0000 7f40199eb640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40000b5590 0x7f40000b7a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4010005fd0 tx=0x7f401000b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:26.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.300+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f400c0cde30 con 0x7f40141a05f0 2024-09-10T22:16:26.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.504+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f40140ff020 con 0x7f40000b5590 2024-09-10T22:16:26.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.505+0000 7f400affd640 1 -- 172.21.15.5:0/2808920271 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f40140ff020 con 0x7f40000b5590 2024-09-10T22:16:26.507 INFO:teuthology.orchestra.run.smithi005.stdout:Backend: cephadm 2024-09-10T22:16:26.507 INFO:teuthology.orchestra.run.smithi005.stdout:Available: Yes 2024-09-10T22:16:26.507 INFO:teuthology.orchestra.run.smithi005.stdout:Paused: No 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40000b5590 msgr2=0x7f40000b7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40000b5590 0x7f40000b7a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4010005fd0 tx=0x7f401000b4a0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40141a05f0 msgr2=0x7f40141a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40141a05f0 0x7f40141a0aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f400c031a20 tx=0x7f400c003ba0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 shutdown_connections 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40000b5590 0x7f40000b7a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.510 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40141a05f0 0x7f40141a0aa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f4014076f80 0x7f401419f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 --2- 172.21.15.5:0/2808920271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f4014075b20 0x7f401419f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 >> 172.21.15.5:0/2808920271 conn(0x7f40140fe2f0 msgr2=0x7f40140fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 shutdown_connections 2024-09-10T22:16:26.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:26.509+0000 7f401bc4f640 1 -- 172.21.15.5:0/2808920271 wait complete. 2024-09-10T22:16:27.209 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:27 smithi005 ceph-mon[31115]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:27.211 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-10T22:16:27.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:27 smithi189 ceph-mon[35784]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:27.467 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:27.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:27 smithi052 ceph-mon[34997]: pgmap v334: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:16:27.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 -- 172.21.15.5:0/298410802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988101950 msgr2=0x7fe988101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 --2- 172.21.15.5:0/298410802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988101950 0x7fe988101d50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe984009cd0 tx=0x7fe98402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:16:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 -- 172.21.15.5:0/298410802 shutdown_connections 2024-09-10T22:16:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 --2- 172.21.15.5:0/298410802 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988103470 0x7fe988109df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 --2- 172.21.15.5:0/298410802 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988102ab0 0x7fe988102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 --2- 172.21.15.5:0/298410802 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988101950 0x7fe988101d50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:27.936 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 -- 172.21.15.5:0/298410802 >> 172.21.15.5:0/298410802 conn(0x7fe9880fd200 msgr2=0x7fe9880ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 -- 172.21.15.5:0/298410802 shutdown_connections 2024-09-10T22:16:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.932+0000 7fe98f38e640 1 -- 172.21.15.5:0/298410802 wait complete. 2024-09-10T22:16:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 Processor -- start 2024-09-10T22:16:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 -- start start 2024-09-10T22:16:27.937 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988101950 0x7fe988105710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 0x7fe988103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988103470 0x7fe9881044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe98810d5b0 con 0x7fe988102ab0 2024-09-10T22:16:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe98810d430 con 0x7fe988101950 2024-09-10T22:16:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98f38e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe98810d730 con 0x7fe988103470 2024-09-10T22:16:27.938 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98c929640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 0x7fe988103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98c929640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 0x7fe988103f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46240/0 (socket says 172.21.15.5:46240) 2024-09-10T22:16:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98c929640 1 -- 172.21.15.5:0/1316866522 learned_addr learned my addr 172.21.15.5:0/1316866522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98d92b640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988103470 0x7fe9881044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.933+0000 7fe98d12a640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988101950 0x7fe988105710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98c929640 1 -- 172.21.15.5:0/1316866522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988103470 msgr2=0x7fe9881044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:27.939 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98c929640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988103470 0x7fe9881044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98c929640 1 -- 172.21.15.5:0/1316866522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988101950 msgr2=0x7fe988105710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98c929640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988101950 0x7fe988105710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98c929640 1 -- 172.21.15.5:0/1316866522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe988104d80 con 0x7fe988102ab0 2024-09-10T22:16:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98d92b640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988103470 0x7fe9881044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:16:27.940 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98d12a640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988101950 0x7fe988105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98c929640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 0x7fe988103f80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe97800d950 tx=0x7fe97800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe978017030 con 0x7fe988102ab0 2024-09-10T22:16:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe978004020 con 0x7fe988102ab0 2024-09-10T22:16:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9881a2fa0 con 0x7fe988102ab0 2024-09-10T22:16:27.941 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9780047a0 con 0x7fe988102ab0 2024-09-10T22:16:27.942 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.934+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9881a34b0 con 0x7fe988102ab0 2024-09-10T22:16:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.935+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe988101d50 con 0x7fe988102ab0 2024-09-10T22:16:27.943 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.936+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fe978009a30 con 0x7fe988102ab0 2024-09-10T22:16:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.937+0000 7fe97e7fc640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9740b5370 0x7fe9740b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.938+0000 7fe98d12a640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9740b5370 0x7fe9740b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.938+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe9780e5e20 con 0x7fe988102ab0 2024-09-10T22:16:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.938+0000 7fe98d12a640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9740b5370 0x7fe9740b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe984031900 tx=0x7fe984005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:27.944 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:27.941+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe9780acbb0 con 0x7fe988102ab0 2024-09-10T22:16:28.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.137+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe9880ff400 con 0x7fe9740b5370 2024-09-10T22:16:28.151 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.150+0000 7fe97e7fc640 1 -- 172.21.15.5:0/1316866522 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7fe9880ff400 con 0x7fe9740b5370 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.a smithi005 running (99s) 17s ago 98s 13.5M - 19.3.0-4854-g8f219c47 589dd18248e4 b62c411c7205 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.b smithi052 running (96s) 29s ago 95s 26.1M - 19.3.0-4854-g8f219c47 589dd18248e4 1ad476cfd7f0 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.c smithi189 running (110s) 29s ago 110s 19.8M - 19.3.0-4854-g8f219c47 589dd18248e4 6d4195475644 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.d smithi005 running (118s) 17s ago 118s 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 5582575942e5 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.e smithi052 running (116s) 29s ago 115s 17.2M - 19.3.0-4854-g8f219c47 589dd18248e4 9b5a939d2dae 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.f smithi189 running (113s) 29s ago 112s 18.7M - 19.3.0-4854-g8f219c47 589dd18248e4 228d9640dd4f 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.g smithi005 running (102s) 17s ago 102s 14.2M - 19.3.0-4854-g8f219c47 589dd18248e4 add2f3e8e8fc 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.h smithi052 running (107s) 29s ago 107s 18.5M - 19.3.0-4854-g8f219c47 589dd18248e4 20f93db48f99 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.i smithi189 running (105s) 29s ago 104s 17.1M - 19.3.0-4854-g8f219c47 589dd18248e4 b9bd5d88a362 2024-09-10T22:16:28.152 INFO:teuthology.orchestra.run.smithi005.stdout:mds.j smithi005 running (2m) 17s ago 2m 14.6M - 19.3.0-4854-g8f219c47 589dd18248e4 724bdcefc74a 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mds.k smithi052 running (2m) 29s ago 2m 14.7M - 19.3.0-4854-g8f219c47 589dd18248e4 ee82bd925b2f 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mds.l smithi189 running (2m) 29s ago 2m 16.9M - 19.3.0-4854-g8f219c47 589dd18248e4 549d5691079d 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi005 *:9283,8765 running (9m) 17s ago 9m 523M - 19.3.0-4854-g8f219c47 589dd18248e4 91187bfe8cd9 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi052 *:8443,8765 running (7m) 29s ago 7m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 211f7d5ca89b 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.z smithi189 *:8443,8765 running (7m) 29s ago 7m 455M - 19.3.0-4854-g8f219c47 589dd18248e4 4db7ef2f0d55 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (9m) 17s ago 9m 51.4M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 a756bc48a70a 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi052 running (8m) 29s ago 8m 44.3M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 9a004c76f3f1 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi189 running (8m) 29s ago 8m 41.0M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 e7d643b897dc 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 17s ago 7m 48.2M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 bc4beb3b7d0b 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi052 running (6m) 29s ago 6m 47.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 e4f6f495ec97 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi189 running (6m) 29s ago 6m 46.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 63bd245be75a 2024-09-10T22:16:28.153 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (5m) 17s ago 5m 44.0M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 f9bbcf0df8e3 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi052 running (5m) 29s ago 5m 43.4M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 fe15f227ca91 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi189 running (5m) 29s ago 5m 56.1M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 22bb2fcf7ac2 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi005 running (4m) 17s ago 4m 43.7M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 bf167e0454e5 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi052 running (4m) 29s ago 4m 57.1M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 9c0203f62391 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 smithi189 running (3m) 29s ago 3m 51.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 9776228a2730 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 smithi005 running (3m) 17s ago 3m 41.6M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 c65f27fadc2e 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 smithi052 running (2m) 29s ago 2m 54.0M 4273M 19.3.0-4854-g8f219c47 589dd18248e4 24fb425c50e0 2024-09-10T22:16:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 smithi189 running (2m) 29s ago 2m 52.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 76f6f61d68f1 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9740b5370 msgr2=0x7fe9740b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9740b5370 0x7fe9740b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe984031900 tx=0x7fe984005ef0 comp rx=0 tx=0).stop 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 msgr2=0x7fe988103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 0x7fe988103f80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe97800d950 tx=0x7fe97800de10 comp rx=0 tx=0).stop 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 shutdown_connections 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9740b5370 0x7fe9740b7830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:28.155 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe988103470 0x7fe9881044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe988102ab0 0x7fe988103f80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 --2- 172.21.15.5:0/1316866522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe988101950 0x7fe988105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 >> 172.21.15.5:0/1316866522 conn(0x7fe9880fd200 msgr2=0x7fe9880fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 shutdown_connections 2024-09-10T22:16:28.156 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:28.153+0000 7fe98f38e640 1 -- 172.21.15.5:0/1316866522 wait complete. 2024-09-10T22:16:28.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:28 smithi189 ceph-mon[35784]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:28.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:28 smithi052 ceph-mon[34997]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:28.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:28 smithi005 ceph-mon[31115]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:28.847 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-10T22:16:29.109 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:29.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:29 smithi005 ceph-mon[31115]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:29.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:29 smithi005 ceph-mon[31115]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:29.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:29 smithi189 ceph-mon[35784]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:29.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:29 smithi189 ceph-mon[35784]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:29.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:29 smithi052 ceph-mon[34997]: pgmap v335: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:29.500 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:29 smithi052 ceph-mon[34997]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.592+0000 7fc44b9b0640 1 -- 172.21.15.5:0/3339327358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 msgr2=0x7fc4441079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.592+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/3339327358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc4441079f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc434009ca0 tx=0x7fc43402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.592+0000 7fc44b9b0640 1 -- 172.21.15.5:0/3339327358 shutdown_connections 2024-09-10T22:16:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/3339327358 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 0x7fc44410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/3339327358 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc444107f30 0x7fc44410a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.594 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/3339327358 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc4441079f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 -- 172.21.15.5:0/3339327358 >> 172.21.15.5:0/3339327358 conn(0x7fc4440fd1e0 msgr2=0x7fc4440ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 -- 172.21.15.5:0/3339327358 shutdown_connections 2024-09-10T22:16:29.595 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 -- 172.21.15.5:0/3339327358 wait complete. 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 Processor -- start 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 -- start start 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.593+0000 7fc44b9b0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc44419b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc444107f30 0x7fc44419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 0x7fc44419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc444110910 con 0x7fc44406b5d0 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc444110790 con 0x7fc44410a940 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc444110a90 con 0x7fc444107f30 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc44419b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc44419b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46262/0 (socket says 172.21.15.5:46262) 2024-09-10T22:16:29.597 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 -- 172.21.15.5:0/4127891434 learned_addr learned my addr 172.21.15.5:0/4127891434 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc449f4d640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 0x7fc44419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc448f4b640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc444107f30 0x7fc44419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 -- 172.21.15.5:0/4127891434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc444107f30 msgr2=0x7fc44419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc444107f30 0x7fc44419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 -- 172.21.15.5:0/4127891434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 msgr2=0x7fc44419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 0x7fc44419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 -- 172.21.15.5:0/4127891434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44419cb60 con 0x7fc44406b5d0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc449f4d640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 0x7fc44419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44974c640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc44419b030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc434006010 tx=0x7fc434003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434004040 con 0x7fc44406b5d0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44419cdf0 con 0x7fc44406b5d0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc434004690 con 0x7fc44406b5d0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43402fed0 con 0x7fc44406b5d0 2024-09-10T22:16:29.598 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.594+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4441a3530 con 0x7fc44406b5d0 2024-09-10T22:16:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.596+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4440fecd0 con 0x7fc44406b5d0 2024-09-10T22:16:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.597+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc43402f660 con 0x7fc44406b5d0 2024-09-10T22:16:29.599 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.598+0000 7fc4427fc640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc42c0b5370 0x7fc42c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.598+0000 7fc448f4b640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc42c0b5370 0x7fc42c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.598+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc434107410 con 0x7fc44406b5d0 2024-09-10T22:16:29.600 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.598+0000 7fc448f4b640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc42c0b5370 0x7fc42c0b7830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc4441035b0 tx=0x7fc438008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:29.603 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.602+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc4340ce140 con 0x7fc44406b5d0 2024-09-10T22:16:29.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.797+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fc444063590 con 0x7fc42c0b5370 2024-09-10T22:16:29.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.802+0000 7fc4427fc640 1 -- 172.21.15.5:0/4127891434 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fc444063590 con 0x7fc42c0b5370 2024-09-10T22:16:29.804 INFO:teuthology.orchestra.run.smithi005.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-10T22:16:29.804 INFO:teuthology.orchestra.run.smithi005.stdout:mds.all 12/12 30s ago 2m smithi005=a;smithi005=d;smithi005=g;smithi005=j;smithi052=b;smithi052=e;smithi052=h;smithi052=k;smithi189=c;smithi189=f;smithi189=i;smithi189=l;count:12 2024-09-10T22:16:29.804 INFO:teuthology.orchestra.run.smithi005.stdout:mgr 3/3 30s ago 7m smithi005=x;smithi052=y;smithi189=z;count:3 2024-09-10T22:16:29.804 INFO:teuthology.orchestra.run.smithi005.stdout:mon 3/3 30s ago 8m smithi005:172.21.15.5=a;smithi052:172.21.15.52=b;smithi189:172.21.15.189=c;count:3 2024-09-10T22:16:29.804 INFO:teuthology.orchestra.run.smithi005.stdout:osd 12 30s ago - 2024-09-10T22:16:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc42c0b5370 msgr2=0x7fc42c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc42c0b5370 0x7fc42c0b7830 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc4441035b0 tx=0x7fc438008040 comp rx=0 tx=0).stop 2024-09-10T22:16:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 msgr2=0x7fc44419b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:29.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc44419b030 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc434006010 tx=0x7fc434003ba0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 shutdown_connections 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc42c0b5370 0x7fc42c0b7830 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc44410a940 0x7fc44419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc444107f30 0x7fc44419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 --2- 172.21.15.5:0/4127891434 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc44406b5d0 0x7fc44419b030 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 >> 172.21.15.5:0/4127891434 conn(0x7fc4440fd1e0 msgr2=0x7fc444108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 shutdown_connections 2024-09-10T22:16:29.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:29.805+0000 7fc44b9b0640 1 -- 172.21.15.5:0/4127891434 wait complete. 2024-09-10T22:16:30.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-10T22:16:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:31.279 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 -- 172.21.15.5:0/3527865427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984101910 msgr2=0x7fc984101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/3527865427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984101910 0x7fc984101d10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc980009930 tx=0x7fc98002a420 comp rx=0 tx=0).stop 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 -- 172.21.15.5:0/3527865427 shutdown_connections 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/3527865427 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 0x7fc984109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/3527865427 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc984102a70 0x7fc984102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/3527865427 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984101910 0x7fc984101d10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 -- 172.21.15.5:0/3527865427 >> 172.21.15.5:0/3527865427 conn(0x7fc9840fd1e0 msgr2=0x7fc9840ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 -- 172.21.15.5:0/3527865427 shutdown_connections 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.264+0000 7fc98c2a0640 1 -- 172.21.15.5:0/3527865427 wait complete. 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 Processor -- start 2024-09-10T22:16:31.280 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 -- start start 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc984101910 0x7fc9841056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 0x7fc984103f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 0x7fc984104480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc98410d5c0 con 0x7fc984102a70 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc98410d440 con 0x7fc984101910 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98c2a0640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc98410d740 con 0x7fc984103430 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98983b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 0x7fc984103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98983b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 0x7fc984103f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:46272/0 (socket says 172.21.15.5:46272) 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98983b640 1 -- 172.21.15.5:0/1302732706 learned_addr learned my addr 172.21.15.5:0/1302732706 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98a03c640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc984101910 0x7fc9841056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.265+0000 7fc98a83d640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 0x7fc984104480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:31.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98983b640 1 -- 172.21.15.5:0/1302732706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 msgr2=0x7fc984104480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98983b640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 0x7fc984104480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98983b640 1 -- 172.21.15.5:0/1302732706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc984101910 msgr2=0x7fc9841056d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98983b640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc984101910 0x7fc9841056d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98983b640 1 -- 172.21.15.5:0/1302732706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc984104d40 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98a83d640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 0x7fc984104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98983b640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 0x7fc984103f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc97400d950 tx=0x7fc97400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974017070 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc974009c30 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9841a2ef0 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97400f620 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.266+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9841a33f0 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.267+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9841a3620 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.269+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc974005030 con 0x7fc984102a70 2024-09-10T22:16:31.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.270+0000 7fc97b7fe640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc9700b53f0 0x7fc9700b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.270+0000 7fc98a03c640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc9700b53f0 0x7fc9700b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.270+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc9740e5880 con 0x7fc984102a70 2024-09-10T22:16:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.271+0000 7fc98a03c640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc9700b53f0 0x7fc9700b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc980009900 tx=0x7fc980031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:31.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.272+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc9740ac690 con 0x7fc984102a70 2024-09-10T22:16:31.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:31 smithi005 ceph-mon[31115]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:31.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:31 smithi005 ceph-mon[31115]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:31.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:31 smithi189 ceph-mon[35784]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:31.443 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:31 smithi189 ceph-mon[35784]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:31.466 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.465+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc9840ff340 con 0x7fc9700b53f0 2024-09-10T22:16:31.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.466+0000 7fc97b7fe640 1 -- 172.21.15.5:0/1302732706 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc9840ff340 con 0x7fc9700b53f0 2024-09-10T22:16:31.468 INFO:teuthology.orchestra.run.smithi005.stdout:HOST ADDR LABELS STATUS 2024-09-10T22:16:31.468 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 172.21.15.5 2024-09-10T22:16:31.468 INFO:teuthology.orchestra.run.smithi005.stdout:smithi052 172.21.15.52 2024-09-10T22:16:31.468 INFO:teuthology.orchestra.run.smithi005.stdout:smithi189 172.21.15.189 2024-09-10T22:16:31.468 INFO:teuthology.orchestra.run.smithi005.stdout:3 hosts in cluster 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.468+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc9700b53f0 msgr2=0x7fc9700b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.468+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc9700b53f0 0x7fc9700b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc980009900 tx=0x7fc980031450 comp rx=0 tx=0).stop 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.468+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 msgr2=0x7fc984103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.468+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 0x7fc984103f40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc97400d950 tx=0x7fc97400de10 comp rx=0 tx=0).stop 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 shutdown_connections 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc9700b53f0 0x7fc9700b78b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc984103430 0x7fc984104480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc984102a70 0x7fc984103f40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 --2- 172.21.15.5:0/1302732706 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc984101910 0x7fc9841056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:31.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 >> 172.21.15.5:0/1302732706 conn(0x7fc9840fd1e0 msgr2=0x7fc9840fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 shutdown_connections 2024-09-10T22:16:31.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:31.469+0000 7fc98c2a0640 1 -- 172.21.15.5:0/1302732706 wait complete. 2024-09-10T22:16:31.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:31 smithi052 ceph-mon[34997]: pgmap v336: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:31.499 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:31 smithi052 ceph-mon[34997]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:32.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-10T22:16:32.431 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:32.709 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:32 smithi005 ceph-mon[31115]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:32.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:32 smithi052 ceph-mon[34997]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 -- 172.21.15.5:0/3055959268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102a40 msgr2=0x7f5f90102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:32.932 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 --2- 172.21.15.5:0/3055959268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102a40 0x7f5f90102e40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009930 tx=0x7f5f8002a420 comp rx=0 tx=0).stop 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 -- 172.21.15.5:0/3055959268 shutdown_connections 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 --2- 172.21.15.5:0/3055959268 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f90104560 0x7f5f9010aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 --2- 172.21.15.5:0/3055959268 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90103ba0 0x7f5f90104020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 --2- 172.21.15.5:0/3055959268 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90102a40 0x7f5f90102e40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 -- 172.21.15.5:0/3055959268 >> 172.21.15.5:0/3055959268 conn(0x7f5f900fe2f0 msgr2=0x7f5f90100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 -- 172.21.15.5:0/3055959268 shutdown_connections 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.915+0000 7f5f9642a640 1 -- 172.21.15.5:0/3055959268 wait complete. 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 Processor -- start 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 -- start start 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90102a40 0x7f5f90076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 0x7f5f90075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f90104560 0x7f5f90075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:32.933 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9010e6a0 con 0x7f5f90103ba0 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9010e520 con 0x7f5f90104560 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f9642a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9010e820 con 0x7f5f90102a40 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 0x7f5f90075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f8f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 0x7f5f90075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38076/0 (socket says 172.21.15.5:38076) 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.916+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/2769430586 learned_addr learned my addr 172.21.15.5:0/2769430586 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90102a40 0x7f5f90076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f949c7640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f90104560 0x7f5f90075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/2769430586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90102a40 msgr2=0x7f5f90076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90102a40 0x7f5f90076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/2769430586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f90104560 msgr2=0x7f5f90075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f90104560 0x7f5f90075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8f7fe640 1 -- 172.21.15.5:0/2769430586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f90076340 con 0x7f5f90103ba0 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90102a40 0x7f5f90076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:32.934 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8f7fe640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 0x7f5f90075540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400c920 tx=0x7f5f8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84007c70 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f84007e10 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f901a2e80 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f84018820 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.917+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f901a3330 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.918+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f90109d60 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.920+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7f5f8400f450 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.920+0000 7f5f8d7fa640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f5f780b5370 0x7f5f780b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.921+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f5f780b5370 0x7f5f780b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.921+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f5f840e61a0 con 0x7f5f90103ba0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.921+0000 7f5f8ffff640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f5f780b5370 0x7f5f780b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5f80006010 tx=0x7f5f80031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:32.935 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:32.923+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5f84014030 con 0x7f5f90103ba0 2024-09-10T22:16:32.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:32 smithi189 ceph-mon[35784]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:33.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.121+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f5f90063590 con 0x7f5f780b5370 2024-09-10T22:16:33.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.123+0000 7f5f8d7fa640 1 -- 172.21.15.5:0/2769430586 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f5f90063590 con 0x7f5f780b5370 2024-09-10T22:16:33.124 INFO:teuthology.orchestra.run.smithi005.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-10T22:16:33.124 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300EW480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-10T22:16:33.124 INFO:teuthology.orchestra.run.smithi005.stdout:smithi052 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513010N480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-10T22:16:33.124 INFO:teuthology.orchestra.run.smithi005.stdout:smithi189 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232004L400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-10T22:16:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f5f780b5370 msgr2=0x7f5f780b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f5f780b5370 0x7f5f780b7830 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5f80006010 tx=0x7f5f80031450 comp rx=0 tx=0).stop 2024-09-10T22:16:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 msgr2=0x7f5f90075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:33.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 0x7f5f90075540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5f8400c920 tx=0x7f5f8400cde0 comp rx=0 tx=0).stop 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 shutdown_connections 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f5f780b5370 0x7f5f780b7830 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5f90104560 0x7f5f90075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5f90103ba0 0x7f5f90075540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 --2- 172.21.15.5:0/2769430586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5f90102a40 0x7f5f90076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 >> 172.21.15.5:0/2769430586 conn(0x7f5f900fe2f0 msgr2=0x7f5f90106f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 shutdown_connections 2024-09-10T22:16:33.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:33.125+0000 7f5f9642a640 1 -- 172.21.15.5:0/2769430586 wait complete. 2024-09-10T22:16:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:33 smithi052 ceph-mon[34997]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:33.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:33 smithi005 ceph-mon[31115]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:33.903 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-10T22:16:33.914 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:16:33.914 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-10T22:16:33.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:33 smithi189 ceph-mon[35784]: pgmap v337: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:34.204 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:34.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:34 smithi005 ceph-mon[31115]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:34.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:34 smithi052 ceph-mon[34997]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:34.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 -- 172.21.15.5:0/4060627199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c1028f0 msgr2=0x7fc88c102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 --2- 172.21.15.5:0/4060627199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c1028f0 0x7fc88c102d70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc884009930 tx=0x7fc88402a420 comp rx=0 tx=0).stop 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 -- 172.21.15.5:0/4060627199 shutdown_connections 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 --2- 172.21.15.5:0/4060627199 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc88c1032b0 0x7fc88c109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 --2- 172.21.15.5:0/4060627199 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c1028f0 0x7fc88c102d70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 --2- 172.21.15.5:0/4060627199 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c101790 0x7fc88c101b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 -- 172.21.15.5:0/4060627199 >> 172.21.15.5:0/4060627199 conn(0x7fc88c0fd040 msgr2=0x7fc88c0ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 -- 172.21.15.5:0/4060627199 shutdown_connections 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.735+0000 7fc89359e640 1 -- 172.21.15.5:0/4060627199 wait complete. 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 Processor -- start 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 -- start start 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 0x7fc88c19adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:34.755 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1028f0 0x7fc88c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc88c1032b0 0x7fc88c19c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10e500 con 0x7fc88c101790 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10e380 con 0x7fc88c1028f0 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89359e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c10e680 con 0x7fc88c1032b0 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.736+0000 7fc89259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 0x7fc88c19adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 0x7fc88c19adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38092/0 (socket says 172.21.15.5:38092) 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 -- 172.21.15.5:0/2130065456 learned_addr learned my addr 172.21.15.5:0/2130065456 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc892d9d640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc88c1032b0 0x7fc88c19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc891d9b640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1028f0 0x7fc88c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 -- 172.21.15.5:0/2130065456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc88c1032b0 msgr2=0x7fc88c19c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc88c1032b0 0x7fc88c19c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 -- 172.21.15.5:0/2130065456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1028f0 msgr2=0x7fc88c19b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1028f0 0x7fc88c19b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 -- 172.21.15.5:0/2130065456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c19c8f0 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc891d9b640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1028f0 0x7fc88c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89259c640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 0x7fc88c19adc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c890 tx=0x7fc88000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880004220 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c19cbe0 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8800043c0 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880004a00 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.737+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c1a32c0 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.738+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c1a34f0 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.740+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7fc8800079b0 con 0x7fc88c101790 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.740+0000 7fc87f7fe640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc8780b5410 0x7fc8780b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.741+0000 7fc891d9b640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc8780b5410 0x7fc8780b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:34.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.741+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc8800e5b30 con 0x7fc88c101790 2024-09-10T22:16:34.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.741+0000 7fc891d9b640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc8780b5410 0x7fc8780b78d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc884006010 tx=0x7fc884031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:34.758 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.745+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc880014030 con 0x7fc88c101790 2024-09-10T22:16:34.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:34 smithi189 ceph-mon[35784]: from='client.15183 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-10T22:16:34.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.967+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc88c1a36c0 con 0x7fc88c101790 2024-09-10T22:16:34.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.968+0000 7fc87f7fe640 1 -- 172.21.15.5:0/2130065456 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3076 (secure 0 0 0) 0x7fc8800ac860 con 0x7fc88c101790 2024-09-10T22:16:34.969 INFO:teuthology.orchestra.run.smithi005.stdout:e24 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:btime 2024-09-10T22:15:15:399259+0000 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:legacy client fscid: 1 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:Filesystem 'cephfs' (1) 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:fs_name cephfs 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 24 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-10T22:15:03.043229+0000 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-09-10T22:15:15.075706+0000 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:tableserver 0 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:root 0 2024-09-10T22:16:34.970 INFO:teuthology.orchestra.run.smithi005.stdout:session_timeout 300 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:session_autoclose 300 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:max_file_size 1099511627776 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:max_xattr_size 65536 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:required_client_features {} 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure 0 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:last_failure_osd_epoch 0 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:max_mds 3 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:in 0,1,2 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:up {0=24578,1=24563,2=24562} 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:failed 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:damaged 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:stopped 2024-09-10T22:16:34.971 INFO:teuthology.orchestra.run.smithi005.stdout:data_pools [3] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:metadata_pool 2 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:inline_data disabled 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:balancer 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:bal_rank_mask -1 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:standby_count_wanted 0 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:qdb_cluster leader: 24578 members: 24562,24563,24578 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.b{0:24578} state up:active seq 4 addr [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.c{0:24544} state up:standby-replay seq 1 addr [v2:172.21.15.189:6836/2390982285,v1:172.21.15.189:6837/2390982285] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.h{1:24563} state up:active seq 9 addr [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.f{1:24538} state up:standby-replay seq 1 addr [v2:172.21.15.189:6834/1432375899,v1:172.21.15.189:6835/1432375899] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.i{2:24562} state up:active seq 9 addr [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.e{2:24536} state up:standby-replay seq 1 addr [v2:172.21.15.52:6834/4020193542,v1:172.21.15.52:6835/4020193542] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:Standby daemons: 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.j{-1:14682} state up:standby seq 1 addr [v2:172.21.15.5:6834/1828396706,v1:172.21.15.5:6835/1828396706] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.d{-1:14694} state up:standby seq 1 addr [v2:172.21.15.5:6836/2877300563,v1:172.21.15.5:6837/2877300563] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.g{-1:14736} state up:standby seq 1 addr [v2:172.21.15.5:6838/738059047,v1:172.21.15.5:6839/738059047] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.a{-1:14748} state up:standby seq 1 addr [v2:172.21.15.5:6840/4233870863,v1:172.21.15.5:6841/4233870863] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.l{-1:24508} state up:standby seq 1 addr [v2:172.21.15.189:6832/1255852386,v1:172.21.15.189:6833/1255852386] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.973 INFO:teuthology.orchestra.run.smithi005.stdout:[mds.k{-1:24518} state up:standby seq 1 addr [v2:172.21.15.52:6832/3402874625,v1:172.21.15.52:6833/3402874625] compat {c=[1],r=[1],i=[1fff]}] 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc8780b5410 msgr2=0x7fc8780b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc8780b5410 0x7fc8780b78d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc884006010 tx=0x7fc884031450 comp rx=0 tx=0).stop 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 msgr2=0x7fc88c19adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 0x7fc88c19adc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc88000c890 tx=0x7fc88000cd50 comp rx=0 tx=0).stop 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 shutdown_connections 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc8780b5410 0x7fc8780b78d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc88c1032b0 0x7fc88c19c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc88c1028f0 0x7fc88c19b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 --2- 172.21.15.5:0/2130065456 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc88c101790 0x7fc88c19adc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 >> 172.21.15.5:0/2130065456 conn(0x7fc88c0fd040 msgr2=0x7fc88c10a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 shutdown_connections 2024-09-10T22:16:34.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:34.970+0000 7fc89359e640 1 -- 172.21.15.5:0/2130065456 wait complete. 2024-09-10T22:16:35.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:35 smithi005 ceph-mon[31115]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:35.639 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:35 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2130065456' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T22:16:35.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-10T22:16:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:35 smithi052 ceph-mon[34997]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:35.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:35 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2130065456' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T22:16:35.926 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:35 smithi189 ceph-mon[35784]: pgmap v338: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:35.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:35 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2130065456' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-10T22:16:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 -- 172.21.15.5:0/1894458592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc101940 msgr2=0x7faebc101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 --2- 172.21.15.5:0/1894458592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc101940 0x7faebc101d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faeac009930 tx=0x7faeac02a420 comp rx=0 tx=0).stop 2024-09-10T22:16:36.389 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 -- 172.21.15.5:0/1894458592 shutdown_connections 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 --2- 172.21.15.5:0/1894458592 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 0x7faebc109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 --2- 172.21.15.5:0/1894458592 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc102aa0 0x7faebc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 --2- 172.21.15.5:0/1894458592 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc101940 0x7faebc101d40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 -- 172.21.15.5:0/1894458592 >> 172.21.15.5:0/1894458592 conn(0x7faebc0fd210 msgr2=0x7faebc0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 -- 172.21.15.5:0/1894458592 shutdown_connections 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.362+0000 7faec29b5640 1 -- 172.21.15.5:0/1894458592 wait complete. 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 Processor -- start 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 -- start start 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc101940 0x7faebc198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 0x7faebc199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 0x7faebc19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:36.390 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10d5a0 con 0x7faebc102aa0 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10d420 con 0x7faebc103460 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faec29b5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7faebc10d720 con 0x7faebc101940 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faebb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 0x7faebc199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faebb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 0x7faebc199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38112/0 (socket says 172.21.15.5:38112) 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faebb7fe640 1 -- 172.21.15.5:0/2753285257 learned_addr learned my addr 172.21.15.5:0/2753285257 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.363+0000 7faebbfff640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc101940 0x7faebc198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebb7fe640 1 -- 172.21.15.5:0/2753285257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc101940 msgr2=0x7faebc198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebb7fe640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc101940 0x7faebc198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebb7fe640 1 -- 172.21.15.5:0/2753285257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 msgr2=0x7faebc19a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faec0f52640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 0x7faebc19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebb7fe640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 0x7faebc19a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebb7fe640 1 -- 172.21.15.5:0/2753285257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc19a950 con 0x7faebc102aa0 2024-09-10T22:16:36.391 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebbfff640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc101940 0x7faebc198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faec0f52640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 0x7faebc19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faebb7fe640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 0x7faebc199470 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faeb000d950 tx=0x7faeb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb0017070 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faeb0009c30 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb000f620 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faebc19ac40 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.364+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faebc1a1320 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.365+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faebc1a14f0 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.367+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 17) ==== 153300+0+0 (secure 0 0 0) 0x7faeb0010460 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.368+0000 7faeb97fa640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7faea40b53f0 0x7faea40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.368+0000 7faebbfff640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7faea40b53f0 0x7faea40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.368+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7faeb00e5a00 con 0x7faebc102aa0 2024-09-10T22:16:36.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.368+0000 7faebbfff640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7faea40b53f0 0x7faea40b78b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faeac006010 tx=0x7faeac031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:36.393 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.371+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faeb00ac7b0 con 0x7faebc102aa0 2024-09-10T22:16:36.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.468+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7faeb00a8320 con 0x7faebc102aa0 2024-09-10T22:16:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.564+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7faebc1a16c0 con 0x7faebc102aa0 2024-09-10T22:16:36.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.565+0000 7faeb97fa640 1 -- 172.21.15.5:0/2753285257 <== mon.0 v2:172.21.15.5:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v78) ==== 56+0+5219 (secure 0 0 0) 0x7faeb0009de0 con 0x7faebc102aa0 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 78 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-10T22:06:46.142379+0000 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-09-10T22:15:35.469355+0000 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 26 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2024-09-10T22:16:36.567 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client luminous 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release squid 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 76 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 12 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 8 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6802/3696075683,v1:172.21.15.5:6803/3696075683] [v2:172.21.15.5:6804/3696075683,v1:172.21.15.5:6805/3696075683] exists,up 0222d8dd-610f-4eea-9c9f-2beea3a602b6 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6800/1933409756,v1:172.21.15.52:6801/1933409756] [v2:172.21.15.52:6802/1933409756,v1:172.21.15.52:6803/1933409756] exists,up 5a473b05-b36a-4011-91d0-e93a9190a8b9 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6800/3820297552,v1:172.21.15.189:6801/3820297552] [v2:172.21.15.189:6802/3820297552,v1:172.21.15.189:6803/3820297552] exists,up 025f8eb8-11e9-4f44-a07e-bc09e476780d 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 up in weight 1 up_from 25 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6810/2032049707,v1:172.21.15.5:6811/2032049707] [v2:172.21.15.5:6812/2032049707,v1:172.21.15.5:6813/2032049707] exists,up d2de667c-2627-47c7-a890-837a819b62ff 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 up in weight 1 up_from 31 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6808/2372406744,v1:172.21.15.52:6809/2372406744] [v2:172.21.15.52:6810/2372406744,v1:172.21.15.52:6811/2372406744] exists,up adfeb2e3-b099-4406-8934-6cc24e759c0f 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 up in weight 1 up_from 36 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6808/3637282250,v1:172.21.15.189:6809/3637282250] [v2:172.21.15.189:6810/3637282250,v1:172.21.15.189:6811/3637282250] exists,up 496d4b82-cf16-4c60-98d4-904b66a06fe9 2024-09-10T22:16:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 up in weight 1 up_from 42 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6818/785003891,v1:172.21.15.5:6819/785003891] [v2:172.21.15.5:6820/785003891,v1:172.21.15.5:6821/785003891] exists,up c454304c-d9fb-4962-b760-e10c257f6ea1 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 up in weight 1 up_from 47 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6816/3246361291,v1:172.21.15.52:6817/3246361291] [v2:172.21.15.52:6818/3246361291,v1:172.21.15.52:6819/3246361291] exists,up d9f735c7-7b27-48ab-89e3-57076f0b2ee0 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:osd.8 up in weight 1 up_from 53 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6816/2630630352,v1:172.21.15.189:6817/2630630352] [v2:172.21.15.189:6818/2630630352,v1:172.21.15.189:6819/2630630352] exists,up 3bf416f0-d03c-486d-98ff-7a40d2920d99 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:osd.9 up in weight 1 up_from 59 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6826/416812838,v1:172.21.15.5:6827/416812838] [v2:172.21.15.5:6828/416812838,v1:172.21.15.5:6829/416812838] exists,up d9abfd78-d3e7-4506-8c2d-5c5050fd2913 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:osd.10 up in weight 1 up_from 64 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.52:6824/1898218403,v1:172.21.15.52:6825/1898218403] [v2:172.21.15.52:6826/1898218403,v1:172.21.15.52:6827/1898218403] exists,up cd4c7c17-9bb8-4f3c-951f-3482e24c16fa 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:osd.11 up in weight 1 up_from 70 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.189:6824/4080775547,v1:172.21.15.189:6825/4080775547] [v2:172.21.15.189:6826/4080775547,v1:172.21.15.189:6827/4080775547] exists,up 91aae414-bd19-4b39-a93f-d4705df0a491 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.5 [8,11] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 2.8 [2,11] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.3 [4,9] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.14 [4,6] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.28 [5,8] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.2c [4,9] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:pg_upmap_items 3.2d [3,9] 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/907757444 expires 2024-09-11T22:07:33.618373+0000 2024-09-10T22:16:36.569 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/2665728769 expires 2024-09-11T22:07:33.618373+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3915014878 expires 2024-09-11T22:07:33.618373+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/3420450808 expires 2024-09-11T22:07:08.650376+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/907757444 expires 2024-09-11T22:07:33.618373+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6801/3919804850 expires 2024-09-11T22:07:08.650376+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1897492228 expires 2024-09-11T22:07:33.618373+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:6800/3919804850 expires 2024-09-11T22:07:08.650376+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/4269601080 expires 2024-09-11T22:07:08.650376+0000 2024-09-10T22:16:36.570 INFO:teuthology.orchestra.run.smithi005.stdout:blocklist 172.21.15.5:0/1643809040 expires 2024-09-11T22:07:08.650376+0000 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.567+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7faea40b53f0 msgr2=0x7faea40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.567+0000 7faec29b5640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7faea40b53f0 0x7faea40b78b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faeac006010 tx=0x7faeac031450 comp rx=0 tx=0).stop 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.567+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 msgr2=0x7faebc199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.567+0000 7faec29b5640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 0x7faebc199470 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7faeb000d950 tx=0x7faeb000de10 comp rx=0 tx=0).stop 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 shutdown_connections 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7faea40b53f0 0x7faea40b78b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7faebc103460 0x7faebc19a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7faebc102aa0 0x7faebc199470 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 --2- 172.21.15.5:0/2753285257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7faebc101940 0x7faebc198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:36.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 >> 172.21.15.5:0/2753285257 conn(0x7faebc0fd210 msgr2=0x7faebc0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 shutdown_connections 2024-09-10T22:16:36.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:36.568+0000 7faec29b5640 1 -- 172.21.15.5:0/2753285257 wait complete. 2024-09-10T22:16:37.401 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-10T22:16:37.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:37.678 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:37.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:37 smithi052 ceph-mon[34997]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:37.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:37 smithi052 ceph-mon[34997]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T22:16:37.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:37 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2753285257' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T22:16:37.799 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:37 smithi005 ceph-mon[31115]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:37.799 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:37 smithi005 ceph-mon[31115]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T22:16:37.799 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:37 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2753285257' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T22:16:37.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:37 smithi189 ceph-mon[35784]: pgmap v339: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:37.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:37 smithi189 ceph-mon[35784]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-10T22:16:37.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:37 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2753285257' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 -- 172.21.15.5:0/3348850667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb201087d0 msgr2=0x7feb20108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 --2- 172.21.15.5:0/3348850667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb201087d0 0x7feb20108c10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb0c009900 tx=0x7feb0c02a410 comp rx=0 tx=0).stop 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 -- 172.21.15.5:0/3348850667 shutdown_connections 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 --2- 172.21.15.5:0/3348850667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb20109150 0x7feb2010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 --2- 172.21.15.5:0/3348850667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb201087d0 0x7feb20108c10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 --2- 172.21.15.5:0/3348850667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb20102dc0 0x7feb201031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 -- 172.21.15.5:0/3348850667 >> 172.21.15.5:0/3348850667 conn(0x7feb200fe830 msgr2=0x7feb20100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 -- 172.21.15.5:0/3348850667 shutdown_connections 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.155+0000 7feb26c14640 1 -- 172.21.15.5:0/3348850667 wait complete. 2024-09-10T22:16:38.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 Processor -- start 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 -- start start 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb20102dc0 0x7feb20199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb201087d0 0x7feb20199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 0x7feb2019eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7feb20112da0 con 0x7feb20109150 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7feb20112c20 con 0x7feb20102dc0 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb26c14640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7feb20112f20 con 0x7feb201087d0 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb251b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 0x7feb2019eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb251b1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 0x7feb2019eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38128/0 (socket says 172.21.15.5:38128) 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb251b1640 1 -- 172.21.15.5:0/2083667744 learned_addr learned my addr 172.21.15.5:0/2083667744 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.156+0000 7feb249b0640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb20102dc0 0x7feb20199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:38.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb1ffff640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb201087d0 0x7feb20199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb251b1640 1 -- 172.21.15.5:0/2083667744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb201087d0 msgr2=0x7feb20199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb251b1640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb201087d0 0x7feb20199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb251b1640 1 -- 172.21.15.5:0/2083667744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb20102dc0 msgr2=0x7feb20199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb251b1640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb20102dc0 0x7feb20199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb251b1640 1 -- 172.21.15.5:0/2083667744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2019f300 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb251b1640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 0x7feb2019eb30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb1800eaa0 tx=0x7feb1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1800cdb0 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb18005020 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb180116d0 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2019f5f0 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.157+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb201a5cb0 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.158+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb201031a0 con 0x7feb20109150 2024-09-10T22:16:38.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.159+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7feb1800f040 con 0x7feb20109150 2024-09-10T22:16:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.161+0000 7feb1dffb640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7feb100b5360 0x7feb100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.161+0000 7feb249b0640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7feb100b5360 0x7feb100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.161+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7feb180e5910 con 0x7feb20109150 2024-09-10T22:16:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.161+0000 7feb249b0640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7feb100b5360 0x7feb100b7820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb140058c0 tx=0x7feb1400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:38.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.165+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7feb18016030 con 0x7feb20109150 2024-09-10T22:16:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.390+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb2002e5c0 con 0x7feb20109150 2024-09-10T22:16:38.392 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.391+0000 7feb1dffb640 1 -- 172.21.15.5:0/2083667744 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7feb180ac1b0 con 0x7feb20109150 2024-09-10T22:16:38.393 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:38.393 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-10T22:15:15:399259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:15:15.075706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24562,24563,24578]},"id":1}]} 2024-09-10T22:16:38.393 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:16:38.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7feb100b5360 msgr2=0x7feb100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:38.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7feb100b5360 0x7feb100b7820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7feb140058c0 tx=0x7feb1400a2d0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 msgr2=0x7feb2019eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:38.395 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 0x7feb2019eb30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb1800eaa0 tx=0x7feb1800ef60 comp rx=0 tx=0).stop 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 shutdown_connections 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7feb100b5360 0x7feb100b7820 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7feb20109150 0x7feb2019eb30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7feb201087d0 0x7feb20199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 --2- 172.21.15.5:0/2083667744 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7feb20102dc0 0x7feb20199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 >> 172.21.15.5:0/2083667744 conn(0x7feb200fe830 msgr2=0x7feb20100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 shutdown_connections 2024-09-10T22:16:38.396 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:38.394+0000 7feb26c14640 1 -- 172.21.15.5:0/2083667744 wait complete. 2024-09-10T22:16:38.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:38 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2083667744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:38.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:38 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2083667744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:38.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:38 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2083667744' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:39.119 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:39.379 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:39 smithi052 ceph-mon[34997]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:39.792 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:39 smithi005 ceph-mon[31115]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.872+0000 7f6495535640 1 -- 172.21.15.5:0/815320696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 msgr2=0x7f64901031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:39.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.872+0000 7f6495535640 1 --2- 172.21.15.5:0/815320696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901031a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6480009900 tx=0x7f648002a410 comp rx=0 tx=0).stop 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 -- 172.21.15.5:0/815320696 shutdown_connections 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 --2- 172.21.15.5:0/815320696 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6490109150 0x7f649010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 --2- 172.21.15.5:0/815320696 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f64901087d0 0x7f6490108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 --2- 172.21.15.5:0/815320696 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901031a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 -- 172.21.15.5:0/815320696 >> 172.21.15.5:0/815320696 conn(0x7f64900fe830 msgr2=0x7f6490100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 -- 172.21.15.5:0/815320696 shutdown_connections 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 -- 172.21.15.5:0/815320696 wait complete. 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 Processor -- start 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 -- start start 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901087d0 0x7f64901997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.873+0000 7f6495535640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6490109150 0x7f649019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:39.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f6495535640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6490112dd0 con 0x7f6490102dc0 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f6495535640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6490112c50 con 0x7f64901087d0 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f6495535640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6490112f50 con 0x7f6490109150 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38150/0 (socket says 172.21.15.5:38150) 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 -- 172.21.15.5:0/1416752528 learned_addr learned my addr 172.21.15.5:0/1416752528 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f6487fff640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901087d0 0x7f64901997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648f7fe640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6490109150 0x7f649019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 -- 172.21.15.5:0/1416752528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6490109150 msgr2=0x7f649019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6490109150 0x7f649019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 -- 172.21.15.5:0/1416752528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901087d0 msgr2=0x7f64901997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901087d0 0x7f64901997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 -- 172.21.15.5:0/1416752528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649019f350 con 0x7f6490102dc0 2024-09-10T22:16:39.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648effd640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901992a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6480005940 tx=0x7f6480004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648003f030 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6480003aa0 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649019f5e0 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480035070 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.874+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64901a5d00 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.875+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64901031a0 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.877+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f648004c060 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.877+0000 7f648cff9640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f647c0b5360 0x7f647c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.878+0000 7f6487fff640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f647c0b5360 0x7f647c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.878+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6480105e70 con 0x7f6490102dc0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.878+0000 7f6487fff640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f647c0b5360 0x7f647c0b7820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6490108270 tx=0x7f647800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:39.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:39.882+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64800ccd60 con 0x7f6490102dc0 2024-09-10T22:16:39.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:39 smithi189 ceph-mon[35784]: pgmap v340: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:40.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.105+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f649002e5c0 con 0x7f6490102dc0 2024-09-10T22:16:40.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.106+0000 7f648cff9640 1 -- 172.21.15.5:0/1416752528 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11896 (secure 0 0 0) 0x7f64800cc660 con 0x7f6490102dc0 2024-09-10T22:16:40.107 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:40.107 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":24,"btime":"2024-09-10T22:15:15:399259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:15:15.075706+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24562,24563,24578]},"id":1}]} 2024-09-10T22:16:40.108 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 24 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f647c0b5360 msgr2=0x7f647c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f647c0b5360 0x7f647c0b7820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6490108270 tx=0x7f647800b390 comp rx=0 tx=0).stop 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 msgr2=0x7f64901992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901992a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6480005940 tx=0x7f6480004270 comp rx=0 tx=0).stop 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 shutdown_connections 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f647c0b5360 0x7f647c0b7820 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:40.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6490109150 0x7f649019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:40.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f64901087d0 0x7f64901997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:40.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 --2- 172.21.15.5:0/1416752528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6490102dc0 0x7f64901992a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:40.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 >> 172.21.15.5:0/1416752528 conn(0x7f64900fe830 msgr2=0x7f6490100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:40.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 shutdown_connections 2024-09-10T22:16:40.110 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:40.108+0000 7f6495535640 1 -- 172.21.15.5:0/1416752528 wait complete. 2024-09-10T22:16:40.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:40 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1416752528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:40.789 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:40 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1416752528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:40.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:16:40.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:40 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1416752528' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:41.083 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 -- 172.21.15.5:0/3500274042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 msgr2=0x7f7650101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 --2- 172.21.15.5:0/3500274042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f7650101eb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f764c009900 tx=0x7f764c02a3f0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 -- 172.21.15.5:0/3500274042 shutdown_connections 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 --2- 172.21.15.5:0/3500274042 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650106f10 0x7f7650107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 --2- 172.21.15.5:0/3500274042 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 0x7f76501068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 --2- 172.21.15.5:0/3500274042 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f7650101eb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.590+0000 7f765749e640 1 -- 172.21.15.5:0/3500274042 >> 172.21.15.5:0/3500274042 conn(0x7f76500fd700 msgr2=0x7f76500ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 -- 172.21.15.5:0/3500274042 shutdown_connections 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 -- 172.21.15.5:0/3500274042 wait complete. 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 Processor -- start 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 -- start start 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f765019f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 0x7f765019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650106f10 0x7f76501a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7650119380 con 0x7f7650101ad0 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7650119200 con 0x7f7650106f10 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765749e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7650119500 con 0x7f76501023f0 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.591+0000 7f765523a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f765019f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:41.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f765019f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38174/0 (socket says 172.21.15.5:38174) 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 -- 172.21.15.5:0/3742396852 learned_addr learned my addr 172.21.15.5:0/3742396852 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f7654a39640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 0x7f765019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f7655a3b640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650106f10 0x7f76501a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 -- 172.21.15.5:0/3742396852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 msgr2=0x7f765019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 0x7f765019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 -- 172.21.15.5:0/3742396852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650106f10 msgr2=0x7f76501a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650106f10 0x7f76501a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 -- 172.21.15.5:0/3742396852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76501a5900 con 0x7f7650101ad0 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f7654a39640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 0x7f765019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765523a640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f765019f850 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f764c006010 tx=0x7f764c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c03f030 con 0x7f7650101ad0 2024-09-10T22:16:41.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76501a5b90 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f764c003800 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c035070 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.592+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76501ac2b0 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.593+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76501068c0 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.595+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f764c031b10 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.595+0000 7f76467fc640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f763c0b52e0 0x7f763c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.595+0000 7f7654a39640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f763c0b52e0 0x7f763c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.595+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f764c106820 con 0x7f7650101ad0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.596+0000 7f7654a39640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f763c0b52e0 0x7f763c0b77a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7650107630 tx=0x7f764000a680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:41.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.598+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f764c0cd710 con 0x7f7650101ad0 2024-09-10T22:16:41.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:41 smithi052 ceph-mon[34997]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:41.786 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.785+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76501ac540 con 0x7f7650101ad0 2024-09-10T22:16:41.786 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:41 smithi005 ceph-mon[31115]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:41.787 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.786+0000 7f76467fc640 1 -- 172.21.15.5:0/3742396852 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7f764c0cd010 con 0x7f7650101ad0 2024-09-10T22:16:41.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:41.788 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:16:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f763c0b52e0 msgr2=0x7f763c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f763c0b52e0 0x7f763c0b77a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7650107630 tx=0x7f764000a680 comp rx=0 tx=0).stop 2024-09-10T22:16:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 msgr2=0x7f765019f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f765019f850 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f764c006010 tx=0x7f764c0042f0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 shutdown_connections 2024-09-10T22:16:41.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f763c0b52e0 0x7f763c0b77a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7650106f10 0x7f76501a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f76501023f0 0x7f765019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 --2- 172.21.15.5:0/3742396852 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7650101ad0 0x7f765019f850 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 >> 172.21.15.5:0/3742396852 conn(0x7f76500fd700 msgr2=0x7f7650104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 shutdown_connections 2024-09-10T22:16:41.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:41.789+0000 7f765749e640 1 -- 172.21.15.5:0/3742396852 wait complete. 2024-09-10T22:16:41.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:41 smithi189 ceph-mon[35784]: pgmap v341: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:42.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-10T22:15:03.043229+0000', 'modified': '2024-09-10T22:15:15.075706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24578, 'mds_1': 24563, 'mds_2': 24562}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24536': {'gid': 24536, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.52:6835/4020193542', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6834', 'nonce': 4020193542}, {'type': 'v1', 'addr': '172.21.15.52:6835', 'nonce': 4020193542}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24538': {'gid': 24538, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6835/1432375899', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6834', 'nonce': 1432375899}, {'type': 'v1', 'addr': '172.21.15.189:6835', 'nonce': 1432375899}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24544': {'gid': 24544, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.189:6837/2390982285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6836', 'nonce': 2390982285}, {'type': 'v1', 'addr': '172.21.15.189:6837', 'nonce': 2390982285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24562': {'gid': 24562, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.189:6839/3637381557', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.189:6838', 'nonce': 3637381557}, {'type': 'v1', 'addr': '172.21.15.189:6839', 'nonce': 3637381557}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24563': {'gid': 24563, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.52:6837/992786234', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6836', 'nonce': 992786234}, {'type': 'v1', 'addr': '172.21.15.52:6837', 'nonce': 992786234}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.52:6839/3172231401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6838', 'nonce': 3172231401}, {'type': 'v1', 'addr': '172.21.15.52:6839', 'nonce': 3172231401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24578, 'qdb_cluster': [24562, 24563, 24578]} 2024-09-10T22:16:42.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-10T22:16:42.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-10T22:16:42.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:42 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3742396852' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:42.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:42 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3742396852' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:42.851 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:42.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:42 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3742396852' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:43.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 -- 172.21.15.5:0/3565900863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 msgr2=0x7f8a40101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 --2- 172.21.15.5:0/3565900863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a40101eb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009900 tx=0x7f8a3002a3f0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 -- 172.21.15.5:0/3565900863 shutdown_connections 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 --2- 172.21.15.5:0/3565900863 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a40106f10 0x7f8a40107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 --2- 172.21.15.5:0/3565900863 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a401023f0 0x7f8a401068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 --2- 172.21.15.5:0/3565900863 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a40101eb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 -- 172.21.15.5:0/3565900863 >> 172.21.15.5:0/3565900863 conn(0x7f8a400fd700 msgr2=0x7f8a400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:43.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 -- 172.21.15.5:0/3565900863 shutdown_connections 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.334+0000 7f8a44d91640 1 -- 172.21.15.5:0/3565900863 wait complete. 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 Processor -- start 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 -- start start 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a4019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a401023f0 0x7f8a4019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a40106f10 0x7f8a401a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40119380 con 0x7f8a40101ad0 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40119200 con 0x7f8a401023f0 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a44d91640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8a40119500 con 0x7f8a40106f10 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a4019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.335+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a4019f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52028/0 (socket says 172.21.15.5:52028) 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 -- 172.21.15.5:0/458326243 learned_addr learned my addr 172.21.15.5:0/458326243 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:43.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 -- 172.21.15.5:0/458326243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a40106f10 msgr2=0x7f8a401a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a40106f10 0x7f8a401a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 -- 172.21.15.5:0/458326243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a401023f0 msgr2=0x7f8a4019fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a401023f0 0x7f8a4019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a401023f0 0x7f8a4019fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 -- 172.21.15.5:0/458326243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a401a58e0 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a4019f830 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006010 tx=0x7f8a300042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a2f7fe640 1 -- 172.21.15.5:0/458326243 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3003f030 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a401a5b70 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a2f7fe640 1 -- 172.21.15.5:0/458326243 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a30003800 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a2f7fe640 1 -- 172.21.15.5:0/458326243 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30035070 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.336+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a401ac290 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a2f7fe640 1 -- 172.21.15.5:0/458326243 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8a30031b10 con 0x7f8a40101ad0 2024-09-10T22:16:43.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 Processor -- start 2024-09-10T22:16:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 -- start start 2024-09-10T22:16:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ecf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14edb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 0x560f14edd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560f14e46c10 con 0x560f14edb5e0 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f14e36040 con 0x560f14ecf650 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a47166740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f14e39e50 con 0x560f14eced30 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a3dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 0x560f14edd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a3dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 0x560f14edd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52040/0 (socket says 172.21.15.5:52040) 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.339+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/3488479153 learned_addr learned my addr 172.21.15.5:0/3488479153 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14edb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3ed9d640 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ecf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/3488479153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 msgr2=0x560f14ecf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ecf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/3488479153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 msgr2=0x560f14edb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14edb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/3488479153 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f14b94540 con 0x560f14edb5e0 2024-09-10T22:16:43.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a2f7fe640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a280b52e0 0x7f8a280b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3ed9d640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a280b52e0 0x7f8a280b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 0x560f14edd9d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400ba90 tx=0x7f8a3400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ecaac569cedf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a2f7fe640 1 -- 172.21.15.5:0/458326243 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f8a301065a0 con 0x7f8a40101ad0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a2cff9640 1 -- 172.21.15.5:0/3488479153 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a34017420 con 0x560f14edb5e0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a2cff9640 1 -- 172.21.15.5:0/3488479153 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a34017a70 con 0x560f14edb5e0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.340+0000 7f8a2cff9640 1 -- 172.21.15.5:0/3488479153 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400f9d0 con 0x560f14edb5e0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 -- 172.21.15.5:0/3488479153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 msgr2=0x560f14edd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a3ed9d640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a280b52e0 0x7f8a280b77a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005fd0 tx=0x7f8a380073a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 0x560f14edd9d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400ba90 tx=0x7f8a3400bf50 comp rx=0 tx=0).stop 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 -- 172.21.15.5:0/3488479153 shutdown_connections 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14edb5e0 0x560f14edd9d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14edb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 --2- 172.21.15.5:0/3488479153 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ecf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 -- 172.21.15.5:0/3488479153 >> 172.21.15.5:0/3488479153 conn(0x560f14eccb60 msgr2=0x560f14ecdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 -- 172.21.15.5:0/3488479153 shutdown_connections 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 -- 172.21.15.5:0/3488479153 wait complete. 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.341+0000 7f8a47166740 1 -- start start 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 Processor -- start 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14ed8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14ed8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14ed8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560f14c975f0 con 0x560f14eced30 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f14dd1010 con 0x560f14ecf650 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f14ede290 con 0x560f14edb5e0 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a47166740 10 client.0 _ll_register_callbacks cb 0x560f14e30340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14ed8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14ed8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52042/0 (socket says 172.21.15.5:52042) 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 -- 172.21.15.5:0/2852672258 learned_addr learned my addr 172.21.15.5:0/2852672258 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14ed8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3ed9d640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14ed8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 -- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 msgr2=0x560f14ed8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14ed8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 -- 172.21.15.5:0/2852672258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 msgr2=0x560f14ed8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14ed8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 -- 172.21.15.5:0/2852672258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f14dfea00 con 0x560f14eced30 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14ed8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14ed8560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8a300ccd20 tx=0x7f8a3002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289de3de093f2522 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:43.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a25ffb640 1 -- 172.21.15.5:0/2852672258 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30049040 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.342+0000 7f8a25ffb640 1 -- 172.21.15.5:0/2852672258 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f8a300b40d0 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a34017a70 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a25ffb640 1 -- 172.21.15.5:0/2852672258 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a300cc6e0 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 10 client.15225 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560f14ee9e00 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a25ffb640 1 -- 172.21.15.5:0/2852672258 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a34017a70 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a25ffb640 1 -- 172.21.15.5:0/2852672258 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8a300c9000 con 0x560f14eced30 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 10 client.15225 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 10 client.15225 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 20 client.15225 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14eed900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 4 client.15225 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f14e48b60 con 0x560f14eec490 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.343+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14eed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.344+0000 7f8a25ffb640 10 client.15225 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.344+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14eed900 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9f6b784813dac56 server_cookie=11f082f7428ad619 in_seq=0 out_seq=0 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a25ffb640 1 -- 172.21.15.5:0/2852672258 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560f14e48b60 con 0x560f14eec490 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a25ffb640 10 client.15225 handle_command_reply: tid=0 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 client.15225 shutdown 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 msgr2=0x560f14ed8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14ed8560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8a300ccd20 tx=0x7f8a3002a3f0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 shutdown_connections 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14ed8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14eed900 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a25ffb640 0 client.15225 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:43.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14ed8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 --2- 172.21.15.5:0/2852672258 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14ed8560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 >> 172.21.15.5:0/2852672258 conn(0x560f14eccb60 msgr2=0x560f14ed2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 shutdown_connections 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 1 -- 172.21.15.5:0/2852672258 wait complete. 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.345+0000 7f8a47166740 20 client.15225 trim_cache size 0 max 16384 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 Processor -- start 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 -- start start 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14eecb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14eeb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14eeb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560f14eebc40 con 0x560f14eced30 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f14eec310 con 0x560f14ecf650 2024-09-10T22:16:43.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a47166740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f14eec9e0 con 0x560f14edb5e0 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14eecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a3e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14eecb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52052/0 (socket says 172.21.15.5:52052) 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.363+0000 7f8a3e59c640 1 -- 172.21.15.5:0/153459983 learned_addr learned my addr 172.21.15.5:0/153459983 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a3e59c640 1 -- 172.21.15.5:0/153459983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 msgr2=0x560f14eeb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14eeb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a3e59c640 1 -- 172.21.15.5:0/153459983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 msgr2=0x560f14eeb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14eeb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a3e59c640 1 -- 172.21.15.5:0/153459983 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f14ecd5e0 con 0x560f14eced30 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14eecb60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a300c9360 tx=0x7f8a30031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b8b10009f6e467 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a27fff640 1 -- 172.21.15.5:0/153459983 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30049070 con 0x560f14eced30 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a27fff640 1 -- 172.21.15.5:0/153459983 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a300cc8a0 con 0x560f14eced30 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.364+0000 7f8a27fff640 1 -- 172.21.15.5:0/153459983 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a300cc500 con 0x560f14eced30 2024-09-10T22:16:43.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- 172.21.15.5:0/153459983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 msgr2=0x560f14eecb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14eecb60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a300c9360 tx=0x7f8a30031f50 comp rx=0 tx=0).stop 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- 172.21.15.5:0/153459983 shutdown_connections 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14edb5e0 0x560f14eeb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14ecf650 0x560f14eeb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- 172.21.15.5:0/153459983 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14eced30 0x560f14eecb60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- 172.21.15.5:0/153459983 >> 172.21.15.5:0/153459983 conn(0x560f14eccb60 msgr2=0x560f14ec7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- 172.21.15.5:0/153459983 shutdown_connections 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- 172.21.15.5:0/153459983 wait complete. 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- start start 2024-09-10T22:16:43.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 Processor -- start 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ef09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 0x560f14ef0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14edb5e0 0x560f14ef1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560f14eed780 con 0x560f14ecf650 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560f14eed0b0 con 0x560f14edb5e0 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560f14eede50 con 0x560f14eced30 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a47166740 10 client.0 _ll_register_callbacks cb 0x7f8a30109b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a3dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 0x560f14ef0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a3dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 0x560f14ef0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52066/0 (socket says 172.21.15.5:52066) 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.365+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/832254457 learned_addr learned my addr 172.21.15.5:0/832254457 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ef09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 msgr2=0x560f14ef09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ef09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3ed9d640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14edb5e0 0x560f14ef1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/832254457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14edb5e0 msgr2=0x560f14ef1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14edb5e0 0x560f14ef1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3dd9b640 1 -- 172.21.15.5:0/832254457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f14ee7b40 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a3dd9b640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 0x560f14ef0f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x560f14ecece0 tx=0x7f8a3400f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0242c04ad29c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a25ffb640 1 -- 172.21.15.5:0/832254457 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400f5a0 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a25ffb640 1 -- 172.21.15.5:0/832254457 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f8a34027070 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a300cc8a0 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a25ffb640 1 -- 172.21.15.5:0/832254457 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a3400f740 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a47166740 10 client.15231 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560f14f591a0 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.366+0000 7f8a25ffb640 1 -- 172.21.15.5:0/832254457 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a300cc8a0 con 0x560f14ecf650 2024-09-10T22:16:43.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a25ffb640 1 -- 172.21.15.5:0/832254457 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f8a34017720 con 0x560f14ecf650 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a47166740 10 client.15231 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a47166740 10 client.15231 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a47166740 20 client.15231 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a47166740 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14f5c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a47166740 4 client.15231 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "status"}) -- 0x560f14e44610 con 0x560f14eec490 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14f5c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a25ffb640 10 client.15231 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.367+0000 7f8a3e59c640 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14f5c8c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d021953c59167ef8 server_cookie=b9b3c4812b87dd9c in_seq=0 out_seq=0 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a25ffb640 1 -- 172.21.15.5:0/832254457 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560f14e44610 con 0x560f14eec490 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a25ffb640 10 client.15231 handle_command_reply: tid=0 2024-09-10T22:16:43.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 client.15231 shutdown 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 msgr2=0x560f14ef0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 0x560f14ef0f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x560f14ecece0 tx=0x7f8a3400f420 comp rx=0 tx=0).stop 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 shutdown_connections 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x560f14eec490 0x560f14f5c8c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a25ffb640 0 client.15231 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560f14edb5e0 0x560f14ef1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560f14ecf650 0x560f14ef0f00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 --2- 172.21.15.5:0/832254457 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560f14eced30 0x560f14ef09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 >> 172.21.15.5:0/832254457 conn(0x560f14eccb60 msgr2=0x560f14eeb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 shutdown_connections 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 1 -- 172.21.15.5:0/832254457 wait complete. 2024-09-10T22:16:43.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a47166740 20 client.15231 trim_cache size 0 max 16384 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 2, 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24562, 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 90.972596719999999, 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 78, 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T22:16:43.483 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 120.25151925199999 2024-09-10T22:16:43.484 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:16:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a280b52e0 msgr2=0x7f8a280b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a44d91640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a280b52e0 0x7f8a280b77a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8a38005fd0 tx=0x7f8a380073a0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.484 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 msgr2=0x7f8a4019f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.368+0000 7f8a44d91640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a4019f830 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8a30006010 tx=0x7f8a300042f0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 shutdown_connections 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8a280b52e0 0x7f8a280b77a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8a40106f10 0x7f8a401a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8a401023f0 0x7f8a4019fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 --2- 172.21.15.5:0/458326243 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8a40101ad0 0x7f8a4019f830 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 >> 172.21.15.5:0/458326243 conn(0x7f8a400fd700 msgr2=0x7f8a40104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 shutdown_connections 2024-09-10T22:16:43.485 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:43.369+0000 7f8a44d91640 1 -- 172.21.15.5:0/458326243 wait complete. 2024-09-10T22:16:43.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:43 smithi005 ceph-mon[31115]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:43.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:43 smithi052 ceph-mon[34997]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:43.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:43 smithi189 ceph-mon[35784]: pgmap v342: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:44.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-10T22:16:44.306 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:44.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:44 smithi005 ceph-mon[31115]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:44.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:44 smithi052 ceph-mon[34997]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:44.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.777+0000 7f98059a5640 1 -- 172.21.15.5:0/476733257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 msgr2=0x7f9800108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 --2- 172.21.15.5:0/476733257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f9800108c30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f97e8009900 tx=0x7f97e802a410 comp rx=0 tx=0).stop 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 -- 172.21.15.5:0/476733257 shutdown_connections 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 --2- 172.21.15.5:0/476733257 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 0x7f980010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 --2- 172.21.15.5:0/476733257 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f9800108c30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 --2- 172.21.15.5:0/476733257 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9800102de0 0x7f98001031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 -- 172.21.15.5:0/476733257 >> 172.21.15.5:0/476733257 conn(0x7f98000fe830 msgr2=0x7f9800100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 -- 172.21.15.5:0/476733257 shutdown_connections 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 -- 172.21.15.5:0/476733257 wait complete. 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 Processor -- start 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.778+0000 7f98059a5640 1 -- start start 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f98059a5640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9800102de0 0x7f9800199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f98059a5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f98001999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f98059a5640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 0x7f980019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.805 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f98059a5640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9800112e70 con 0x7f98001087f0 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f98059a5640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9800112cf0 con 0x7f9800102de0 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f98059a5640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9800112ff0 con 0x7f9800109170 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f98001999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f98001999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52074/0 (socket says 172.21.15.5:52074) 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 -- 172.21.15.5:0/4266455823 learned_addr learned my addr 172.21.15.5:0/4266455823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97feffd640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9800102de0 0x7f9800199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 0x7f980019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 -- 172.21.15.5:0/4266455823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 msgr2=0x7f980019ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 0x7f980019ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 -- 172.21.15.5:0/4266455823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9800102de0 msgr2=0x7f9800199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9800102de0 0x7f9800199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 -- 172.21.15.5:0/4266455823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980019f530 con 0x7f98001087f0 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 0x7f980019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:44.806 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.779+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f98001999c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f97e8006010 tx=0x7f97e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.780+0000 7f98049a3640 1 -- 172.21.15.5:0/4266455823 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e803f030 con 0x7f98001087f0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.780+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980019f7c0 con 0x7f98001087f0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.780+0000 7f98049a3640 1 -- 172.21.15.5:0/4266455823 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e8003800 con 0x7f98001087f0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.780+0000 7f98049a3640 1 -- 172.21.15.5:0/4266455823 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8035070 con 0x7f98001087f0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.780+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98001a5ee0 con 0x7f98001087f0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f98049a3640 1 -- 172.21.15.5:0/4266455823 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f97e8003cb0 con 0x7f98001087f0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 Processor -- start 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 -- start start 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f488ba2c10 con 0x55f488c375e0 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f488b92040 con 0x55f488c2ad30 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.782+0000 7f9807d7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f488b95e50 con 0x55f488c2b650 2024-09-10T22:16:44.807 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c399d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52080/0 (socket says 172.21.15.5:52080) 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 -- 172.21.15.5:0/3192708340 learned_addr learned my addr 172.21.15.5:0/3192708340 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97feffd640 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 -- 172.21.15.5:0/3192708340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 msgr2=0x55f488c370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 -- 172.21.15.5:0/3192708340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 msgr2=0x55f488c2b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 -- 172.21.15.5:0/3192708340 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4888f0540 con 0x55f488c375e0 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97feffd640 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f98049a3640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97ec0b52e0 0x7f97ec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97ec0b52e0 0x7f97ec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f98049a3640 1 -- 172.21.15.5:0/4266455823 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f97e81064e0 con 0x7f98001087f0 2024-09-10T22:16:44.808 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c399d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f97e810c680 tx=0x7f97e810c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b7ccd0c2f400f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.783+0000 7f97f5ffb640 1 -- 172.21.15.5:0/3192708340 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8049030 con 0x55f488c375e0 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97ec0b52e0 0x7f97ec0b77a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97f000c610 tx=0x7f97f000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f97f5ffb640 1 -- 172.21.15.5:0/3192708340 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e80cc7e0 con 0x55f488c375e0 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f97f5ffb640 1 -- 172.21.15.5:0/3192708340 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80ccaa0 con 0x55f488c375e0 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 -- 172.21.15.5:0/3192708340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 msgr2=0x55f488c399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c399d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f97e810c680 tx=0x7f97e810c770 comp rx=0 tx=0).stop 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 -- 172.21.15.5:0/3192708340 shutdown_connections 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c399d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 --2- 172.21.15.5:0/3192708340 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 -- 172.21.15.5:0/3192708340 >> 172.21.15.5:0/3192708340 conn(0x55f488c28b60 msgr2=0x55f488c29d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 -- 172.21.15.5:0/3192708340 shutdown_connections 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.784+0000 7f9807d7a740 1 -- 172.21.15.5:0/3192708340 wait complete. 2024-09-10T22:16:44.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 -- start start 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 Processor -- start 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c34530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c34a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488c34fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f4889f35f0 con 0x55f488c2ad30 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f488b2d010 con 0x55f488c2b650 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f488c3a050 con 0x55f488c375e0 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f9807d7a740 10 client.0 _ll_register_callbacks cb 0x55f488b8c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f97feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c34530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f97feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c34530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52086/0 (socket says 172.21.15.5:52086) 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f97feffd640 1 -- 172.21.15.5:0/1880394909 learned_addr learned my addr 172.21.15.5:0/1880394909 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.785+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c34a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488c34fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97feffd640 1 -- 172.21.15.5:0/1880394909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 msgr2=0x55f488c34fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97feffd640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488c34fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97feffd640 1 -- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 msgr2=0x55f488c34a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97feffd640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c34a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97feffd640 1 -- 172.21.15.5:0/1880394909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f488b5aa00 con 0x55f488c2ad30 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488c34fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97feffd640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c34530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009e00 tx=0x7f97f8011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36da8ce5b16ea5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97deffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97deffd640 1 -- 172.21.15.5:0/1880394909 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8019070 con 0x55f488c2ad30 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97deffd640 1 -- 172.21.15.5:0/1880394909 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f97f8015660 con 0x55f488c2ad30 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e80cc7e0 con 0x55f488c2ad30 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97deffd640 1 -- 172.21.15.5:0/1880394909 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97f8025050 con 0x55f488c2ad30 2024-09-10T22:16:44.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f9807d7a740 10 client.15243 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f488c45b70 con 0x55f488c2ad30 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97deffd640 1 -- 172.21.15.5:0/1880394909 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e80cc7e0 con 0x55f488c2ad30 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.786+0000 7f97deffd640 1 -- 172.21.15.5:0/1880394909 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f97f8014910 con 0x55f488c2ad30 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f9807d7a740 10 client.15243 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f9807d7a740 10 client.15243 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f9807d7a740 20 client.15243 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488c48180 0x55f488c495f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f9807d7a740 4 client.15243 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f488ba4b60 con 0x55f488c48180 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488c48180 0x55f488c495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f97deffd640 10 client.15243 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.787+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488c48180 0x55f488c495f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6f8bc7aac595f318 server_cookie=e46e4a1d77d2417a in_seq=0 out_seq=0 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f97deffd640 1 -- 172.21.15.5:0/1880394909 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f488ba4b60 con 0x55f488c48180 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f97deffd640 10 client.15243 handle_command_reply: tid=0 2024-09-10T22:16:44.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 client.15243 shutdown 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 msgr2=0x55f488c34530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c34530 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009e00 tx=0x7f97f8011630 comp rx=0 tx=0).stop 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 shutdown_connections 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488c34fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c34a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488c48180 0x55f488c495f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1880394909 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c34530 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 >> 172.21.15.5:0/1880394909 conn(0x55f488c28b60 msgr2=0x55f488c2e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f97deffd640 0 client.15243 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 shutdown_connections 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 1 -- 172.21.15.5:0/1880394909 wait complete. 2024-09-10T22:16:44.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.788+0000 7f9807d7a740 20 client.15243 trim_cache size 0 max 16384 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.806+0000 7f9807d7a740 1 Processor -- start 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 -- start start 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c51cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c52200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f488c47930 con 0x55f488c375e0 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f488c48000 con 0x55f488c2ad30 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f9807d7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f488c486d0 con 0x55f488c2b650 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c52200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c52200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52100/0 (socket says 172.21.15.5:52100) 2024-09-10T22:16:44.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 -- 172.21.15.5:0/1570861377 learned_addr learned my addr 172.21.15.5:0/1570861377 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97feffd640 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c51cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 -- 172.21.15.5:0/1570861377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 msgr2=0x55f488c51cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c51cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 -- 172.21.15.5:0/1570861377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 msgr2=0x55f488c2eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 -- 172.21.15.5:0/1570861377 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f488c295e0 con 0x55f488c375e0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c51cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.807+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c52200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97f00079f0 tx=0x7f97f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed2707198614569 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f97f57fa640 1 -- 172.21.15.5:0/1570861377 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f001e040 con 0x55f488c375e0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f97f57fa640 1 -- 172.21.15.5:0/1570861377 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f0027070 con 0x55f488c375e0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f97f57fa640 1 -- 172.21.15.5:0/1570861377 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f00163c0 con 0x55f488c375e0 2024-09-10T22:16:44.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 -- 172.21.15.5:0/1570861377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 msgr2=0x55f488c52200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c52200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f97f00079f0 tx=0x7f97f0014000 comp rx=0 tx=0).stop 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 -- 172.21.15.5:0/1570861377 shutdown_connections 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c375e0 0x55f488c52200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c2b650 0x55f488c51cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1570861377 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2ad30 0x55f488c2eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 -- 172.21.15.5:0/1570861377 >> 172.21.15.5:0/1570861377 conn(0x55f488c28b60 msgr2=0x55f488c2f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 -- 172.21.15.5:0/1570861377 shutdown_connections 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.808+0000 7f9807d7a740 1 -- 172.21.15.5:0/1570861377 wait complete. 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 -- start start 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 Processor -- start 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c4a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c4ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488cb7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55f488c49470 con 0x55f488c2ad30 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55f488c48da0 con 0x55f488c2b650 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55f488c49b40 con 0x55f488c375e0 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f9807d7a740 10 client.0 _ll_register_callbacks cb 0x7f97f80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f97feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c4a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f97feffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c4a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52114/0 (socket says 172.21.15.5:52114) 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f97feffd640 1 -- 172.21.15.5:0/1393714362 learned_addr learned my addr 172.21.15.5:0/1393714362 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.809+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c4ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488cb7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97feffd640 1 -- 172.21.15.5:0/1393714362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 msgr2=0x55f488cb7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97feffd640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488cb7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97feffd640 1 -- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 msgr2=0x55f488c4ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97feffd640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c4ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97feffd640 1 -- 172.21.15.5:0/1393714362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f488c4b600 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97ff7fe640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488cb7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97feffd640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c4a7f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f97f8004700 tx=0x7f97f8009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220be8e96fa13492 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97deffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97deffd640 1 -- 172.21.15.5:0/1393714362 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f802d070 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97deffd640 1 -- 172.21.15.5:0/1393714362 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f97f80145e0 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f0027070 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97deffd640 1 -- 172.21.15.5:0/1393714362 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f97f8039050 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f9807d7a740 10 client.15249 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f488cb90a0 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.810+0000 7f97deffd640 1 -- 172.21.15.5:0/1393714362 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f0027070 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f97deffd640 1 -- 172.21.15.5:0/1393714362 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f97f8006690 con 0x55f488c2ad30 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 10 client.15249 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-10T22:16:44.822 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 20 client.15249 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488cbdd10 0x55f488cbca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 4 client.15249 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "status"}) -- 0x55f488ba0610 con 0x55f488cbdd10 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488cbdd10 0x55f488cbca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f97fe7fc640 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488cbdd10 0x55f488cbca20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1a5b821c72088e6d server_cookie=46ebdd69b27c4c57 in_seq=0 out_seq=0 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f97deffd640 10 client.15249 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f97deffd640 1 -- 172.21.15.5:0/1393714362 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55f488ba0610 con 0x55f488cbdd10 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f97deffd640 10 client.15249 handle_command_reply: tid=0 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.811+0000 7f9807d7a740 1 client.15249 shutdown 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 msgr2=0x55f488c4a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c4a7f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f97f8004700 tx=0x7f97f8009110 comp rx=0 tx=0).stop 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 shutdown_connections 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55f488c375e0 0x55f488cb7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.823 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55f488c2b650 0x55f488c4ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55f488cbdd10 0x55f488cbca20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 --2- 172.21.15.5:0/1393714362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55f488c2ad30 0x55f488c4a7f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f97deffd640 0 client.15249 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 >> 172.21.15.5:0/1393714362 conn(0x55f488c28b60 msgr2=0x55f488c329b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 shutdown_connections 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 1 -- 172.21.15.5:0/1393714362 wait complete. 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f9807d7a740 20 client.15249 trim_cache size 0 max 16384 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:16:44.824 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 1, 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24563, 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 93.433599482000005, 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 78, 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 124.26157465 2024-09-10T22:16:44.825 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97ec0b52e0 msgr2=0x7f97ec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97ec0b52e0 0x7f97ec0b77a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97f000c610 tx=0x7f97f000e040 comp rx=0 tx=0).stop 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 msgr2=0x7f98001999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f98001999c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f97e8006010 tx=0x7f97e80042f0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 shutdown_connections 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97ec0b52e0 0x7f97ec0b77a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9800109170 0x7f980019ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f98001087f0 0x7f98001999c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 --2- 172.21.15.5:0/4266455823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9800102de0 0x7f9800199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:44.826 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.812+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 >> 172.21.15.5:0/4266455823 conn(0x7f98000fe830 msgr2=0x7f9800100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.813+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 shutdown_connections 2024-09-10T22:16:44.827 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:44.813+0000 7f98059a5640 1 -- 172.21.15.5:0/4266455823 wait complete. 2024-09-10T22:16:44.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:44 smithi189 ceph-mon[35784]: pgmap v343: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:16:45.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-10T22:16:45.823 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:46.271 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 -- 172.21.15.5:0/1686501416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c104600 msgr2=0x7f065c10caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 --2- 172.21.15.5:0/1686501416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c104600 0x7f065c10caf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0644009900 tx=0x7f064402a410 comp rx=0 tx=0).stop 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 -- 172.21.15.5:0/1686501416 shutdown_connections 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 --2- 172.21.15.5:0/1686501416 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c10d140 0x7f065c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 --2- 172.21.15.5:0/1686501416 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c104600 0x7f065c10caf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 --2- 172.21.15.5:0/1686501416 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c103ce0 0x7f065c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 -- 172.21.15.5:0/1686501416 >> 172.21.15.5:0/1686501416 conn(0x7f065c0fd700 msgr2=0x7f065c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 -- 172.21.15.5:0/1686501416 shutdown_connections 2024-09-10T22:16:46.272 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.270+0000 7f0660b13640 1 -- 172.21.15.5:0/1686501416 wait complete. 2024-09-10T22:16:46.274 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 Processor -- start 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 -- start start 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 0x7f065c199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c104600 0x7f065c199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c10d140 0x7f065c19ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f065c112df0 con 0x7f065c103ce0 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f065c112c70 con 0x7f065c10d140 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0660b13640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f065c112f70 con 0x7f065c104600 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f065a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 0x7f065c199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f065a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 0x7f065c199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52130/0 (socket says 172.21.15.5:52130) 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f065a59c640 1 -- 172.21.15.5:0/3213287992 learned_addr learned my addr 172.21.15.5:0/3213287992 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f065ad9d640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c10d140 0x7f065c19ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.271+0000 7f0659d9b640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c104600 0x7f065c199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065a59c640 1 -- 172.21.15.5:0/3213287992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c104600 msgr2=0x7f065c199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065a59c640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c104600 0x7f065c199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065a59c640 1 -- 172.21.15.5:0/3213287992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c10d140 msgr2=0x7f065c19ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065a59c640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c10d140 0x7f065c19ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065a59c640 1 -- 172.21.15.5:0/3213287992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c19f3f0 con 0x7f065c103ce0 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065ad9d640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c10d140 0x7f065c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f0659d9b640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c104600 0x7f065c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f065a59c640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 0x7f065c199340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b4a0 tx=0x7f064c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f06537fe640 1 -- 172.21.15.5:0/3213287992 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c014070 con 0x7f065c103ce0 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f06537fe640 1 -- 172.21.15.5:0/3213287992 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f064c010ac0 con 0x7f065c103ce0 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c19f6e0 con 0x7f065c103ce0 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f06537fe640 1 -- 172.21.15.5:0/3213287992 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c017c30 con 0x7f065c103ce0 2024-09-10T22:16:46.276 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.272+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c1a5e20 con 0x7f065c103ce0 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.274+0000 7f06537fe640 1 -- 172.21.15.5:0/3213287992 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f064c010610 con 0x7f065c103ce0 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.274+0000 7f0662ee8740 1 Processor -- start 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 -- start start 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b3d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b4d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55df81ab4c10 con 0x55df81b4d9f0 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55df81aa4040 con 0x55df81b3d650 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0662ee8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55df81aa7e50 con 0x55df81b3cd30 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b4fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52140/0 (socket says 172.21.15.5:52140) 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 -- 172.21.15.5:0/401167755 learned_addr learned my addr 172.21.15.5:0/401167755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f065a59c640 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b4d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f065ad9d640 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b3d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 -- 172.21.15.5:0/401167755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 msgr2=0x55df81b3d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b3d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 -- 172.21.15.5:0/401167755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 msgr2=0x55df81b4d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.275+0000 7f0659d9b640 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b4d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f0659d9b640 1 -- 172.21.15.5:0/401167755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df81802540 con 0x55df81b4d9f0 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f06537fe640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f06480b52e0 0x7f06480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f0659d9b640 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b4fde0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0644006010 tx=0x7f0644005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd537a6111cb945 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f065ad9d640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f06480b52e0 0x7f06480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f06537fe640 1 -- 172.21.15.5:0/3213287992 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f064c0e5540 con 0x7f065c103ce0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f0650ff9640 1 -- 172.21.15.5:0/401167755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064403f070 con 0x55df81b4d9f0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f0650ff9640 1 -- 172.21.15.5:0/401167755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06440316a0 con 0x55df81b4d9f0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.276+0000 7f0650ff9640 1 -- 172.21.15.5:0/401167755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644035070 con 0x55df81b4d9f0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 -- 172.21.15.5:0/401167755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 msgr2=0x55df81b4fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f065ad9d640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f06480b52e0 0x7f06480b77a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0654005fd0 tx=0x7f0654008630 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b4fde0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0644006010 tx=0x7f0644005e80 comp rx=0 tx=0).stop 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 -- 172.21.15.5:0/401167755 shutdown_connections 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b4fde0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b4d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 --2- 172.21.15.5:0/401167755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b3d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 -- 172.21.15.5:0/401167755 >> 172.21.15.5:0/401167755 conn(0x55df81b3ab60 msgr2=0x55df81b3bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 -- 172.21.15.5:0/401167755 shutdown_connections 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 -- 172.21.15.5:0/401167755 wait complete. 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 -- start start 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.277+0000 7f0662ee8740 1 Processor -- start 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 0x55df81b4d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3d650 0x55df81b4a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b4d9f0 0x55df81b4b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55df819055f0 con 0x55df81b3cd30 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55df81a3f010 con 0x55df81b4d9f0 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55df81b50610 con 0x55df81b3d650 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 0x55df81b4d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0662ee8740 10 client.0 _ll_register_callbacks cb 0x55df81a9e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 0x55df81b4d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52156/0 (socket says 172.21.15.5:52156) 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 -- 172.21.15.5:0/509815249 learned_addr learned my addr 172.21.15.5:0/509815249 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:46.284 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0659d9b640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3d650 0x55df81b4a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065ad9d640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b4d9f0 0x55df81b4b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 -- 172.21.15.5:0/509815249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3d650 msgr2=0x55df81b4a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3d650 0x55df81b4a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 -- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b4d9f0 msgr2=0x55df81b4b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b4d9f0 0x55df81b4b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 -- 172.21.15.5:0/509815249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df81a6ca00 con 0x55df81b3cd30 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065ad9d640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b4d9f0 0x55df81b4b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f065a59c640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 0x55df81b4d4a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f064c000c00 tx=0x7f064c0a7c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8953333947e5f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0641ffb640 1 -- 172.21.15.5:0/509815249 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c01e070 con 0x55df81b3cd30 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.278+0000 7f0641ffb640 1 -- 172.21.15.5:0/509815249 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f064c010c70 con 0x55df81b3cd30 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06440316a0 con 0x55df81b3cd30 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0641ffb640 1 -- 172.21.15.5:0/509815249 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f064c0ab4a0 con 0x55df81b3cd30 2024-09-10T22:16:46.285 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 10 client.15261 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55df81b5c1b0 con 0x55df81b3cd30 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0641ffb640 1 -- 172.21.15.5:0/509815249 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06440316a0 con 0x55df81b3cd30 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0641ffb640 1 -- 172.21.15.5:0/509815249 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f064c0a7fa0 con 0x55df81b3cd30 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 10 client.15261 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 10 client.15261 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 20 client.15261 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81b5e780 0x55df81b5fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 4 client.15261 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df81ab6b60 con 0x55df81b5e780 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.279+0000 7f0659d9b640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81b5e780 0x55df81b5fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.280+0000 7f0659d9b640 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81b5e780 0x55df81b5fbf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb5491066cab0cb9 server_cookie=fd9d03eda869c314 in_seq=0 out_seq=0 2024-09-10T22:16:46.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.280+0000 7f0641ffb640 10 client.15261 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0641ffb640 1 -- 172.21.15.5:0/509815249 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df81ab6b60 con 0x55df81b5e780 2024-09-10T22:16:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0641ffb640 10 client.15261 handle_command_reply: tid=0 2024-09-10T22:16:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 client.15261 shutdown 2024-09-10T22:16:46.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 msgr2=0x55df81b4d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 0x55df81b4d4a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f064c000c00 tx=0x7f064c0a7c90 comp rx=0 tx=0).stop 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 shutdown_connections 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81b5e780 0x55df81b5fbf0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b4d9f0 0x55df81b4b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3d650 0x55df81b4a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 --2- 172.21.15.5:0/509815249 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3cd30 0x55df81b4d4a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 >> 172.21.15.5:0/509815249 conn(0x55df81b3ab60 msgr2=0x55df81b406d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0641ffb640 0 client.15261 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 shutdown_connections 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 1 -- 172.21.15.5:0/509815249 wait complete. 2024-09-10T22:16:46.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.281+0000 7f0662ee8740 20 client.15261 trim_cache size 0 max 16384 2024-09-10T22:16:46.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 Processor -- start 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 -- start start 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3cd30 0x55df81b5e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 0x55df81b48480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b4d9f0 0x55df81b5d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55df81b5df30 con 0x55df81b3d650 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55df81b5e600 con 0x55df81b3cd30 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.299+0000 7f0662ee8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55df81b5ecd0 con 0x55df81b4d9f0 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 0x55df81b48480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 0x55df81b48480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52162/0 (socket says 172.21.15.5:52162) 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 -- 172.21.15.5:0/2881033673 learned_addr learned my addr 172.21.15.5:0/2881033673 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f065a59c640 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3cd30 0x55df81b5e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f065ad9d640 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b4d9f0 0x55df81b5d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 -- 172.21.15.5:0/2881033673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b4d9f0 msgr2=0x55df81b5d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b4d9f0 0x55df81b5d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 -- 172.21.15.5:0/2881033673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3cd30 msgr2=0x55df81b5e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3cd30 0x55df81b5e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 -- 172.21.15.5:0/2881033673 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df81b3a4f0 con 0x55df81b3d650 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f065ad9d640 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b4d9f0 0x55df81b5d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0659d9b640 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 0x55df81b48480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0644009850 tx=0x7f0644005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d7c9155e4675b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:46.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0643fff640 1 -- 172.21.15.5:0/2881033673 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644050020 con 0x55df81b3d650 2024-09-10T22:16:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0643fff640 1 -- 172.21.15.5:0/2881033673 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06440317c0 con 0x55df81b3d650 2024-09-10T22:16:46.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.300+0000 7f0643fff640 1 -- 172.21.15.5:0/2881033673 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064403f030 con 0x55df81b3d650 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 -- 172.21.15.5:0/2881033673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 msgr2=0x55df81b48480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 0x55df81b48480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0644009850 tx=0x7f0644005b50 comp rx=0 tx=0).stop 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 -- 172.21.15.5:0/2881033673 shutdown_connections 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b4d9f0 0x55df81b5d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b3d650 0x55df81b48480 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 --2- 172.21.15.5:0/2881033673 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3cd30 0x55df81b5e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 -- 172.21.15.5:0/2881033673 >> 172.21.15.5:0/2881033673 conn(0x55df81b3ab60 msgr2=0x55df81b35c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 -- 172.21.15.5:0/2881033673 shutdown_connections 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 -- 172.21.15.5:0/2881033673 wait complete. 2024-09-10T22:16:46.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 -- start start 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.301+0000 7f0662ee8740 1 Processor -- start 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b39580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b39ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b3dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55df81b5fa70 con 0x55df81b4d9f0 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55df81b5f3a0 con 0x55df81b3d650 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55df81b60140 con 0x55df81b3cd30 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 10 client.0 _ll_register_callbacks cb 0x7f064c010930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b3dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b3dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52168/0 (socket says 172.21.15.5:52168) 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 -- 172.21.15.5:0/852343952 learned_addr learned my addr 172.21.15.5:0/852343952 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0659d9b640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b39ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065a59c640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b39580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 -- 172.21.15.5:0/852343952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 msgr2=0x55df81b39580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b39580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 -- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 msgr2=0x55df81b39ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b39ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 -- 172.21.15.5:0/852343952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df81b3a1b0 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f065ad9d640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b3dd80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f065401ebb0 tx=0x7f0654004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915d4278bdfb82a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0641ffb640 1 -- 172.21.15.5:0/852343952 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065400eb30 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0641ffb640 1 -- 172.21.15.5:0/852343952 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f065400ecd0 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.302+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06440317c0 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0641ffb640 1 -- 172.21.15.5:0/852343952 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f065402f070 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 10 client.15267 fetch_fsmap learned FSMap version 24 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55df81bcb5a0 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0641ffb640 1 -- 172.21.15.5:0/852343952 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06440317c0 con 0x55df81b4d9f0 2024-09-10T22:16:46.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0641ffb640 1 -- 172.21.15.5:0/852343952 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f065401f6b0 con 0x55df81b4d9f0 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 10 client.15267 fetch_fsmap finished waiting for FSMap version 24 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 20 client.15267 populate_metadata read hostname 'smithi005' 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81bd0210 0x55df81bcef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 4 client.15267 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "status"}) -- 0x55df81ab2610 con 0x55df81bd0210 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.303+0000 7f065a59c640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81bd0210 0x55df81bcef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f065a59c640 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81bd0210 0x55df81bcef20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9a73be79e028939 server_cookie=be487def1968c61b in_seq=0 out_seq=0 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0641ffb640 10 client.15267 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0641ffb640 1 -- 172.21.15.5:0/852343952 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55df81ab2610 con 0x55df81bd0210 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0641ffb640 10 client.15267 handle_command_reply: tid=0 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 client.15267 shutdown 2024-09-10T22:16:46.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 msgr2=0x55df81b3dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b3dd80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f065401ebb0 tx=0x7f0654004a40 comp rx=0 tx=0).stop 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 shutdown_connections 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55df81bd0210 0x55df81bcef20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55df81b4d9f0 0x55df81b3dd80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55df81b3d650 0x55df81b39ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 --2- 172.21.15.5:0/852343952 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55df81b3cd30 0x55df81b39580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 >> 172.21.15.5:0/852343952 conn(0x55df81b3ab60 msgr2=0x55df81b4f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0641ffb640 0 client.15267 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 shutdown_connections 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 1 -- 172.21.15.5:0/852343952 wait complete. 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.304+0000 7f0662ee8740 20 client.15267 trim_cache size 0 max 16384 2024-09-10T22:16:46.312 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_fsid": "ca2ddb2e-6fc0-11ef-bcea-c7b262605968", 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "whoami": 0, 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "id": 24578, 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "want_state": "up:active", 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "state": "up:active", 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "fs_name": "cephfs", 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "rank_uptime": 102.963216324, 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "mdsmap_epoch": 24, 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch": 78, 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_epoch_barrier": 76, 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout: "uptime": 114.138508868 2024-09-10T22:16:46.313 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:16:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f06480b52e0 msgr2=0x7f06480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f06480b52e0 0x7f06480b77a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0654005fd0 tx=0x7f0654008630 comp rx=0 tx=0).stop 2024-09-10T22:16:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 msgr2=0x7f065c199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 0x7f065c199340 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f064c00b4a0 tx=0x7f064c00b960 comp rx=0 tx=0).stop 2024-09-10T22:16:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 shutdown_connections 2024-09-10T22:16:46.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f06480b52e0 0x7f06480b77a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f065c10d140 0x7f065c19ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f065c104600 0x7f065c199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 --2- 172.21.15.5:0/3213287992 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f065c103ce0 0x7f065c199340 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 >> 172.21.15.5:0/3213287992 conn(0x7f065c0fd700 msgr2=0x7f065c0fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 shutdown_connections 2024-09-10T22:16:46.315 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:46.305+0000 7f0660b13640 1 -- 172.21.15.5:0/3213287992 wait complete. 2024-09-10T22:16:47.012 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:46 smithi005 ceph-mon[31115]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:47.041 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T22:16:47.147 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T22:16:47.147 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-10T22:16:47.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:47.147 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-10T22:16:47.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:47.166 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-09-10T22:16:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:46 smithi189 ceph-mon[35784]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:47.236 INFO:teuthology.orchestra.run.smithi005.stderr:Cannot find device "ceph-brx" 2024-09-10T22:16:47.237 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:16:47.237 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-10T22:16:47.237 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T22:16:47.238 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:16:47.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-10T22:16:47.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:46 smithi052 ceph-mon[34997]: pgmap v344: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-10T22:16:47.535 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 -- 172.21.15.5:0/3720710819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 msgr2=0x7ff1d0108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 --2- 172.21.15.5:0/3720710819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0108c10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8009900 tx=0x7ff1b802a410 comp rx=0 tx=0).stop 2024-09-10T22:16:48.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 -- 172.21.15.5:0/3720710819 shutdown_connections 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 --2- 172.21.15.5:0/3720710819 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d0109150 0x7ff1d010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 --2- 172.21.15.5:0/3720710819 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0108c10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 --2- 172.21.15.5:0/3720710819 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0102dc0 0x7ff1d01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 -- 172.21.15.5:0/3720710819 >> 172.21.15.5:0/3720710819 conn(0x7ff1d00fe830 msgr2=0x7ff1d0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 -- 172.21.15.5:0/3720710819 shutdown_connections 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.022+0000 7ff1d5107640 1 -- 172.21.15.5:0/3720710819 wait complete. 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 Processor -- start 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 -- start start 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0102dc0 0x7ff1d01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d0109150 0x7ff1d019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d0112e60 con 0x7ff1d01087d0 2024-09-10T22:16:48.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d0112ce0 con 0x7ff1d0109150 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1d5107640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d0112fe0 con 0x7ff1d0102dc0 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1c7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52196/0 (socket says 172.21.15.5:52196) 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.023+0000 7ff1c7fff640 1 -- 172.21.15.5:0/1836082926 learned_addr learned my addr 172.21.15.5:0/1836082926 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1ced9d640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0102dc0 0x7ff1d01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1cf59e640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d0109150 0x7ff1d019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1c7fff640 1 -- 172.21.15.5:0/1836082926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0102dc0 msgr2=0x7ff1d01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1c7fff640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0102dc0 0x7ff1d01992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1c7fff640 1 -- 172.21.15.5:0/1836082926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d0109150 msgr2=0x7ff1d019ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1c7fff640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d0109150 0x7ff1d019ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1c7fff640 1 -- 172.21.15.5:0/1836082926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d019f380 con 0x7ff1d01087d0 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1c7fff640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0199810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8005ab0 tx=0x7ff1b8003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:48.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b803f070 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b8031d60 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d019f610 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8035030 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.024+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d01a5d30 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.025+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1d01031a0 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.027+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff1b803b580 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.027+0000 7ff1ccd99640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1bc0b52e0 0x7ff1bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.027+0000 7ff1ced9d640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1bc0b52e0 0x7ff1bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.028+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff1b81066e0 con 0x7ff1d01087d0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.028+0000 7ff1ced9d640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1bc0b52e0 0x7ff1bc0b77a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0005fd0 tx=0x7ff1c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:48.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.032+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff1b80ccf80 con 0x7ff1d01087d0 2024-09-10T22:16:48.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.256+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff1d010af90 con 0x7ff1d01087d0 2024-09-10T22:16:48.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.257+0000 7ff1ccd99640 1 -- 172.21.15.5:0/1836082926 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7ff1b80d19b0 con 0x7ff1d01087d0 2024-09-10T22:16:48.259 INFO:teuthology.orchestra.run.smithi005.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T22:16:48.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1bc0b52e0 msgr2=0x7ff1bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1bc0b52e0 0x7ff1bc0b77a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff1c0005fd0 tx=0x7ff1c000b390 comp rx=0 tx=0).stop 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 msgr2=0x7ff1d0199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0199810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff1b8005ab0 tx=0x7ff1b8003cd0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 shutdown_connections 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1bc0b52e0 0x7ff1bc0b77a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1d0109150 0x7ff1d019ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1d01087d0 0x7ff1d0199810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 --2- 172.21.15.5:0/1836082926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff1d0102dc0 0x7ff1d01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:48.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 >> 172.21.15.5:0/1836082926 conn(0x7ff1d00fe830 msgr2=0x7ff1d0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 shutdown_connections 2024-09-10T22:16:48.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:48.260+0000 7ff1d5107640 1 -- 172.21.15.5:0/1836082926 wait complete. 2024-09-10T22:16:49.013 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:48 smithi005 ceph-mon[31115]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:49.013 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:48 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1836082926' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T22:16:49.042 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T22:16:49.042 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T22:16:49.042 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi005.front.sepia.ceph.com 2024-09-10T22:16:49.042 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T22:16:49.043 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T22:16:49.043 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T22:16:49.043 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T22:16:49.043 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T22:16:49.043 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:16:49.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:49.043 DEBUG:teuthology.orchestra.run.smithi005:> ip addr 2024-09-10T22:16:49.060 INFO:teuthology.orchestra.run.smithi005.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T22:16:49.060 INFO:teuthology.orchestra.run.smithi005.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T22:16:49.060 INFO:teuthology.orchestra.run.smithi005.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T22:16:49.060 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:16:49.060 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 ::1/128 scope host 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:de brd ff:ff:ff:ff:ff:ff 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f0 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:42 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f0 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: inet 172.21.15.5/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft 42122sec preferred_lft 42122sec 2024-09-10T22:16:49.061 INFO:teuthology.orchestra.run.smithi005.stdout: inet6 fe80::ec4:7aff:febd:1442/64 scope link 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout: valid_lft forever preferred_lft forever 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:6b:fd:df brd ff:ff:ff:ff:ff:ff 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp7s0f1 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout: link/ether 0c:c4:7a:bd:14:43 brd ff:ff:ff:ff:ff:ff 2024-09-10T22:16:49.062 INFO:teuthology.orchestra.run.smithi005.stdout: altname enp1s0f1 2024-09-10T22:16:49.062 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add name ceph-brx type bridge 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr flush dev ceph-brx 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set ceph-brx up 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T22:16:49.063 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-10T22:16:49.153 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:16:49.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:48 smithi189 ceph-mon[35784]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:49.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:48 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1836082926' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T22:16:49.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:48 smithi052 ceph-mon[34997]: pgmap v345: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:16:49.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:48 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1836082926' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-10T22:16:49.268 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:49.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:49.275 DEBUG:teuthology.orchestra.run.smithi005:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T22:16:49.302 INFO:teuthology.orchestra.run.smithi005.stdout:1 2024-09-10T22:16:49.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:49.304 DEBUG:teuthology.orchestra.run.smithi005:> route 2024-09-10T22:16:49.379 INFO:teuthology.orchestra.run.smithi005.stdout:Kernel IP routing table 2024-09-10T22:16:49.379 INFO:teuthology.orchestra.run.smithi005.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T22:16:49.379 INFO:teuthology.orchestra.run.smithi005.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T22:16:49.380 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T22:16:49.380 INFO:teuthology.orchestra.run.smithi005.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T22:16:49.380 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:16:49.380 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-10T22:16:49.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T22:16:49.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T22:16:49.381 DEBUG:teuthology.orchestra.run.smithi005:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T22:16:49.381 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-10T22:16:49.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:16:49.704 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:49.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:49.711 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-10T22:16:49.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:49.728 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list-id 2024-09-10T22:16:49.783 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:16:49.784 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-10T22:16:49.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:16:49.784 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T22:16:49.784 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-10T22:16:49.874 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:16:49.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:49.905 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T22:16:49.905 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:16:49.905 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-10T22:16:49.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T22:16:49.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T22:16:49.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T22:16:49.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T22:16:49.906 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T22:16:49.906 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-10T22:16:49.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:16:50.030 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:50.037 DEBUG:teuthology.orchestra.run.smithi005:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T22:16:50.037 DEBUG:teuthology.orchestra.run.smithi005:> set -e 2024-09-10T22:16:50.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set brx.0 up 2024-09-10T22:16:50.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T22:16:50.038 DEBUG:teuthology.orchestra.run.smithi005:> ') 2024-09-10T22:16:50.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:16:50.111 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:50.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:16:50.117 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T22:16:50.133 INFO:teuthology.orchestra.run.smithi005.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T22:16:50.133 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T22:16:50.134 DEBUG:teuthology.orchestra.run.smithi005:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:16:50.191 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-10T22:16:50.191 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-10T22:16:50.191 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/f60be848-4c1e-4e67-8e02-bf5c10104255 2024-09-10T22:16:50.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:50.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/f60be848-4c1e-4e67-8e02-bf5c10104255 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-10T22:16:50.297 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-10T22:16:50.297 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-10T22:16:50.298 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-09-10T22:16:50.425 INFO:teuthology.orchestra.run.smithi005.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-10T22:16:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-10T22:16:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:invalid new device string format 2024-09-10T22:16:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: resolved to: "172.21.15.5:3300,172.21.15.52:3300,172.21.15.189:3300" 2024-09-10T22:16:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.5:3300,172.21.15.52:3300,172.21.15.189:3300:/volumes/qa/sv_1/f60be848-4c1e-4e67-8e02-bf5c10104255 2024-09-10T22:16:50.426 INFO:teuthology.orchestra.run.smithi005.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=ca2ddb2e-6fc0-11ef-bcea-c7b262605968" will pass to kernel 2024-09-10T22:16:50.427 INFO:teuthology.orchestra.run.smithi005.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T22:16:50.427 INFO:teuthology.orchestra.run.smithi005.stdout: You just mounted a file system that supports labels which does not 2024-09-10T22:16:50.427 INFO:teuthology.orchestra.run.smithi005.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T22:16:50.427 INFO:teuthology.orchestra.run.smithi005.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T22:16:50.427 INFO:teuthology.orchestra.run.smithi005.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T22:16:50.428 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T22:16:50.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:16:50.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T22:16:50.456 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T22:16:50.547 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:16:50.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:50.555 INFO:teuthology.orchestra.run.smithi005.stdout:client24907 2024-09-10T22:16:50.556 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:16:50.556 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:16:50.573 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T22:16:50.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:16:50.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:50.671 INFO:teuthology.orchestra.run.smithi005.stdout:client24907 2024-09-10T22:16:50.672 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T22:16:50.722 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T22:16:50.724 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:50.730 INFO:teuthology.orchestra.run.smithi005.stdout:client24907 2024-09-10T22:16:50.731 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968.client24907/status') 2024-09-10T22:16:50.781 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T22:16:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:instance: client.24907 (3)172.21.15.5:0/230134135 2024-09-10T22:16:50.791 INFO:teuthology.orchestra.run.smithi005.stdout:blocklisted: false 2024-09-10T22:16:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records in 2024-09-10T22:16:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:0+1 records out 2024-09-10T22:16:50.791 INFO:teuthology.orchestra.run.smithi005.stderr:69 bytes copied, 2.7783e-05 s, 2.5 MB/s 2024-09-10T22:16:50.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T22:16:50.799 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T22:16:50.809 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T22:16:50.809 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:16:50.809 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-10T22:16:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 -- 172.21.15.5:0/2513270960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 msgr2=0x7f0af8105600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/2513270960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8105600 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8009900 tx=0x7f0ae802a410 comp rx=0 tx=0).stop 2024-09-10T22:16:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 -- 172.21.15.5:0/2513270960 shutdown_connections 2024-09-10T22:16:50.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/2513270960 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 0x7f0af810ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/2513270960 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 0x7f0af8107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/2513270960 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8105600 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 -- 172.21.15.5:0/2513270960 >> 172.21.15.5:0/2513270960 conn(0x7f0af80fd150 msgr2=0x7f0af80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 -- 172.21.15.5:0/2513270960 shutdown_connections 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 -- 172.21.15.5:0/2513270960 wait complete. 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.913+0000 7f0afe7ec640 1 Processor -- start 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 -- start start 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 0x7f0af81993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 0x7f0af8199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0af810e600 con 0x7f0af806be60 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0af810e480 con 0x7f0af81086b0 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0af810e780 con 0x7f0af8105b40 2024-09-10T22:16:50.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52210/0 (socket says 172.21.15.5:52210) 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 -- 172.21.15.5:0/440198107 learned_addr learned my addr 172.21.15.5:0/440198107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0aeffff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 0x7f0af81993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afcd89640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 0x7f0af8199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 -- 172.21.15.5:0/440198107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 msgr2=0x7f0af81993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 0x7f0af81993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 -- 172.21.15.5:0/440198107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 msgr2=0x7f0af8199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 0x7f0af8199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 -- 172.21.15.5:0/440198107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af819a890 con 0x7f0af806be60 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0aeffff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 0x7f0af81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afcd89640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 0x7f0af8199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af7fff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8198d50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8031500 tx=0x7f0ae80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae803f030 con 0x7f0af806be60 2024-09-10T22:16:50.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ae8003800 con 0x7f0af806be60 2024-09-10T22:16:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af819ab20 con 0x7f0af806be60 2024-09-10T22:16:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.914+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8035070 con 0x7f0af806be60 2024-09-10T22:16:50.919 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.915+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af81a1250 con 0x7f0af806be60 2024-09-10T22:16:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.915+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af8105f60 con 0x7f0af806be60 2024-09-10T22:16:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.917+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0ae8003cd0 con 0x7f0af806be60 2024-09-10T22:16:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.918+0000 7f0af5ffb640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0ae40b52e0 0x7f0ae40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.918+0000 7f0aeffff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0ae40b52e0 0x7f0ae40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.918+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f0ae8106cc0 con 0x7f0af806be60 2024-09-10T22:16:50.920 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.918+0000 7f0aeffff640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0ae40b52e0 0x7f0ae40b77a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0af806c3a0 tx=0x7f0ae0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:50.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:50.921+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0ae80cdbb0 con 0x7f0af806be60 2024-09-10T22:16:51.052 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:50 smithi052 ceph-mon[34997]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:51.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:50 smithi005 ceph-mon[31115]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:51.146 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.145+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f0af80fec40 con 0x7f0af806be60 2024-09-10T22:16:51.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:50 smithi189 ceph-mon[35784]: pgmap v346: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:51.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.797+0000 7f0af5ffb640 1 -- 172.21.15.5:0/440198107 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7f0ae80cd4b0 con 0x7f0af806be60 2024-09-10T22:16:51.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0ae40b52e0 msgr2=0x7f0ae40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0ae40b52e0 0x7f0ae40b77a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0af806c3a0 tx=0x7f0ae0005d90 comp rx=0 tx=0).stop 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 msgr2=0x7f0af8198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8198d50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0ae8031500 tx=0x7f0ae80043c0 comp rx=0 tx=0).stop 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 shutdown_connections 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f0ae40b52e0 0x7f0ae40b77a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0af81086b0 0x7f0af8199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0af8105b40 0x7f0af81993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 --2- 172.21.15.5:0/440198107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0af806be60 0x7f0af8198d50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 >> 172.21.15.5:0/440198107 conn(0x7f0af80fd150 msgr2=0x7f0af8103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 shutdown_connections 2024-09-10T22:16:51.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:51.800+0000 7f0afe7ec640 1 -- 172.21.15.5:0/440198107 wait complete. 2024-09-10T22:16:51.816 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-10T22:16:51.827 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-10T22:16:51.939 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:16:52.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 -- 172.21.15.5:0/1104607692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 msgr2=0x7fcc6c105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 --2- 172.21.15.5:0/1104607692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c105570 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009ca0 tx=0x7fcc5c02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 -- 172.21.15.5:0/1104607692 shutdown_connections 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 --2- 172.21.15.5:0/1104607692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc6c1086b0 0x7fcc6c10ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 --2- 172.21.15.5:0/1104607692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc6c105b00 0x7fcc6c107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 --2- 172.21.15.5:0/1104607692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c105570 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 -- 172.21.15.5:0/1104607692 >> 172.21.15.5:0/1104607692 conn(0x7fcc6c0fd140 msgr2=0x7fcc6c0ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 -- 172.21.15.5:0/1104607692 shutdown_connections 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 -- 172.21.15.5:0/1104607692 wait complete. 2024-09-10T22:16:52.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.054+0000 7fcc71f45640 1 Processor -- start 2024-09-10T22:16:52.057 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 -- start start 2024-09-10T22:16:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc6c105b00 0x7fcc6c101510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.058 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc6c1086b0 0x7fcc6c101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10e630 con 0x7fcc6c06b130 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10e4b0 con 0x7fcc6c105b00 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc71f45640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c10e7b0 con 0x7fcc6c1086b0 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52234/0 (socket says 172.21.15.5:52234) 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/3656061311 learned_addr learned my addr 172.21.15.5:0/3656061311 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6bfff640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc6c1086b0 0x7fcc6c101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6affd640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc6c105b00 0x7fcc6c101510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/3656061311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc6c1086b0 msgr2=0x7fcc6c101a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc6c1086b0 0x7fcc6c101a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/3656061311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc6c105b00 msgr2=0x7fcc6c101510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.059 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc6c105b00 0x7fcc6c101510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.055+0000 7fcc6b7fe640 1 -- 172.21.15.5:0/3656061311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c1022c0 con 0x7fcc6c06b130 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.056+0000 7fcc6b7fe640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c102cb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c000f80 tx=0x7fcc5c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.056+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0317c0 con 0x7fcc6c06b130 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.056+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc5c0044f0 con 0x7fcc6c06b130 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.056+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c1a2d70 con 0x7fcc6c06b130 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.056+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c02fcf0 con 0x7fcc6c06b130 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.056+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c1a31d0 con 0x7fcc6c06b130 2024-09-10T22:16:52.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.057+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c0fec30 con 0x7fcc6c06b130 2024-09-10T22:16:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.058+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fcc5c004040 con 0x7fcc6c06b130 2024-09-10T22:16:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.059+0000 7fcc68ff9640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcc580b52e0 0x7fcc580b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.059+0000 7fcc6affd640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcc580b52e0 0x7fcc580b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.059+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fcc5c106f90 con 0x7fcc6c06b130 2024-09-10T22:16:52.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.060+0000 7fcc6affd640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcc580b52e0 0x7fcc580b77a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400bbe0 tx=0x7fcc5400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:52.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.062+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc5c0cdfb0 con 0x7fcc6c06b130 2024-09-10T22:16:52.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:51 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/440198107' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T22:16:52.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:51 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/440198107' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T22:16:52.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:51 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/440198107' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-10T22:16:52.251 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.250+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcc6c02e810 con 0x7fcc6c06b130 2024-09-10T22:16:52.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.251+0000 7fcc68ff9640 1 -- 172.21.15.5:0/3656061311 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7fcc5c02fe90 con 0x7fcc6c06b130 2024-09-10T22:16:52.253 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:52.253 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcc580b52e0 msgr2=0x7fcc580b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcc580b52e0 0x7fcc580b77a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400bbe0 tx=0x7fcc5400b390 comp rx=0 tx=0).stop 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 msgr2=0x7fcc6c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c102cb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c000f80 tx=0x7fcc5c003ba0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 shutdown_connections 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fcc580b52e0 0x7fcc580b77a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fcc6c1086b0 0x7fcc6c101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fcc6c105b00 0x7fcc6c101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 --2- 172.21.15.5:0/3656061311 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fcc6c06b130 0x7fcc6c102cb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 >> 172.21.15.5:0/3656061311 conn(0x7fcc6c0fd140 msgr2=0x7fcc6c103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 shutdown_connections 2024-09-10T22:16:52.256 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.254+0000 7fcc71f45640 1 -- 172.21.15.5:0/3656061311 wait complete. 2024-09-10T22:16:52.266 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:10:20.089426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T22:14:58.643913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T22:15:00.986202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:16:52.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:16:52.375 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.372+0000 7fe153a72640 1 -- 172.21.15.5:0/4225332654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c1029d0 msgr2=0x7fe14c102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.372+0000 7fe153a72640 1 --2- 172.21.15.5:0/4225332654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c1029d0 0x7fe14c102e50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe140009930 tx=0x7fe14002a420 comp rx=0 tx=0).stop 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- 172.21.15.5:0/4225332654 shutdown_connections 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 --2- 172.21.15.5:0/4225332654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c103390 0x7fe14c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 --2- 172.21.15.5:0/4225332654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c1029d0 0x7fe14c102e50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 --2- 172.21.15.5:0/4225332654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c101880 0x7fe14c101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- 172.21.15.5:0/4225332654 >> 172.21.15.5:0/4225332654 conn(0x7fe14c0fd120 msgr2=0x7fe14c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- 172.21.15.5:0/4225332654 shutdown_connections 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- 172.21.15.5:0/4225332654 wait complete. 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 Processor -- start 2024-09-10T22:16:52.376 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- start start 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c101880 0x7fe14c06ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c1029d0 0x7fe14c19da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 0x7fe14c1a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10d4f0 con 0x7fe14c103390 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10d370 con 0x7fe14c101880 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe153a72640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10d670 con 0x7fe14c1029d0 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.373+0000 7fe15200f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 0x7fe14c1a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 0x7fe14c1a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39280/0 (socket says 172.21.15.5:39280) 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 -- 172.21.15.5:0/681138225 learned_addr learned my addr 172.21.15.5:0/681138225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15100d640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c1029d0 0x7fe14c19da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15180e640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c101880 0x7fe14c06ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 -- 172.21.15.5:0/681138225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c1029d0 msgr2=0x7fe14c19da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c1029d0 0x7fe14c19da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.377 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 -- 172.21.15.5:0/681138225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c101880 msgr2=0x7fe14c06ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c101880 0x7fe14c06ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 -- 172.21.15.5:0/681138225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c1a0990 con 0x7fe14c103390 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15180e640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c101880 0x7fe14c06ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15100d640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c1029d0 0x7fe14c19da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe15200f640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 0x7fe14c1a0080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe14400d750 tx=0x7fe14400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144017070 con 0x7fe14c103390 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1440054d0 con 0x7fe14c103390 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c1a0c20 con 0x7fe14c103390 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe144004c60 con 0x7fe14c103390 2024-09-10T22:16:52.378 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.374+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c1a1120 con 0x7fe14c103390 2024-09-10T22:16:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.375+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14c108bd0 con 0x7fe14c103390 2024-09-10T22:16:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.376+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe144004e00 con 0x7fe14c103390 2024-09-10T22:16:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.377+0000 7fe14affd640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe1340b52e0 0x7fe1340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.378+0000 7fe15180e640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe1340b52e0 0x7fe1340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.378+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe1440e5630 con 0x7fe14c103390 2024-09-10T22:16:52.379 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.378+0000 7fe15180e640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe1340b52e0 0x7fe1340b77a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe13c005fd0 tx=0x7fe13c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:52.383 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.382+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe1440ac520 con 0x7fe14c103390 2024-09-10T22:16:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.570+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe14c063d50 con 0x7fe14c103390 2024-09-10T22:16:52.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.570+0000 7fe14affd640 1 -- 172.21.15.5:0/681138225 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7fe1440abe20 con 0x7fe14c103390 2024-09-10T22:16:52.573 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe1340b52e0 msgr2=0x7fe1340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe1340b52e0 0x7fe1340b77a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe13c005fd0 tx=0x7fe13c009520 comp rx=0 tx=0).stop 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 msgr2=0x7fe14c1a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 0x7fe14c1a0080 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe14400d750 tx=0x7fe14400dc10 comp rx=0 tx=0).stop 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 shutdown_connections 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe1340b52e0 0x7fe1340b77a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe14c103390 0x7fe14c1a0080 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe14c1029d0 0x7fe14c19da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 --2- 172.21.15.5:0/681138225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe14c101880 0x7fe14c06ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.572+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 >> 172.21.15.5:0/681138225 conn(0x7fe14c0fd120 msgr2=0x7fe14c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:52.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.573+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 shutdown_connections 2024-09-10T22:16:52.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.573+0000 7fe153a72640 1 -- 172.21.15.5:0/681138225 wait complete. 2024-09-10T22:16:52.585 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T22:16:52.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 -- 172.21.15.5:0/2826201647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39006be30 msgr2=0x7ff390105550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.694 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 --2- 172.21.15.5:0/2826201647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39006be30 0x7ff390105550 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff380009900 tx=0x7ff38002a410 comp rx=0 tx=0).stop 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 -- 172.21.15.5:0/2826201647 shutdown_connections 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 --2- 172.21.15.5:0/2826201647 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff390108690 0x7ff39010ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 --2- 172.21.15.5:0/2826201647 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff390105ae0 0x7ff390107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 --2- 172.21.15.5:0/2826201647 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff39006be30 0x7ff390105550 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 -- 172.21.15.5:0/2826201647 >> 172.21.15.5:0/2826201647 conn(0x7ff3900fd120 msgr2=0x7ff3900ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 -- 172.21.15.5:0/2826201647 shutdown_connections 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.689+0000 7ff396189640 1 -- 172.21.15.5:0/2826201647 wait complete. 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 Processor -- start 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 -- start start 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39006be30 0x7ff390198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff390105ae0 0x7ff3901993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 0x7ff390199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff39010e610 con 0x7ff390108690 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff39010e490 con 0x7ff39006be30 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff396189640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff39010e790 con 0x7ff390105ae0 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff38ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 0x7ff390199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff38ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 0x7ff390199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39298/0 (socket says 172.21.15.5:39298) 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.690+0000 7ff38ffff640 1 -- 172.21.15.5:0/3823232371 learned_addr learned my addr 172.21.15.5:0/3823232371 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38effd640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff390105ae0 0x7ff3901993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38f7fe640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39006be30 0x7ff390198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38ffff640 1 -- 172.21.15.5:0/3823232371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff390105ae0 msgr2=0x7ff3901993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38ffff640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff390105ae0 0x7ff3901993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38ffff640 1 -- 172.21.15.5:0/3823232371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39006be30 msgr2=0x7ff390198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38ffff640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39006be30 0x7ff390198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38ffff640 1 -- 172.21.15.5:0/3823232371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39019a8a0 con 0x7ff390108690 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38f7fe640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39006be30 0x7ff390198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38ffff640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 0x7ff390199fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff388009fd0 tx=0x7ff38800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388017070 con 0x7ff390108690 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff388003e20 con 0x7ff390108690 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39019ab90 con 0x7ff390108690 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388010460 con 0x7ff390108690 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.691+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3901a1260 con 0x7ff390108690 2024-09-10T22:16:52.697 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.692+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3900fec10 con 0x7ff390108690 2024-09-10T22:16:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.694+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff388003970 con 0x7ff390108690 2024-09-10T22:16:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.694+0000 7ff38cff9640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3780b5360 0x7ff3780b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.695+0000 7ff38f7fe640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3780b5360 0x7ff3780b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.695+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff3880e58b0 con 0x7ff390108690 2024-09-10T22:16:52.698 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.695+0000 7ff38f7fe640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3780b5360 0x7ff3780b7820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff38002a930 tx=0x7ff380005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:52.699 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.697+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3880ac820 con 0x7ff390108690 2024-09-10T22:16:52.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.886+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff390063d50 con 0x7ff390108690 2024-09-10T22:16:52.889 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.886+0000 7ff38cff9640 1 -- 172.21.15.5:0/3823232371 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) ==== 104+0+11 (secure 0 0 0) 0x7ff3880ac120 con 0x7ff390108690 2024-09-10T22:16:52.889 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-10T22:16:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3780b5360 msgr2=0x7ff3780b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3780b5360 0x7ff3780b7820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff38002a930 tx=0x7ff380005fd0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.891 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 msgr2=0x7ff390199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 0x7ff390199fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff388009fd0 tx=0x7ff38800b260 comp rx=0 tx=0).stop 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 shutdown_connections 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3780b5360 0x7ff3780b7820 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff390108690 0x7ff390199fe0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff390105ae0 0x7ff3901993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 --2- 172.21.15.5:0/3823232371 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff39006be30 0x7ff390198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 >> 172.21.15.5:0/3823232371 conn(0x7ff3900fd120 msgr2=0x7ff390103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 shutdown_connections 2024-09-10T22:16:52.892 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:52.889+0000 7ff396189640 1 -- 172.21.15.5:0/3823232371 wait complete. 2024-09-10T22:16:52.901 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:52 smithi005 ceph-mon[31115]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:52.901 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/440198107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T22:16:52.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:52 smithi005 ceph-mon[31115]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:16:52.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3656061311' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:52.902 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/681138225' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:16:52.903 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T22:16:53.016 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.007+0000 7fb186fad640 1 -- 172.21.15.5:0/3650120610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180101880 msgr2=0x7fb180101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.007+0000 7fb186fad640 1 --2- 172.21.15.5:0/3650120610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180101880 0x7fb180101c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb178009930 tx=0x7fb17802a420 comp rx=0 tx=0).stop 2024-09-10T22:16:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.007+0000 7fb186fad640 1 -- 172.21.15.5:0/3650120610 shutdown_connections 2024-09-10T22:16:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.007+0000 7fb186fad640 1 --2- 172.21.15.5:0/3650120610 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb180103390 0x7fb180109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 --2- 172.21.15.5:0/3650120610 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1801029d0 0x7fb180102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 --2- 172.21.15.5:0/3650120610 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180101880 0x7fb180101c80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.017 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- 172.21.15.5:0/3650120610 >> 172.21.15.5:0/3650120610 conn(0x7fb1800fd120 msgr2=0x7fb1800ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- 172.21.15.5:0/3650120610 shutdown_connections 2024-09-10T22:16:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- 172.21.15.5:0/3650120610 wait complete. 2024-09-10T22:16:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 Processor -- start 2024-09-10T22:16:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- start start 2024-09-10T22:16:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb180101880 0x7fb180105710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.018 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1801029d0 0x7fb180103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 0x7fb1801044b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb18010d550 con 0x7fb180103390 2024-09-10T22:16:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb18010d3d0 con 0x7fb180101880 2024-09-10T22:16:53.019 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb186fad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb18010d6d0 con 0x7fb1801029d0 2024-09-10T22:16:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb18554a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 0x7fb1801044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb18554a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 0x7fb1801044b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39310/0 (socket says 172.21.15.5:39310) 2024-09-10T22:16:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.008+0000 7fb18554a640 1 -- 172.21.15.5:0/4040600602 learned_addr learned my addr 172.21.15.5:0/4040600602 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb184d49640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb180101880 0x7fb180105710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb17ffff640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1801029d0 0x7fb180103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.020 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb18554a640 1 -- 172.21.15.5:0/4040600602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1801029d0 msgr2=0x7fb180103f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb18554a640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1801029d0 0x7fb180103f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb18554a640 1 -- 172.21.15.5:0/4040600602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb180101880 msgr2=0x7fb180105710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb18554a640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb180101880 0x7fb180105710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb18554a640 1 -- 172.21.15.5:0/4040600602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180104d20 con 0x7fb180103390 2024-09-10T22:16:53.021 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb18554a640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 0x7fb1801044b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb16800d750 tx=0x7fb16800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168017070 con 0x7fb180103390 2024-09-10T22:16:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1680054d0 con 0x7fb180103390 2024-09-10T22:16:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1801a2eb0 con 0x7fb180103390 2024-09-10T22:16:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb168004c60 con 0x7fb180103390 2024-09-10T22:16:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.009+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1801a33a0 con 0x7fb180103390 2024-09-10T22:16:53.022 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.010+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1801a35d0 con 0x7fb180103390 2024-09-10T22:16:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.012+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb168004e00 con 0x7fb180103390 2024-09-10T22:16:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.012+0000 7fb17dffb640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb16c0b52e0 0x7fb16c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.013+0000 7fb184d49640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb16c0b52e0 0x7fb16c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.013+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb1680e5580 con 0x7fb180103390 2024-09-10T22:16:53.023 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.013+0000 7fb184d49640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb16c0b52e0 0x7fb16c0b77a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb178006010 tx=0x7fb1780314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:53.024 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.016+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb1680ac470 con 0x7fb180103390 2024-09-10T22:16:53.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:52 smithi189 ceph-mon[35784]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:53.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:52 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/440198107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T22:16:53.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:52 smithi189 ceph-mon[35784]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:16:53.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:52 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3656061311' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:53.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:52 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/681138225' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:16:53.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.205+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb1801a3960 con 0x7fb180103390 2024-09-10T22:16:53.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.205+0000 7fb17dffb640 1 -- 172.21.15.5:0/4040600602 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) ==== 100+0+11 (secure 0 0 0) 0x7fb1680abd70 con 0x7fb180103390 2024-09-10T22:16:53.208 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb16c0b52e0 msgr2=0x7fb16c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb16c0b52e0 0x7fb16c0b77a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb178006010 tx=0x7fb1780314a0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 msgr2=0x7fb1801044b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 0x7fb1801044b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fb16800d750 tx=0x7fb16800dc10 comp rx=0 tx=0).stop 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 shutdown_connections 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb16c0b52e0 0x7fb16c0b77a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb180103390 0x7fb1801044b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb1801029d0 0x7fb180103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 --2- 172.21.15.5:0/4040600602 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb180101880 0x7fb180105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 >> 172.21.15.5:0/4040600602 conn(0x7fb1800fd120 msgr2=0x7fb18006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 shutdown_connections 2024-09-10T22:16:53.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.207+0000 7fb186fad640 1 -- 172.21.15.5:0/4040600602 wait complete. 2024-09-10T22:16:53.221 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-10T22:16:53.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:53.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:52 smithi052 ceph-mon[34997]: pgmap v347: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:16:53.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:52 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/440198107' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-10T22:16:53.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:52 smithi052 ceph-mon[34997]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-10T22:16:53.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:52 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3656061311' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:53.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:52 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/681138225' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:16:53.478 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:53.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:53 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3823232371' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:16:53.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:53 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4040600602' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/263871044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d28102dc0 msgr2=0x7f8d281031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/263871044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d28102dc0 0x7f8d281031a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009900 tx=0x7f8d1802a410 comp rx=0 tx=0).stop 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/263871044 shutdown_connections 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/263871044 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 0x7f8d2810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/263871044 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d281087d0 0x7f8d28108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/263871044 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d28102dc0 0x7f8d281031a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/263871044 >> 172.21.15.5:0/263871044 conn(0x7f8d280fe830 msgr2=0x7f8d28100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/263871044 shutdown_connections 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.959+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/263871044 wait complete. 2024-09-10T22:16:53.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 Processor -- start 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 -- start start 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d28102dc0 0x7f8d28199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 0x7f8d281997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 0x7f8d2819eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28112e10 con 0x7f8d281087d0 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28112c90 con 0x7f8d28109150 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d2dbfe640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f8d28112f90 con 0x7f8d28102dc0 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.960+0000 7f8d26ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 0x7f8d281997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 0x7f8d281997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39338/0 (socket says 172.21.15.5:39338) 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 -- 172.21.15.5:0/2036547921 learned_addr learned my addr 172.21.15.5:0/2036547921 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d27fff640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 0x7f8d2819eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d277fe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d28102dc0 0x7f8d28199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.988 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 -- 172.21.15.5:0/2036547921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d28102dc0 msgr2=0x7f8d28199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d28102dc0 0x7f8d28199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 -- 172.21.15.5:0/2036547921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 msgr2=0x7f8d2819eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 0x7f8d2819eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 -- 172.21.15.5:0/2036547921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2819f330 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d27fff640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 0x7f8d2819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d26ffd640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 0x7f8d281997c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e9f0 tx=0x7f8d1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00cd80 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d1c0054d0 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2819f620 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c010690 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.961+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d281a5ce0 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.962+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d281031a0 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.964+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f8d1c004e90 con 0x7f8d281087d0 2024-09-10T22:16:53.989 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.965+0000 7f8d24ff9640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8d100b5360 0x7f8d100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.965+0000 7f8d277fe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8d100b5360 0x7f8d100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.965+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f8d1c0e6120 con 0x7f8d281087d0 2024-09-10T22:16:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.965+0000 7f8d277fe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8d100b5360 0x7f8d100b7820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8d18031440 tx=0x7f8d180095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:53.990 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:53.969+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8d1c0acfb0 con 0x7f8d281087d0 2024-09-10T22:16:54.195 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:53 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3823232371' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:16:54.195 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:53 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/4040600602' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:16:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.193+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d2802e5c0 con 0x7f8d281087d0 2024-09-10T22:16:54.196 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.194+0000 7f8d24ff9640 1 -- 172.21.15.5:0/2036547921 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f8d1c0ac8b0 con 0x7f8d281087d0 2024-09-10T22:16:54.197 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:54.198 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:16:54.198 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8d100b5360 msgr2=0x7f8d100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8d100b5360 0x7f8d100b7820 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8d18031440 tx=0x7f8d180095f0 comp rx=0 tx=0).stop 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 msgr2=0x7f8d281997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 0x7f8d281997c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e9f0 tx=0x7f8d1c00edf0 comp rx=0 tx=0).stop 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 shutdown_connections 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f8d100b5360 0x7f8d100b7820 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f8d28109150 0x7f8d2819eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:54.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f8d281087d0 0x7f8d281997c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 --2- 172.21.15.5:0/2036547921 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f8d28102dc0 0x7f8d28199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.196+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 >> 172.21.15.5:0/2036547921 conn(0x7f8d280fe830 msgr2=0x7f8d28100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.197+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 shutdown_connections 2024-09-10T22:16:54.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:54.197+0000 7f8d2dbfe640 1 -- 172.21.15.5:0/2036547921 wait complete. 2024-09-10T22:16:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:53 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3823232371' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:16:54.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:53 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/4040600602' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:16:54.935 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:54 smithi005 ceph-mon[31115]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:54.935 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:54 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2036547921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:54.968 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-10T22:16:54.968 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-10T22:16:54.968 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:16:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 -- 172.21.15.5:0/443061038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037006b130 msgr2=0x7f0370105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 --2- 172.21.15.5:0/443061038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037006b130 0x7f0370105570 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0360009ca0 tx=0x7f036002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 -- 172.21.15.5:0/443061038 shutdown_connections 2024-09-10T22:16:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 --2- 172.21.15.5:0/443061038 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f03701086b0 0x7f037010ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 --2- 172.21.15.5:0/443061038 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f0370105b00 0x7f0370107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 --2- 172.21.15.5:0/443061038 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f037006b130 0x7f0370105570 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.076+0000 7f03755e2640 1 -- 172.21.15.5:0/443061038 >> 172.21.15.5:0/443061038 conn(0x7f03700fd140 msgr2=0x7f03700ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.077+0000 7f03755e2640 1 -- 172.21.15.5:0/443061038 shutdown_connections 2024-09-10T22:16:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.077+0000 7f03755e2640 1 -- 172.21.15.5:0/443061038 wait complete. 2024-09-10T22:16:55.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.077+0000 7f03755e2640 1 Processor -- start 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.077+0000 7f03755e2640 1 -- start start 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.077+0000 7f03755e2640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037006b130 0x7f0370102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 0x7f0370101510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03701086b0 0x7f0370101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f037010e660 con 0x7f0370105b00 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f037010e4e0 con 0x7f037006b130 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f037010e7e0 con 0x7f03701086b0 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 0x7f0370101510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 0x7f0370101510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39360/0 (socket says 172.21.15.5:39360) 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 -- 172.21.15.5:0/332202107 learned_addr learned my addr 172.21.15.5:0/332202107 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036effd640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037006b130 0x7f0370102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036f7fe640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03701086b0 0x7f0370101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 -- 172.21.15.5:0/332202107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03701086b0 msgr2=0x7f0370101a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03701086b0 0x7f0370101a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 -- 172.21.15.5:0/332202107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037006b130 msgr2=0x7f0370102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037006b130 0x7f0370102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 -- 172.21.15.5:0/332202107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03701022c0 con 0x7f0370105b00 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036f7fe640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03701086b0 0x7f0370101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f036e7fc640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 0x7f0370101510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f036400b4a0 tx=0x7f036400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364014070 con 0x7f0370105b00 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0364010ac0 con 0x7f0370105b00 2024-09-10T22:16:55.083 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03701a2ea0 con 0x7f0370105b00 2024-09-10T22:16:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0364017c30 con 0x7f0370105b00 2024-09-10T22:16:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.078+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03701a33e0 con 0x7f0370105b00 2024-09-10T22:16:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.079+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03700fec30 con 0x7f0370105b00 2024-09-10T22:16:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.082+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0364010610 con 0x7f0370105b00 2024-09-10T22:16:55.084 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.082+0000 7f0357fff640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03580b5360 0x7f03580b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.083+0000 7f036effd640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03580b5360 0x7f03580b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.083+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f03640e5480 con 0x7f0370105b00 2024-09-10T22:16:55.085 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.083+0000 7f036effd640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03580b5360 0x7f03580b7820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0360005e30 tx=0x7f0360005dc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:55.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.085+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f03640ac370 con 0x7f0370105b00 2024-09-10T22:16:55.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:54 smithi189 ceph-mon[35784]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:55.094 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:54 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2036547921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:55.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:54 smithi052 ceph-mon[34997]: pgmap v348: 97 pgs: 97 active+clean; 640 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:16:55.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:54 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2036547921' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:55.270 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.268+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0370063590 con 0x7f03580b5360 2024-09-10T22:16:55.275 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.273+0000 7f0357fff640 1 -- 172.21.15.5:0/332202107 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259030 (secure 0 0 0) 0x7f0370063590 con 0x7f03580b5360 2024-09-10T22:16:55.278 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:55.280 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:16:55.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03580b5360 msgr2=0x7f03580b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03580b5360 0x7f03580b7820 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0360005e30 tx=0x7f0360005dc0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 msgr2=0x7f0370101510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.281 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 0x7f0370101510 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f036400b4a0 tx=0x7f036400b960 comp rx=0 tx=0).stop 2024-09-10T22:16:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 shutdown_connections 2024-09-10T22:16:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f03580b5360 0x7f03580b7820 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f03701086b0 0x7f0370101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0370105b00 0x7f0370101510 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 --2- 172.21.15.5:0/332202107 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f037006b130 0x7f0370102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.282 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 >> 172.21.15.5:0/332202107 conn(0x7f03700fd140 msgr2=0x7f0370103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:55.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 shutdown_connections 2024-09-10T22:16:55.283 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.276+0000 7f03755e2640 1 -- 172.21.15.5:0/332202107 wait complete. 2024-09-10T22:16:55.289 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-10T22:16:53.736296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655610,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":692,"num_read_kb":440,"num_write":296,"num_write_kb":2266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363764,"kb_used_data":10356,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578060,"statfs":{"total":1151940427776,"available":1151567933440,"internally_reserved":0,"allocated":10604544,"data_stored":6863394,"data_compressed":113286,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002804"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112001+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:16:34.112001+0000","last_peered":"2024-09-10T22:16:34.112001+0000","last_clean":"2024-09-10T22:16:34.112001+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:16:34.112001+0000","last_undegraded":"2024-09-10T22:16:34.112001+0000","last_fullsized":"2024-09-10T22:16:34.112001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110999+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:16:34.110999+0000","last_peered":"2024-09-10T22:16:34.110999+0000","last_clean":"2024-09-10T22:16:34.110999+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:16:34.110999+0000","last_undegraded":"2024-09-10T22:16:34.110999+0000","last_fullsized":"2024-09-10T22:16:34.110999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121198+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:16:34.121198+0000","last_peered":"2024-09-10T22:16:34.121198+0000","last_clean":"2024-09-10T22:16:34.121198+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:16:34.121198+0000","last_undegraded":"2024-09-10T22:16:34.121198+0000","last_fullsized":"2024-09-10T22:16:34.121198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.098362+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:16:34.098362+0000","last_peered":"2024-09-10T22:16:34.098362+0000","last_clean":"2024-09-10T22:16:34.098362+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:16:34.098362+0000","last_undegraded":"2024-09-10T22:16:34.098362+0000","last_fullsized":"2024-09-10T22:16:34.098362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.101802+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:16:34.101802+0000","last_peered":"2024-09-10T22:16:34.101802+0000","last_clean":"2024-09-10T22:16:34.101802+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:16:34.101802+0000","last_undegraded":"2024-09-10T22:16:34.101802+0000","last_fullsized":"2024-09-10T22:16:34.101802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108619+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:16:34.108619+0000","last_peered":"2024-09-10T22:16:34.108619+0000","last_clean":"2024-09-10T22:16:34.108619+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:16:34.108619+0000","last_undegraded":"2024-09-10T22:16:34.108619+0000","last_fullsized":"2024-09-10T22:16:34.108619+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.099889+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:16:34.099889+0000","last_peered":"2024-09-10T22:16:34.099889+0000","last_clean":"2024-09-10T22:16:34.099889+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:16:34.099889+0000","last_undegraded":"2024-09-10T22:16:34.099889+0000","last_fullsized":"2024-09-10T22:16:34.099889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109664+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:16:34.109664+0000","last_peered":"2024-09-10T22:16:34.109664+0000","last_clean":"2024-09-10T22:16:34.109664+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:16:34.109664+0000","last_undegraded":"2024-09-10T22:16:34.109664+0000","last_fullsized":"2024-09-10T22:16:34.109664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110803+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:16:34.110803+0000","last_peered":"2024-09-10T22:16:34.110803+0000","last_clean":"2024-09-10T22:16:34.110803+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:16:34.110803+0000","last_undegraded":"2024-09-10T22:16:34.110803+0000","last_fullsized":"2024-09-10T22:16:34.110803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110812+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:16:34.110812+0000","last_peered":"2024-09-10T22:16:34.110812+0000","last_clean":"2024-09-10T22:16:34.110812+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:16:34.110812+0000","last_undegraded":"2024-09-10T22:16:34.110812+0000","last_fullsized":"2024-09-10T22:16:34.110812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121464+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:16:34.121464+0000","last_peered":"2024-09-10T22:16:34.121464+0000","last_clean":"2024-09-10T22:16:34.121464+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:16:34.121464+0000","last_undegraded":"2024-09-10T22:16:34.121464+0000","last_fullsized":"2024-09-10T22:16:34.121464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.104804+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:16:34.104804+0000","last_peered":"2024-09-10T22:16:34.104804+0000","last_clean":"2024-09-10T22:16:34.104804+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:16:34.104804+0000","last_undegraded":"2024-09-10T22:16:34.104804+0000","last_fullsized":"2024-09-10T22:16:34.104804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.120445+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:16:34.120445+0000","last_peered":"2024-09-10T22:16:34.120445+0000","last_clean":"2024-09-10T22:16:34.120445+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:16:34.120445+0000","last_undegraded":"2024-09-10T22:16:34.120445+0000","last_fullsized":"2024-09-10T22:16:34.120445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121290+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:16:34.121290+0000","last_peered":"2024-09-10T22:16:34.121290+0000","last_clean":"2024-09-10T22:16:34.121290+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:16:34.121290+0000","last_undegraded":"2024-09-10T22:16:34.121290+0000","last_fullsized":"2024-09-10T22:16:34.121290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125046+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:16:34.125046+0000","last_peered":"2024-09-10T22:16:34.125046+0000","last_clean":"2024-09-10T22:16:34.125046+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:16:34.125046+0000","last_undegraded":"2024-09-10T22:16:34.125046+0000","last_fullsized":"2024-09-10T22:16:34.125046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124439+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:16:34.124439+0000","last_peered":"2024-09-10T22:16:34.124439+0000","last_clean":"2024-09-10T22:16:34.124439+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:16:34.124439+0000","last_undegraded":"2024-09-10T22:16:34.124439+0000","last_fullsized":"2024-09-10T22:16:34.124439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112223+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:16:34.112223+0000","last_peered":"2024-09-10T22:16:34.112223+0000","last_clean":"2024-09-10T22:16:34.112223+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:16:34.112223+0000","last_undegraded":"2024-09-10T22:16:34.112223+0000","last_fullsized":"2024-09-10T22:16:34.112223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109523+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:16:34.109523+0000","last_peered":"2024-09-10T22:16:34.109523+0000","last_clean":"2024-09-10T22:16:34.109523+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:16:34.109523+0000","last_undegraded":"2024-09-10T22:16:34.109523+0000","last_fullsized":"2024-09-10T22:16:34.109523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.102159+0000","last_change":"2024-09-10T22:15:35.484878+0000","last_active":"2024-09-10T22:16:34.102159+0000","last_peered":"2024-09-10T22:16:34.102159+0000","last_clean":"2024-09-10T22:16:34.102159+0000","last_became_active":"2024-09-10T22:15:35.484434+0000","last_became_peered":"2024-09-10T22:15:35.484434+0000","last_unstale":"2024-09-10T22:16:34.102159+0000","last_undegraded":"2024-09-10T22:16:34.102159+0000","last_fullsized":"2024-09-10T22:16:34.102159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:12.935958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109364+0000","last_change":"2024-09-10T22:15:35.484696+0000","last_active":"2024-09-10T22:16:34.109364+0000","last_peered":"2024-09-10T22:16:34.109364+0000","last_clean":"2024-09-10T22:16:34.109364+0000","last_became_active":"2024-09-10T22:15:35.484342+0000","last_became_peered":"2024-09-10T22:15:35.484342+0000","last_unstale":"2024-09-10T22:16:34.109364+0000","last_undegraded":"2024-09-10T22:16:34.109364+0000","last_fullsized":"2024-09-10T22:16:34.109364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:44.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116718+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:16:34.116718+0000","last_peered":"2024-09-10T22:16:34.116718+0000","last_clean":"2024-09-10T22:16:34.116718+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:16:34.116718+0000","last_undegraded":"2024-09-10T22:16:34.116718+0000","last_fullsized":"2024-09-10T22:16:34.116718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124259+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:16:34.124259+0000","last_peered":"2024-09-10T22:16:34.124259+0000","last_clean":"2024-09-10T22:16:34.124259+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:16:34.124259+0000","last_undegraded":"2024-09-10T22:16:34.124259+0000","last_fullsized":"2024-09-10T22:16:34.124259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112002+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:16:34.112002+0000","last_peered":"2024-09-10T22:16:34.112002+0000","last_clean":"2024-09-10T22:16:34.112002+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:16:34.112002+0000","last_undegraded":"2024-09-10T22:16:34.112002+0000","last_fullsized":"2024-09-10T22:16:34.112002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106097+0000","last_change":"2024-09-10T22:15:36.104261+0000","last_active":"2024-09-10T22:16:34.106097+0000","last_peered":"2024-09-10T22:16:34.106097+0000","last_clean":"2024-09-10T22:16:34.106097+0000","last_became_active":"2024-09-10T22:15:36.103864+0000","last_became_peered":"2024-09-10T22:15:36.103864+0000","last_unstale":"2024-09-10T22:16:34.106097+0000","last_undegraded":"2024-09-10T22:16:34.106097+0000","last_fullsized":"2024-09-10T22:16:34.106097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:24.892850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.105899+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:16:34.105899+0000","last_peered":"2024-09-10T22:16:34.105899+0000","last_clean":"2024-09-10T22:16:34.105899+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:16:34.105899+0000","last_undegraded":"2024-09-10T22:16:34.105899+0000","last_fullsized":"2024-09-10T22:16:34.105899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.098702+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:16:34.098702+0000","last_peered":"2024-09-10T22:16:34.098702+0000","last_clean":"2024-09-10T22:16:34.098702+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:16:34.098702+0000","last_undegraded":"2024-09-10T22:16:34.098702+0000","last_fullsized":"2024-09-10T22:16:34.098702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.107498+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:16:34.107498+0000","last_peered":"2024-09-10T22:16:34.107498+0000","last_clean":"2024-09-10T22:16:34.107498+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:16:34.107498+0000","last_undegraded":"2024-09-10T22:16:34.107498+0000","last_fullsized":"2024-09-10T22:16:34.107498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.119762+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:16:34.119762+0000","last_peered":"2024-09-10T22:16:34.119762+0000","last_clean":"2024-09-10T22:16:34.119762+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:16:34.119762+0000","last_undegraded":"2024-09-10T22:16:34.119762+0000","last_fullsized":"2024-09-10T22:16:34.119762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125257+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:16:34.125257+0000","last_peered":"2024-09-10T22:16:34.125257+0000","last_clean":"2024-09-10T22:16:34.125257+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:16:34.125257+0000","last_undegraded":"2024-09-10T22:16:34.125257+0000","last_fullsized":"2024-09-10T22:16:34.125257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.114117+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:16:34.114117+0000","last_peered":"2024-09-10T22:16:34.114117+0000","last_clean":"2024-09-10T22:16:34.114117+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:16:34.114117+0000","last_undegraded":"2024-09-10T22:16:34.114117+0000","last_fullsized":"2024-09-10T22:16:34.114117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.103667+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:16:34.103667+0000","last_peered":"2024-09-10T22:16:34.103667+0000","last_clean":"2024-09-10T22:16:34.103667+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:16:34.103667+0000","last_undegraded":"2024-09-10T22:16:34.103667+0000","last_fullsized":"2024-09-10T22:16:34.103667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.107821+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:16:34.107821+0000","last_peered":"2024-09-10T22:16:34.107821+0000","last_clean":"2024-09-10T22:16:34.107821+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:16:34.107821+0000","last_undegraded":"2024-09-10T22:16:34.107821+0000","last_fullsized":"2024-09-10T22:16:34.107821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.101052+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:16:34.101052+0000","last_peered":"2024-09-10T22:16:34.101052+0000","last_clean":"2024-09-10T22:16:34.101052+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:16:34.101052+0000","last_undegraded":"2024-09-10T22:16:34.101052+0000","last_fullsized":"2024-09-10T22:16:34.101052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'7","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.551949+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:16:49.551949+0000","last_peered":"2024-09-10T22:16:49.551949+0000","last_clean":"2024-09-10T22:16:49.551949+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:16:49.551949+0000","last_undegraded":"2024-09-10T22:16:49.551949+0000","last_fullsized":"2024-09-10T22:16:49.551949+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115547+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:16:34.115547+0000","last_peered":"2024-09-10T22:16:34.115547+0000","last_clean":"2024-09-10T22:16:34.115547+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:16:34.115547+0000","last_undegraded":"2024-09-10T22:16:34.115547+0000","last_fullsized":"2024-09-10T22:16:34.115547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480566+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:35.480566+0000","last_peered":"2024-09-10T22:15:35.480566+0000","last_clean":"2024-09-10T22:15:35.480566+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:35.480566+0000","last_undegraded":"2024-09-10T22:15:35.480566+0000","last_fullsized":"2024-09-10T22:15:35.480566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476737+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:35.476737+0000","last_peered":"2024-09-10T22:15:35.476737+0000","last_clean":"2024-09-10T22:15:35.476737+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:35.476737+0000","last_undegraded":"2024-09-10T22:15:35.476737+0000","last_fullsized":"2024-09-10T22:15:35.476737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116307+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:16:34.116307+0000","last_peered":"2024-09-10T22:16:34.116307+0000","last_clean":"2024-09-10T22:16:34.116307+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:16:34.116307+0000","last_undegraded":"2024-09-10T22:16:34.116307+0000","last_fullsized":"2024-09-10T22:16:34.116307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478017+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:35.478017+0000","last_peered":"2024-09-10T22:15:35.478017+0000","last_clean":"2024-09-10T22:15:35.478017+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:35.478017+0000","last_undegraded":"2024-09-10T22:15:35.478017+0000","last_fullsized":"2024-09-10T22:15:35.478017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110101+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:16:34.110101+0000","last_peered":"2024-09-10T22:16:34.110101+0000","last_clean":"2024-09-10T22:16:34.110101+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:16:34.110101+0000","last_undegraded":"2024-09-10T22:16:34.110101+0000","last_fullsized":"2024-09-10T22:16:34.110101+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:48.549826+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:16:48.549826+0000","last_peered":"2024-09-10T22:16:48.549826+0000","last_clean":"2024-09-10T22:16:48.549826+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:16:48.549826+0000","last_undegraded":"2024-09-10T22:16:48.549826+0000","last_fullsized":"2024-09-10T22:16:48.549826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.118556+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:16:34.118556+0000","last_peered":"2024-09-10T22:16:34.118556+0000","last_clean":"2024-09-10T22:16:34.118556+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:16:34.118556+0000","last_undegraded":"2024-09-10T22:16:34.118556+0000","last_fullsized":"2024-09-10T22:16:34.118556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847900+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:36.847900+0000","last_peered":"2024-09-10T22:15:36.847900+0000","last_clean":"2024-09-10T22:15:36.847900+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:36.847900+0000","last_undegraded":"2024-09-10T22:15:36.847900+0000","last_fullsized":"2024-09-10T22:15:36.847900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125195+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:16:34.125195+0000","last_peered":"2024-09-10T22:16:34.125195+0000","last_clean":"2024-09-10T22:16:34.125195+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:16:34.125195+0000","last_undegraded":"2024-09-10T22:16:34.125195+0000","last_fullsized":"2024-09-10T22:16:34.125195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478635+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:35.478635+0000","last_peered":"2024-09-10T22:15:35.478635+0000","last_clean":"2024-09-10T22:15:35.478635+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:35.478635+0000","last_undegraded":"2024-09-10T22:15:35.478635+0000","last_fullsized":"2024-09-10T22:15:35.478635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.117012+0000","last_change":"2024-09-10T22:15:35.483364+0000","last_active":"2024-09-10T22:16:34.117012+0000","last_peered":"2024-09-10T22:16:34.117012+0000","last_clean":"2024-09-10T22:16:34.117012+0000","last_became_active":"2024-09-10T22:15:35.482977+0000","last_became_peered":"2024-09-10T22:15:35.482977+0000","last_unstale":"2024-09-10T22:16:34.117012+0000","last_undegraded":"2024-09-10T22:16:34.117012+0000","last_fullsized":"2024-09-10T22:16:34.117012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:04.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'31","reported_seq":258,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.551293+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:16:49.551293+0000","last_peered":"2024-09-10T22:16:49.551293+0000","last_clean":"2024-09-10T22:16:49.551293+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:16:49.551293+0000","last_undegraded":"2024-09-10T22:16:49.551293+0000","last_fullsized":"2024-09-10T22:16:49.551293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60866,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":204,"num_read_kb":160,"num_write":32,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.103602+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:16:34.103602+0000","last_peered":"2024-09-10T22:16:34.103602+0000","last_clean":"2024-09-10T22:16:34.103602+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:16:34.103602+0000","last_undegraded":"2024-09-10T22:16:34.103602+0000","last_fullsized":"2024-09-10T22:16:34.103602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479200+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:35.479200+0000","last_peered":"2024-09-10T22:15:35.479200+0000","last_clean":"2024-09-10T22:15:35.479200+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:35.479200+0000","last_undegraded":"2024-09-10T22:15:35.479200+0000","last_fullsized":"2024-09-10T22:15:35.479200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116607+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:16:34.116607+0000","last_peered":"2024-09-10T22:16:34.116607+0000","last_clean":"2024-09-10T22:16:34.116607+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:16:34.116607+0000","last_undegraded":"2024-09-10T22:16:34.116607+0000","last_fullsized":"2024-09-10T22:16:34.116607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.122615+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:16:34.122615+0000","last_peered":"2024-09-10T22:16:34.122615+0000","last_clean":"2024-09-10T22:16:34.122615+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:16:34.122615+0000","last_undegraded":"2024-09-10T22:16:34.122615+0000","last_fullsized":"2024-09-10T22:16:34.122615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.550022+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:16:49.550022+0000","last_peered":"2024-09-10T22:16:49.550022+0000","last_clean":"2024-09-10T22:16:49.550022+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:16:49.550022+0000","last_undegraded":"2024-09-10T22:16:49.550022+0000","last_fullsized":"2024-09-10T22:16:49.550022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125079+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:16:34.125079+0000","last_peered":"2024-09-10T22:16:34.125079+0000","last_clean":"2024-09-10T22:16:34.125079+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:16:34.125079+0000","last_undegraded":"2024-09-10T22:16:34.125079+0000","last_fullsized":"2024-09-10T22:16:34.125079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480414+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:35.480414+0000","last_peered":"2024-09-10T22:15:35.480414+0000","last_clean":"2024-09-10T22:15:35.480414+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:35.480414+0000","last_undegraded":"2024-09-10T22:15:35.480414+0000","last_fullsized":"2024-09-10T22:15:35.480414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115009+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:16:34.115009+0000","last_peered":"2024-09-10T22:16:34.115009+0000","last_clean":"2024-09-10T22:16:34.115009+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:16:34.115009+0000","last_undegraded":"2024-09-10T22:16:34.115009+0000","last_fullsized":"2024-09-10T22:16:34.115009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481875+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:35.481875+0000","last_peered":"2024-09-10T22:15:35.481875+0000","last_clean":"2024-09-10T22:15:35.481875+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:35.481875+0000","last_undegraded":"2024-09-10T22:15:35.481875+0000","last_fullsized":"2024-09-10T22:15:35.481875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106972+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:16:34.106972+0000","last_peered":"2024-09-10T22:16:34.106972+0000","last_clean":"2024-09-10T22:16:34.106972+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:16:34.106972+0000","last_undegraded":"2024-09-10T22:16:34.106972+0000","last_fullsized":"2024-09-10T22:16:34.106972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477187+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:35.477187+0000","last_peered":"2024-09-10T22:15:35.477187+0000","last_clean":"2024-09-10T22:15:35.477187+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:35.477187+0000","last_undegraded":"2024-09-10T22:15:35.477187+0000","last_fullsized":"2024-09-10T22:15:35.477187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124665+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:16:34.124665+0000","last_peered":"2024-09-10T22:16:34.124665+0000","last_clean":"2024-09-10T22:16:34.124665+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:16:34.124665+0000","last_undegraded":"2024-09-10T22:16:34.124665+0000","last_fullsized":"2024-09-10T22:16:34.124665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478753+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:35.478753+0000","last_peered":"2024-09-10T22:15:35.478753+0000","last_clean":"2024-09-10T22:15:35.478753+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:35.478753+0000","last_undegraded":"2024-09-10T22:15:35.478753+0000","last_fullsized":"2024-09-10T22:15:35.478753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.113650+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:16:34.113650+0000","last_peered":"2024-09-10T22:16:34.113650+0000","last_clean":"2024-09-10T22:16:34.113650+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:16:34.113650+0000","last_undegraded":"2024-09-10T22:16:34.113650+0000","last_fullsized":"2024-09-10T22:16:34.113650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479310+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:35.479310+0000","last_peered":"2024-09-10T22:15:35.479310+0000","last_clean":"2024-09-10T22:15:35.479310+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:35.479310+0000","last_undegraded":"2024-09-10T22:15:35.479310+0000","last_fullsized":"2024-09-10T22:15:35.479310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.123326+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:16:34.123326+0000","last_peered":"2024-09-10T22:16:34.123326+0000","last_clean":"2024-09-10T22:16:34.123326+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:16:34.123326+0000","last_undegraded":"2024-09-10T22:16:34.123326+0000","last_fullsized":"2024-09-10T22:16:34.123326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847758+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:36.847758+0000","last_peered":"2024-09-10T22:15:36.847758+0000","last_clean":"2024-09-10T22:15:36.847758+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:36.847758+0000","last_undegraded":"2024-09-10T22:15:36.847758+0000","last_fullsized":"2024-09-10T22:15:36.847758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477570+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:35.477570+0000","last_peered":"2024-09-10T22:15:35.477570+0000","last_clean":"2024-09-10T22:15:35.477570+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:35.477570+0000","last_undegraded":"2024-09-10T22:15:35.477570+0000","last_fullsized":"2024-09-10T22:15:35.477570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108644+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:16:34.108644+0000","last_peered":"2024-09-10T22:16:34.108644+0000","last_clean":"2024-09-10T22:16:34.108644+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:16:34.108644+0000","last_undegraded":"2024-09-10T22:16:34.108644+0000","last_fullsized":"2024-09-10T22:16:34.108644+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847681+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:36.847681+0000","last_peered":"2024-09-10T22:15:36.847681+0000","last_clean":"2024-09-10T22:15:36.847681+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:36.847681+0000","last_undegraded":"2024-09-10T22:15:36.847681+0000","last_fullsized":"2024-09-10T22:15:36.847681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.113287+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:16:34.113287+0000","last_peered":"2024-09-10T22:16:34.113287+0000","last_clean":"2024-09-10T22:16:34.113287+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:16:34.113287+0000","last_undegraded":"2024-09-10T22:16:34.113287+0000","last_fullsized":"2024-09-10T22:16:34.113287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":127,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:51.552453+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:16:51.552453+0000","last_peered":"2024-09-10T22:16:51.552453+0000","last_clean":"2024-09-10T22:16:51.552453+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:16:51.552453+0000","last_undegraded":"2024-09-10T22:16:51.552453+0000","last_fullsized":"2024-09-10T22:16:51.552453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115051+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:16:34.115051+0000","last_peered":"2024-09-10T22:16:34.115051+0000","last_clean":"2024-09-10T22:16:34.115051+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:16:34.115051+0000","last_undegraded":"2024-09-10T22:16:34.115051+0000","last_fullsized":"2024-09-10T22:16:34.115051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847841+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:36.847841+0000","last_peered":"2024-09-10T22:15:36.847841+0000","last_clean":"2024-09-10T22:15:36.847841+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:36.847841+0000","last_undegraded":"2024-09-10T22:15:36.847841+0000","last_fullsized":"2024-09-10T22:15:36.847841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.097523+0000","last_change":"2024-09-10T22:15:35.484767+0000","last_active":"2024-09-10T22:16:34.097523+0000","last_peered":"2024-09-10T22:16:34.097523+0000","last_clean":"2024-09-10T22:16:34.097523+0000","last_became_active":"2024-09-10T22:15:35.484427+0000","last_became_peered":"2024-09-10T22:15:35.484427+0000","last_unstale":"2024-09-10T22:16:34.097523+0000","last_undegraded":"2024-09-10T22:16:34.097523+0000","last_fullsized":"2024-09-10T22:16:34.097523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:35.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483370+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:35.483370+0000","last_peered":"2024-09-10T22:15:35.483370+0000","last_clean":"2024-09-10T22:15:35.483370+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:35.483370+0000","last_undegraded":"2024-09-10T22:15:35.483370+0000","last_fullsized":"2024-09-10T22:15:35.483370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.105653+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:16:34.105653+0000","last_peered":"2024-09-10T22:16:34.105653+0000","last_clean":"2024-09-10T22:16:34.105653+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:16:34.105653+0000","last_undegraded":"2024-09-10T22:16:34.105653+0000","last_fullsized":"2024-09-10T22:16:34.105653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.489459+0000","last_change":"2024-09-10T22:15:35.488995+0000","last_active":"2024-09-10T22:15:35.489459+0000","last_peered":"2024-09-10T22:15:35.489459+0000","last_clean":"2024-09-10T22:15:35.489459+0000","last_became_active":"2024-09-10T22:15:35.484278+0000","last_became_peered":"2024-09-10T22:15:35.484278+0000","last_unstale":"2024-09-10T22:15:35.489459+0000","last_undegraded":"2024-09-10T22:15:35.489459+0000","last_fullsized":"2024-09-10T22:15:35.489459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:00.474920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115090+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:16:34.115090+0000","last_peered":"2024-09-10T22:16:34.115090+0000","last_clean":"2024-09-10T22:16:34.115090+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:16:34.115090+0000","last_undegraded":"2024-09-10T22:16:34.115090+0000","last_fullsized":"2024-09-10T22:16:34.115090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483341+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:15:35.483341+0000","last_peered":"2024-09-10T22:15:35.483341+0000","last_clean":"2024-09-10T22:15:35.483341+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:15:35.483341+0000","last_undegraded":"2024-09-10T22:15:35.483341+0000","last_fullsized":"2024-09-10T22:15:35.483341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112824+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:16:34.112824+0000","last_peered":"2024-09-10T22:16:34.112824+0000","last_clean":"2024-09-10T22:16:34.112824+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:16:34.112824+0000","last_undegraded":"2024-09-10T22:16:34.112824+0000","last_fullsized":"2024-09-10T22:16:34.112824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477897+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:35.477897+0000","last_peered":"2024-09-10T22:15:35.477897+0000","last_clean":"2024-09-10T22:15:35.477897+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:35.477897+0000","last_undegraded":"2024-09-10T22:15:35.477897+0000","last_fullsized":"2024-09-10T22:15:35.477897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125327+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:16:34.125327+0000","last_peered":"2024-09-10T22:16:34.125327+0000","last_clean":"2024-09-10T22:16:34.125327+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:16:34.125327+0000","last_undegraded":"2024-09-10T22:16:34.125327+0000","last_fullsized":"2024-09-10T22:16:34.125327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.486805+0000","last_change":"2024-09-10T22:15:35.486730+0000","last_active":"2024-09-10T22:15:35.486805+0000","last_peered":"2024-09-10T22:15:35.486805+0000","last_clean":"2024-09-10T22:15:35.486805+0000","last_became_active":"2024-09-10T22:15:35.483148+0000","last_became_peered":"2024-09-10T22:15:35.483148+0000","last_unstale":"2024-09-10T22:15:35.486805+0000","last_undegraded":"2024-09-10T22:15:35.486805+0000","last_fullsized":"2024-09-10T22:15:35.486805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:10.166666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.076070+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:16:34.076070+0000","last_peered":"2024-09-10T22:16:34.076070+0000","last_clean":"2024-09-10T22:16:34.076070+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:16:34.076070+0000","last_undegraded":"2024-09-10T22:16:34.076070+0000","last_fullsized":"2024-09-10T22:16:34.076070+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102639+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:36.102639+0000","last_peered":"2024-09-10T22:15:36.102639+0000","last_clean":"2024-09-10T22:15:36.102639+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:36.102639+0000","last_undegraded":"2024-09-10T22:15:36.102639+0000","last_fullsized":"2024-09-10T22:15:36.102639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108112+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:16:34.108112+0000","last_peered":"2024-09-10T22:16:34.108112+0000","last_clean":"2024-09-10T22:16:34.108112+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:16:34.108112+0000","last_undegraded":"2024-09-10T22:16:34.108112+0000","last_fullsized":"2024-09-10T22:16:34.108112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479161+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:35.479161+0000","last_peered":"2024-09-10T22:15:35.479161+0000","last_clean":"2024-09-10T22:15:35.479161+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:35.479161+0000","last_undegraded":"2024-09-10T22:15:35.479161+0000","last_fullsized":"2024-09-10T22:15:35.479161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.119857+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:16:34.119857+0000","last_peered":"2024-09-10T22:16:34.119857+0000","last_clean":"2024-09-10T22:16:34.119857+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:16:34.119857+0000","last_undegraded":"2024-09-10T22:16:34.119857+0000","last_fullsized":"2024-09-10T22:16:34.119857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481286+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:35.481286+0000","last_peered":"2024-09-10T22:15:35.481286+0000","last_clean":"2024-09-10T22:15:35.481286+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:35.481286+0000","last_undegraded":"2024-09-10T22:15:35.481286+0000","last_fullsized":"2024-09-10T22:15:35.481286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121766+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:16:34.121766+0000","last_peered":"2024-09-10T22:16:34.121766+0000","last_clean":"2024-09-10T22:16:34.121766+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:16:34.121766+0000","last_undegraded":"2024-09-10T22:16:34.121766+0000","last_fullsized":"2024-09-10T22:16:34.121766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116042+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:16:34.116042+0000","last_peered":"2024-09-10T22:16:34.116042+0000","last_clean":"2024-09-10T22:16:34.116042+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:16:34.116042+0000","last_undegraded":"2024-09-10T22:16:34.116042+0000","last_fullsized":"2024-09-10T22:16:34.116042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482561+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:35.482561+0000","last_peered":"2024-09-10T22:15:35.482561+0000","last_clean":"2024-09-10T22:15:35.482561+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:35.482561+0000","last_undegraded":"2024-09-10T22:15:35.482561+0000","last_fullsized":"2024-09-10T22:15:35.482561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116358+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:16:34.116358+0000","last_peered":"2024-09-10T22:16:34.116358+0000","last_clean":"2024-09-10T22:16:34.116358+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:16:34.116358+0000","last_undegraded":"2024-09-10T22:16:34.116358+0000","last_fullsized":"2024-09-10T22:16:34.116358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481854+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:35.481854+0000","last_peered":"2024-09-10T22:15:35.481854+0000","last_clean":"2024-09-10T22:15:35.481854+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:35.481854+0000","last_undegraded":"2024-09-10T22:15:35.481854+0000","last_fullsized":"2024-09-10T22:15:35.481854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.120912+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:16:34.120912+0000","last_peered":"2024-09-10T22:16:34.120912+0000","last_clean":"2024-09-10T22:16:34.120912+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:16:34.120912+0000","last_undegraded":"2024-09-10T22:16:34.120912+0000","last_fullsized":"2024-09-10T22:16:34.120912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103492+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:36.103492+0000","last_peered":"2024-09-10T22:15:36.103492+0000","last_clean":"2024-09-10T22:15:36.103492+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:36.103492+0000","last_undegraded":"2024-09-10T22:15:36.103492+0000","last_fullsized":"2024-09-10T22:15:36.103492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106001+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:16:34.106001+0000","last_peered":"2024-09-10T22:16:34.106001+0000","last_clean":"2024-09-10T22:16:34.106001+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:16:34.106001+0000","last_undegraded":"2024-09-10T22:16:34.106001+0000","last_fullsized":"2024-09-10T22:16:34.106001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483426+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:35.483426+0000","last_peered":"2024-09-10T22:15:35.483426+0000","last_clean":"2024-09-10T22:15:35.483426+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:35.483426+0000","last_undegraded":"2024-09-10T22:15:35.483426+0000","last_fullsized":"2024-09-10T22:15:35.483426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65008,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":616,"num_read_kb":376,"num_write":171,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":195332,"data_compressed":5442,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":843776,"data_stored":408651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":1060976,"data_compressed":37762,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070509,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":408865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":408763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":1000856,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":408254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1000540,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":408691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":408565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":470795,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":468913,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":409525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61174,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62748,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62444,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:16:55.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:16:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 -- 172.21.15.5:0/2314572372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81018a0 msgr2=0x7f40e8101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 --2- 172.21.15.5:0/2314572372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81018a0 0x7f40e8101ca0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009930 tx=0x7f40d802a420 comp rx=0 tx=0).stop 2024-09-10T22:16:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 -- 172.21.15.5:0/2314572372 shutdown_connections 2024-09-10T22:16:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 --2- 172.21.15.5:0/2314572372 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81033b0 0x7f40e8109d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 --2- 172.21.15.5:0/2314572372 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81029f0 0x7f40e8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 --2- 172.21.15.5:0/2314572372 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81018a0 0x7f40e8101ca0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 -- 172.21.15.5:0/2314572372 >> 172.21.15.5:0/2314572372 conn(0x7f40e80fd140 msgr2=0x7f40e80ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 -- 172.21.15.5:0/2314572372 shutdown_connections 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 -- 172.21.15.5:0/2314572372 wait complete. 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 Processor -- start 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.431+0000 7f40eefad640 1 -- start start 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81018a0 0x7f40e8198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 0x7f40e8199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81033b0 0x7f40e819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f40e810e640 con 0x7f40e81029f0 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f40e810e4c0 con 0x7f40e81018a0 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f40e810e7c0 con 0x7f40e81033b0 2024-09-10T22:16:55.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 0x7f40e8199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 0x7f40e8199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39380/0 (socket says 172.21.15.5:39380) 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 -- 172.21.15.5:0/1335662548 learned_addr learned my addr 172.21.15.5:0/1335662548 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40ecd49640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81018a0 0x7f40e8198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40ed54a640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81033b0 0x7f40e819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 -- 172.21.15.5:0/1335662548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81033b0 msgr2=0x7f40e819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81033b0 0x7f40e819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 -- 172.21.15.5:0/1335662548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81018a0 msgr2=0x7f40e8198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81018a0 0x7f40e8198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 -- 172.21.15.5:0/1335662548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e819a960 con 0x7f40e81029f0 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40ecd49640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81018a0 0x7f40e8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40ed54a640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81033b0 0x7f40e819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e7fff640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 0x7f40e8199470 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40d000d770 tx=0x7f40d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0017070 con 0x7f40e81029f0 2024-09-10T22:16:55.437 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d00054d0 con 0x7f40e81029f0 2024-09-10T22:16:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.432+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e819ac50 con 0x7f40e81029f0 2024-09-10T22:16:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.433+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0004c30 con 0x7f40e81029f0 2024-09-10T22:16:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.433+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e81a1320 con 0x7f40e81029f0 2024-09-10T22:16:55.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.434+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e81a14f0 con 0x7f40e81029f0 2024-09-10T22:16:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.435+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f40d0004e10 con 0x7f40e81029f0 2024-09-10T22:16:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.436+0000 7f40e5ffb640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40d40b5360 0x7f40d40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.436+0000 7f40ecd49640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40d40b5360 0x7f40d40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.436+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f40d00e56d0 con 0x7f40e81029f0 2024-09-10T22:16:55.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.436+0000 7f40ecd49640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40d40b5360 0x7f40d40b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d80314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:55.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.440+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f40d00ac5c0 con 0x7f40e81029f0 2024-09-10T22:16:55.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.625+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40e81044e0 con 0x7f40d40b5360 2024-09-10T22:16:55.631 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.629+0000 7f40e5ffb640 1 -- 172.21.15.5:0/1335662548 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259030 (secure 0 0 0) 0x7f40e81044e0 con 0x7f40d40b5360 2024-09-10T22:16:55.634 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:55.635 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40d40b5360 msgr2=0x7f40d40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40d40b5360 0x7f40d40b7820 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f40d8000c00 tx=0x7f40d80314a0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 msgr2=0x7f40e8199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 0x7f40e8199470 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f40d000d770 tx=0x7f40d000dc30 comp rx=0 tx=0).stop 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 shutdown_connections 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f40d40b5360 0x7f40d40b7820 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f40e81033b0 0x7f40e819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f40e81029f0 0x7f40e8199470 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.637 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 --2- 172.21.15.5:0/1335662548 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f40e81018a0 0x7f40e8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 >> 172.21.15.5:0/1335662548 conn(0x7f40e80fd140 msgr2=0x7f40e8103dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:55.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 shutdown_connections 2024-09-10T22:16:55.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.633+0000 7f40eefad640 1 -- 172.21.15.5:0/1335662548 wait complete. 2024-09-10T22:16:55.646 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-09-10T22:16:53.736296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655610,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":692,"num_read_kb":440,"num_write":296,"num_write_kb":2266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":739,"ondisk_log_size":739,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363764,"kb_used_data":10356,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578060,"statfs":{"total":1151940427776,"available":1151567933440,"internally_reserved":0,"allocated":10604544,"data_stored":6863394,"data_compressed":113286,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002804"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112001+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:16:34.112001+0000","last_peered":"2024-09-10T22:16:34.112001+0000","last_clean":"2024-09-10T22:16:34.112001+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:16:34.112001+0000","last_undegraded":"2024-09-10T22:16:34.112001+0000","last_fullsized":"2024-09-10T22:16:34.112001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110999+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:16:34.110999+0000","last_peered":"2024-09-10T22:16:34.110999+0000","last_clean":"2024-09-10T22:16:34.110999+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:16:34.110999+0000","last_undegraded":"2024-09-10T22:16:34.110999+0000","last_fullsized":"2024-09-10T22:16:34.110999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121198+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:16:34.121198+0000","last_peered":"2024-09-10T22:16:34.121198+0000","last_clean":"2024-09-10T22:16:34.121198+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:16:34.121198+0000","last_undegraded":"2024-09-10T22:16:34.121198+0000","last_fullsized":"2024-09-10T22:16:34.121198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.098362+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:16:34.098362+0000","last_peered":"2024-09-10T22:16:34.098362+0000","last_clean":"2024-09-10T22:16:34.098362+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:16:34.098362+0000","last_undegraded":"2024-09-10T22:16:34.098362+0000","last_fullsized":"2024-09-10T22:16:34.098362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.101802+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:16:34.101802+0000","last_peered":"2024-09-10T22:16:34.101802+0000","last_clean":"2024-09-10T22:16:34.101802+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:16:34.101802+0000","last_undegraded":"2024-09-10T22:16:34.101802+0000","last_fullsized":"2024-09-10T22:16:34.101802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108619+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:16:34.108619+0000","last_peered":"2024-09-10T22:16:34.108619+0000","last_clean":"2024-09-10T22:16:34.108619+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:16:34.108619+0000","last_undegraded":"2024-09-10T22:16:34.108619+0000","last_fullsized":"2024-09-10T22:16:34.108619+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.099889+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:16:34.099889+0000","last_peered":"2024-09-10T22:16:34.099889+0000","last_clean":"2024-09-10T22:16:34.099889+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:16:34.099889+0000","last_undegraded":"2024-09-10T22:16:34.099889+0000","last_fullsized":"2024-09-10T22:16:34.099889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109664+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:16:34.109664+0000","last_peered":"2024-09-10T22:16:34.109664+0000","last_clean":"2024-09-10T22:16:34.109664+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:16:34.109664+0000","last_undegraded":"2024-09-10T22:16:34.109664+0000","last_fullsized":"2024-09-10T22:16:34.109664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110803+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:16:34.110803+0000","last_peered":"2024-09-10T22:16:34.110803+0000","last_clean":"2024-09-10T22:16:34.110803+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:16:34.110803+0000","last_undegraded":"2024-09-10T22:16:34.110803+0000","last_fullsized":"2024-09-10T22:16:34.110803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110812+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:16:34.110812+0000","last_peered":"2024-09-10T22:16:34.110812+0000","last_clean":"2024-09-10T22:16:34.110812+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:16:34.110812+0000","last_undegraded":"2024-09-10T22:16:34.110812+0000","last_fullsized":"2024-09-10T22:16:34.110812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121464+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:16:34.121464+0000","last_peered":"2024-09-10T22:16:34.121464+0000","last_clean":"2024-09-10T22:16:34.121464+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:16:34.121464+0000","last_undegraded":"2024-09-10T22:16:34.121464+0000","last_fullsized":"2024-09-10T22:16:34.121464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.104804+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:16:34.104804+0000","last_peered":"2024-09-10T22:16:34.104804+0000","last_clean":"2024-09-10T22:16:34.104804+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:16:34.104804+0000","last_undegraded":"2024-09-10T22:16:34.104804+0000","last_fullsized":"2024-09-10T22:16:34.104804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.120445+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:16:34.120445+0000","last_peered":"2024-09-10T22:16:34.120445+0000","last_clean":"2024-09-10T22:16:34.120445+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:16:34.120445+0000","last_undegraded":"2024-09-10T22:16:34.120445+0000","last_fullsized":"2024-09-10T22:16:34.120445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121290+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:16:34.121290+0000","last_peered":"2024-09-10T22:16:34.121290+0000","last_clean":"2024-09-10T22:16:34.121290+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:16:34.121290+0000","last_undegraded":"2024-09-10T22:16:34.121290+0000","last_fullsized":"2024-09-10T22:16:34.121290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125046+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:16:34.125046+0000","last_peered":"2024-09-10T22:16:34.125046+0000","last_clean":"2024-09-10T22:16:34.125046+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:16:34.125046+0000","last_undegraded":"2024-09-10T22:16:34.125046+0000","last_fullsized":"2024-09-10T22:16:34.125046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124439+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:16:34.124439+0000","last_peered":"2024-09-10T22:16:34.124439+0000","last_clean":"2024-09-10T22:16:34.124439+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:16:34.124439+0000","last_undegraded":"2024-09-10T22:16:34.124439+0000","last_fullsized":"2024-09-10T22:16:34.124439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112223+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:16:34.112223+0000","last_peered":"2024-09-10T22:16:34.112223+0000","last_clean":"2024-09-10T22:16:34.112223+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:16:34.112223+0000","last_undegraded":"2024-09-10T22:16:34.112223+0000","last_fullsized":"2024-09-10T22:16:34.112223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109523+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:16:34.109523+0000","last_peered":"2024-09-10T22:16:34.109523+0000","last_clean":"2024-09-10T22:16:34.109523+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:16:34.109523+0000","last_undegraded":"2024-09-10T22:16:34.109523+0000","last_fullsized":"2024-09-10T22:16:34.109523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.102159+0000","last_change":"2024-09-10T22:15:35.484878+0000","last_active":"2024-09-10T22:16:34.102159+0000","last_peered":"2024-09-10T22:16:34.102159+0000","last_clean":"2024-09-10T22:16:34.102159+0000","last_became_active":"2024-09-10T22:15:35.484434+0000","last_became_peered":"2024-09-10T22:15:35.484434+0000","last_unstale":"2024-09-10T22:16:34.102159+0000","last_undegraded":"2024-09-10T22:16:34.102159+0000","last_fullsized":"2024-09-10T22:16:34.102159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:12.935958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109364+0000","last_change":"2024-09-10T22:15:35.484696+0000","last_active":"2024-09-10T22:16:34.109364+0000","last_peered":"2024-09-10T22:16:34.109364+0000","last_clean":"2024-09-10T22:16:34.109364+0000","last_became_active":"2024-09-10T22:15:35.484342+0000","last_became_peered":"2024-09-10T22:15:35.484342+0000","last_unstale":"2024-09-10T22:16:34.109364+0000","last_undegraded":"2024-09-10T22:16:34.109364+0000","last_fullsized":"2024-09-10T22:16:34.109364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:44.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116718+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:16:34.116718+0000","last_peered":"2024-09-10T22:16:34.116718+0000","last_clean":"2024-09-10T22:16:34.116718+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:16:34.116718+0000","last_undegraded":"2024-09-10T22:16:34.116718+0000","last_fullsized":"2024-09-10T22:16:34.116718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124259+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:16:34.124259+0000","last_peered":"2024-09-10T22:16:34.124259+0000","last_clean":"2024-09-10T22:16:34.124259+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:16:34.124259+0000","last_undegraded":"2024-09-10T22:16:34.124259+0000","last_fullsized":"2024-09-10T22:16:34.124259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112002+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:16:34.112002+0000","last_peered":"2024-09-10T22:16:34.112002+0000","last_clean":"2024-09-10T22:16:34.112002+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:16:34.112002+0000","last_undegraded":"2024-09-10T22:16:34.112002+0000","last_fullsized":"2024-09-10T22:16:34.112002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106097+0000","last_change":"2024-09-10T22:15:36.104261+0000","last_active":"2024-09-10T22:16:34.106097+0000","last_peered":"2024-09-10T22:16:34.106097+0000","last_clean":"2024-09-10T22:16:34.106097+0000","last_became_active":"2024-09-10T22:15:36.103864+0000","last_became_peered":"2024-09-10T22:15:36.103864+0000","last_unstale":"2024-09-10T22:16:34.106097+0000","last_undegraded":"2024-09-10T22:16:34.106097+0000","last_fullsized":"2024-09-10T22:16:34.106097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:24.892850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.105899+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:16:34.105899+0000","last_peered":"2024-09-10T22:16:34.105899+0000","last_clean":"2024-09-10T22:16:34.105899+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:16:34.105899+0000","last_undegraded":"2024-09-10T22:16:34.105899+0000","last_fullsized":"2024-09-10T22:16:34.105899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.098702+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:16:34.098702+0000","last_peered":"2024-09-10T22:16:34.098702+0000","last_clean":"2024-09-10T22:16:34.098702+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:16:34.098702+0000","last_undegraded":"2024-09-10T22:16:34.098702+0000","last_fullsized":"2024-09-10T22:16:34.098702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.107498+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:16:34.107498+0000","last_peered":"2024-09-10T22:16:34.107498+0000","last_clean":"2024-09-10T22:16:34.107498+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:16:34.107498+0000","last_undegraded":"2024-09-10T22:16:34.107498+0000","last_fullsized":"2024-09-10T22:16:34.107498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.119762+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:16:34.119762+0000","last_peered":"2024-09-10T22:16:34.119762+0000","last_clean":"2024-09-10T22:16:34.119762+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:16:34.119762+0000","last_undegraded":"2024-09-10T22:16:34.119762+0000","last_fullsized":"2024-09-10T22:16:34.119762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125257+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:16:34.125257+0000","last_peered":"2024-09-10T22:16:34.125257+0000","last_clean":"2024-09-10T22:16:34.125257+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:16:34.125257+0000","last_undegraded":"2024-09-10T22:16:34.125257+0000","last_fullsized":"2024-09-10T22:16:34.125257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.114117+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:16:34.114117+0000","last_peered":"2024-09-10T22:16:34.114117+0000","last_clean":"2024-09-10T22:16:34.114117+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:16:34.114117+0000","last_undegraded":"2024-09-10T22:16:34.114117+0000","last_fullsized":"2024-09-10T22:16:34.114117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.103667+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:16:34.103667+0000","last_peered":"2024-09-10T22:16:34.103667+0000","last_clean":"2024-09-10T22:16:34.103667+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:16:34.103667+0000","last_undegraded":"2024-09-10T22:16:34.103667+0000","last_fullsized":"2024-09-10T22:16:34.103667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.107821+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:16:34.107821+0000","last_peered":"2024-09-10T22:16:34.107821+0000","last_clean":"2024-09-10T22:16:34.107821+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:16:34.107821+0000","last_undegraded":"2024-09-10T22:16:34.107821+0000","last_fullsized":"2024-09-10T22:16:34.107821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.101052+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:16:34.101052+0000","last_peered":"2024-09-10T22:16:34.101052+0000","last_clean":"2024-09-10T22:16:34.101052+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:16:34.101052+0000","last_undegraded":"2024-09-10T22:16:34.101052+0000","last_fullsized":"2024-09-10T22:16:34.101052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'7","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.551949+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:16:49.551949+0000","last_peered":"2024-09-10T22:16:49.551949+0000","last_clean":"2024-09-10T22:16:49.551949+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:16:49.551949+0000","last_undegraded":"2024-09-10T22:16:49.551949+0000","last_fullsized":"2024-09-10T22:16:49.551949+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115547+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:16:34.115547+0000","last_peered":"2024-09-10T22:16:34.115547+0000","last_clean":"2024-09-10T22:16:34.115547+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:16:34.115547+0000","last_undegraded":"2024-09-10T22:16:34.115547+0000","last_fullsized":"2024-09-10T22:16:34.115547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480566+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:35.480566+0000","last_peered":"2024-09-10T22:15:35.480566+0000","last_clean":"2024-09-10T22:15:35.480566+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:35.480566+0000","last_undegraded":"2024-09-10T22:15:35.480566+0000","last_fullsized":"2024-09-10T22:15:35.480566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476737+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:35.476737+0000","last_peered":"2024-09-10T22:15:35.476737+0000","last_clean":"2024-09-10T22:15:35.476737+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:35.476737+0000","last_undegraded":"2024-09-10T22:15:35.476737+0000","last_fullsized":"2024-09-10T22:15:35.476737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116307+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:16:34.116307+0000","last_peered":"2024-09-10T22:16:34.116307+0000","last_clean":"2024-09-10T22:16:34.116307+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:16:34.116307+0000","last_undegraded":"2024-09-10T22:16:34.116307+0000","last_fullsized":"2024-09-10T22:16:34.116307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478017+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:35.478017+0000","last_peered":"2024-09-10T22:15:35.478017+0000","last_clean":"2024-09-10T22:15:35.478017+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:35.478017+0000","last_undegraded":"2024-09-10T22:15:35.478017+0000","last_fullsized":"2024-09-10T22:15:35.478017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110101+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:16:34.110101+0000","last_peered":"2024-09-10T22:16:34.110101+0000","last_clean":"2024-09-10T22:16:34.110101+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:16:34.110101+0000","last_undegraded":"2024-09-10T22:16:34.110101+0000","last_fullsized":"2024-09-10T22:16:34.110101+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:48.549826+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:16:48.549826+0000","last_peered":"2024-09-10T22:16:48.549826+0000","last_clean":"2024-09-10T22:16:48.549826+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:16:48.549826+0000","last_undegraded":"2024-09-10T22:16:48.549826+0000","last_fullsized":"2024-09-10T22:16:48.549826+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.118556+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:16:34.118556+0000","last_peered":"2024-09-10T22:16:34.118556+0000","last_clean":"2024-09-10T22:16:34.118556+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:16:34.118556+0000","last_undegraded":"2024-09-10T22:16:34.118556+0000","last_fullsized":"2024-09-10T22:16:34.118556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847900+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:36.847900+0000","last_peered":"2024-09-10T22:15:36.847900+0000","last_clean":"2024-09-10T22:15:36.847900+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:36.847900+0000","last_undegraded":"2024-09-10T22:15:36.847900+0000","last_fullsized":"2024-09-10T22:15:36.847900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125195+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:16:34.125195+0000","last_peered":"2024-09-10T22:16:34.125195+0000","last_clean":"2024-09-10T22:16:34.125195+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:16:34.125195+0000","last_undegraded":"2024-09-10T22:16:34.125195+0000","last_fullsized":"2024-09-10T22:16:34.125195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478635+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:35.478635+0000","last_peered":"2024-09-10T22:15:35.478635+0000","last_clean":"2024-09-10T22:15:35.478635+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:35.478635+0000","last_undegraded":"2024-09-10T22:15:35.478635+0000","last_fullsized":"2024-09-10T22:15:35.478635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.117012+0000","last_change":"2024-09-10T22:15:35.483364+0000","last_active":"2024-09-10T22:16:34.117012+0000","last_peered":"2024-09-10T22:16:34.117012+0000","last_clean":"2024-09-10T22:16:34.117012+0000","last_became_active":"2024-09-10T22:15:35.482977+0000","last_became_peered":"2024-09-10T22:15:35.482977+0000","last_unstale":"2024-09-10T22:16:34.117012+0000","last_undegraded":"2024-09-10T22:16:34.117012+0000","last_fullsized":"2024-09-10T22:16:34.117012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:04.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'31","reported_seq":258,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.551293+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:16:49.551293+0000","last_peered":"2024-09-10T22:16:49.551293+0000","last_clean":"2024-09-10T22:16:49.551293+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:16:49.551293+0000","last_undegraded":"2024-09-10T22:16:49.551293+0000","last_fullsized":"2024-09-10T22:16:49.551293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60866,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":204,"num_read_kb":160,"num_write":32,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.103602+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:16:34.103602+0000","last_peered":"2024-09-10T22:16:34.103602+0000","last_clean":"2024-09-10T22:16:34.103602+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:16:34.103602+0000","last_undegraded":"2024-09-10T22:16:34.103602+0000","last_fullsized":"2024-09-10T22:16:34.103602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479200+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:35.479200+0000","last_peered":"2024-09-10T22:15:35.479200+0000","last_clean":"2024-09-10T22:15:35.479200+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:35.479200+0000","last_undegraded":"2024-09-10T22:15:35.479200+0000","last_fullsized":"2024-09-10T22:15:35.479200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116607+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:16:34.116607+0000","last_peered":"2024-09-10T22:16:34.116607+0000","last_clean":"2024-09-10T22:16:34.116607+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:16:34.116607+0000","last_undegraded":"2024-09-10T22:16:34.116607+0000","last_fullsized":"2024-09-10T22:16:34.116607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.122615+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:16:34.122615+0000","last_peered":"2024-09-10T22:16:34.122615+0000","last_clean":"2024-09-10T22:16:34.122615+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:16:34.122615+0000","last_undegraded":"2024-09-10T22:16:34.122615+0000","last_fullsized":"2024-09-10T22:16:34.122615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.550022+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:16:49.550022+0000","last_peered":"2024-09-10T22:16:49.550022+0000","last_clean":"2024-09-10T22:16:49.550022+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:16:49.550022+0000","last_undegraded":"2024-09-10T22:16:49.550022+0000","last_fullsized":"2024-09-10T22:16:49.550022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125079+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:16:34.125079+0000","last_peered":"2024-09-10T22:16:34.125079+0000","last_clean":"2024-09-10T22:16:34.125079+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:16:34.125079+0000","last_undegraded":"2024-09-10T22:16:34.125079+0000","last_fullsized":"2024-09-10T22:16:34.125079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480414+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:35.480414+0000","last_peered":"2024-09-10T22:15:35.480414+0000","last_clean":"2024-09-10T22:15:35.480414+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:35.480414+0000","last_undegraded":"2024-09-10T22:15:35.480414+0000","last_fullsized":"2024-09-10T22:15:35.480414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115009+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:16:34.115009+0000","last_peered":"2024-09-10T22:16:34.115009+0000","last_clean":"2024-09-10T22:16:34.115009+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:16:34.115009+0000","last_undegraded":"2024-09-10T22:16:34.115009+0000","last_fullsized":"2024-09-10T22:16:34.115009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481875+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:35.481875+0000","last_peered":"2024-09-10T22:15:35.481875+0000","last_clean":"2024-09-10T22:15:35.481875+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:35.481875+0000","last_undegraded":"2024-09-10T22:15:35.481875+0000","last_fullsized":"2024-09-10T22:15:35.481875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106972+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:16:34.106972+0000","last_peered":"2024-09-10T22:16:34.106972+0000","last_clean":"2024-09-10T22:16:34.106972+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:16:34.106972+0000","last_undegraded":"2024-09-10T22:16:34.106972+0000","last_fullsized":"2024-09-10T22:16:34.106972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477187+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:35.477187+0000","last_peered":"2024-09-10T22:15:35.477187+0000","last_clean":"2024-09-10T22:15:35.477187+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:35.477187+0000","last_undegraded":"2024-09-10T22:15:35.477187+0000","last_fullsized":"2024-09-10T22:15:35.477187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124665+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:16:34.124665+0000","last_peered":"2024-09-10T22:16:34.124665+0000","last_clean":"2024-09-10T22:16:34.124665+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:16:34.124665+0000","last_undegraded":"2024-09-10T22:16:34.124665+0000","last_fullsized":"2024-09-10T22:16:34.124665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478753+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:35.478753+0000","last_peered":"2024-09-10T22:15:35.478753+0000","last_clean":"2024-09-10T22:15:35.478753+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:35.478753+0000","last_undegraded":"2024-09-10T22:15:35.478753+0000","last_fullsized":"2024-09-10T22:15:35.478753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.113650+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:16:34.113650+0000","last_peered":"2024-09-10T22:16:34.113650+0000","last_clean":"2024-09-10T22:16:34.113650+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:16:34.113650+0000","last_undegraded":"2024-09-10T22:16:34.113650+0000","last_fullsized":"2024-09-10T22:16:34.113650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479310+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:35.479310+0000","last_peered":"2024-09-10T22:15:35.479310+0000","last_clean":"2024-09-10T22:15:35.479310+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:35.479310+0000","last_undegraded":"2024-09-10T22:15:35.479310+0000","last_fullsized":"2024-09-10T22:15:35.479310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.123326+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:16:34.123326+0000","last_peered":"2024-09-10T22:16:34.123326+0000","last_clean":"2024-09-10T22:16:34.123326+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:16:34.123326+0000","last_undegraded":"2024-09-10T22:16:34.123326+0000","last_fullsized":"2024-09-10T22:16:34.123326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847758+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:36.847758+0000","last_peered":"2024-09-10T22:15:36.847758+0000","last_clean":"2024-09-10T22:15:36.847758+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:36.847758+0000","last_undegraded":"2024-09-10T22:15:36.847758+0000","last_fullsized":"2024-09-10T22:15:36.847758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477570+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:35.477570+0000","last_peered":"2024-09-10T22:15:35.477570+0000","last_clean":"2024-09-10T22:15:35.477570+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:35.477570+0000","last_undegraded":"2024-09-10T22:15:35.477570+0000","last_fullsized":"2024-09-10T22:15:35.477570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108644+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:16:34.108644+0000","last_peered":"2024-09-10T22:16:34.108644+0000","last_clean":"2024-09-10T22:16:34.108644+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:16:34.108644+0000","last_undegraded":"2024-09-10T22:16:34.108644+0000","last_fullsized":"2024-09-10T22:16:34.108644+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847681+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:36.847681+0000","last_peered":"2024-09-10T22:15:36.847681+0000","last_clean":"2024-09-10T22:15:36.847681+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:36.847681+0000","last_undegraded":"2024-09-10T22:15:36.847681+0000","last_fullsized":"2024-09-10T22:15:36.847681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.113287+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:16:34.113287+0000","last_peered":"2024-09-10T22:16:34.113287+0000","last_clean":"2024-09-10T22:16:34.113287+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:16:34.113287+0000","last_undegraded":"2024-09-10T22:16:34.113287+0000","last_fullsized":"2024-09-10T22:16:34.113287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":127,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:51.552453+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:16:51.552453+0000","last_peered":"2024-09-10T22:16:51.552453+0000","last_clean":"2024-09-10T22:16:51.552453+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:16:51.552453+0000","last_undegraded":"2024-09-10T22:16:51.552453+0000","last_fullsized":"2024-09-10T22:16:51.552453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115051+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:16:34.115051+0000","last_peered":"2024-09-10T22:16:34.115051+0000","last_clean":"2024-09-10T22:16:34.115051+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:16:34.115051+0000","last_undegraded":"2024-09-10T22:16:34.115051+0000","last_fullsized":"2024-09-10T22:16:34.115051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847841+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:36.847841+0000","last_peered":"2024-09-10T22:15:36.847841+0000","last_clean":"2024-09-10T22:15:36.847841+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:36.847841+0000","last_undegraded":"2024-09-10T22:15:36.847841+0000","last_fullsized":"2024-09-10T22:15:36.847841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.097523+0000","last_change":"2024-09-10T22:15:35.484767+0000","last_active":"2024-09-10T22:16:34.097523+0000","last_peered":"2024-09-10T22:16:34.097523+0000","last_clean":"2024-09-10T22:16:34.097523+0000","last_became_active":"2024-09-10T22:15:35.484427+0000","last_became_peered":"2024-09-10T22:15:35.484427+0000","last_unstale":"2024-09-10T22:16:34.097523+0000","last_undegraded":"2024-09-10T22:16:34.097523+0000","last_fullsized":"2024-09-10T22:16:34.097523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:35.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483370+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:35.483370+0000","last_peered":"2024-09-10T22:15:35.483370+0000","last_clean":"2024-09-10T22:15:35.483370+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:35.483370+0000","last_undegraded":"2024-09-10T22:15:35.483370+0000","last_fullsized":"2024-09-10T22:15:35.483370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.105653+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:16:34.105653+0000","last_peered":"2024-09-10T22:16:34.105653+0000","last_clean":"2024-09-10T22:16:34.105653+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:16:34.105653+0000","last_undegraded":"2024-09-10T22:16:34.105653+0000","last_fullsized":"2024-09-10T22:16:34.105653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.489459+0000","last_change":"2024-09-10T22:15:35.488995+0000","last_active":"2024-09-10T22:15:35.489459+0000","last_peered":"2024-09-10T22:15:35.489459+0000","last_clean":"2024-09-10T22:15:35.489459+0000","last_became_active":"2024-09-10T22:15:35.484278+0000","last_became_peered":"2024-09-10T22:15:35.484278+0000","last_unstale":"2024-09-10T22:15:35.489459+0000","last_undegraded":"2024-09-10T22:15:35.489459+0000","last_fullsized":"2024-09-10T22:15:35.489459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:00.474920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115090+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:16:34.115090+0000","last_peered":"2024-09-10T22:16:34.115090+0000","last_clean":"2024-09-10T22:16:34.115090+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:16:34.115090+0000","last_undegraded":"2024-09-10T22:16:34.115090+0000","last_fullsized":"2024-09-10T22:16:34.115090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'13","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483341+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:15:35.483341+0000","last_peered":"2024-09-10T22:15:35.483341+0000","last_clean":"2024-09-10T22:15:35.483341+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:15:35.483341+0000","last_undegraded":"2024-09-10T22:15:35.483341+0000","last_fullsized":"2024-09-10T22:15:35.483341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112824+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:16:34.112824+0000","last_peered":"2024-09-10T22:16:34.112824+0000","last_clean":"2024-09-10T22:16:34.112824+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:16:34.112824+0000","last_undegraded":"2024-09-10T22:16:34.112824+0000","last_fullsized":"2024-09-10T22:16:34.112824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477897+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:35.477897+0000","last_peered":"2024-09-10T22:15:35.477897+0000","last_clean":"2024-09-10T22:15:35.477897+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:35.477897+0000","last_undegraded":"2024-09-10T22:15:35.477897+0000","last_fullsized":"2024-09-10T22:15:35.477897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125327+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:16:34.125327+0000","last_peered":"2024-09-10T22:16:34.125327+0000","last_clean":"2024-09-10T22:16:34.125327+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:16:34.125327+0000","last_undegraded":"2024-09-10T22:16:34.125327+0000","last_fullsized":"2024-09-10T22:16:34.125327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.486805+0000","last_change":"2024-09-10T22:15:35.486730+0000","last_active":"2024-09-10T22:15:35.486805+0000","last_peered":"2024-09-10T22:15:35.486805+0000","last_clean":"2024-09-10T22:15:35.486805+0000","last_became_active":"2024-09-10T22:15:35.483148+0000","last_became_peered":"2024-09-10T22:15:35.483148+0000","last_unstale":"2024-09-10T22:15:35.486805+0000","last_undegraded":"2024-09-10T22:15:35.486805+0000","last_fullsized":"2024-09-10T22:15:35.486805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:10.166666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.076070+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:16:34.076070+0000","last_peered":"2024-09-10T22:16:34.076070+0000","last_clean":"2024-09-10T22:16:34.076070+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:16:34.076070+0000","last_undegraded":"2024-09-10T22:16:34.076070+0000","last_fullsized":"2024-09-10T22:16:34.076070+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102639+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:36.102639+0000","last_peered":"2024-09-10T22:15:36.102639+0000","last_clean":"2024-09-10T22:15:36.102639+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:36.102639+0000","last_undegraded":"2024-09-10T22:15:36.102639+0000","last_fullsized":"2024-09-10T22:15:36.102639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108112+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:16:34.108112+0000","last_peered":"2024-09-10T22:16:34.108112+0000","last_clean":"2024-09-10T22:16:34.108112+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:16:34.108112+0000","last_undegraded":"2024-09-10T22:16:34.108112+0000","last_fullsized":"2024-09-10T22:16:34.108112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479161+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:35.479161+0000","last_peered":"2024-09-10T22:15:35.479161+0000","last_clean":"2024-09-10T22:15:35.479161+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:35.479161+0000","last_undegraded":"2024-09-10T22:15:35.479161+0000","last_fullsized":"2024-09-10T22:15:35.479161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.119857+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:16:34.119857+0000","last_peered":"2024-09-10T22:16:34.119857+0000","last_clean":"2024-09-10T22:16:34.119857+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:16:34.119857+0000","last_undegraded":"2024-09-10T22:16:34.119857+0000","last_fullsized":"2024-09-10T22:16:34.119857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481286+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:35.481286+0000","last_peered":"2024-09-10T22:15:35.481286+0000","last_clean":"2024-09-10T22:15:35.481286+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:35.481286+0000","last_undegraded":"2024-09-10T22:15:35.481286+0000","last_fullsized":"2024-09-10T22:15:35.481286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121766+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:16:34.121766+0000","last_peered":"2024-09-10T22:16:34.121766+0000","last_clean":"2024-09-10T22:16:34.121766+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:16:34.121766+0000","last_undegraded":"2024-09-10T22:16:34.121766+0000","last_fullsized":"2024-09-10T22:16:34.121766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116042+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:16:34.116042+0000","last_peered":"2024-09-10T22:16:34.116042+0000","last_clean":"2024-09-10T22:16:34.116042+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:16:34.116042+0000","last_undegraded":"2024-09-10T22:16:34.116042+0000","last_fullsized":"2024-09-10T22:16:34.116042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482561+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:35.482561+0000","last_peered":"2024-09-10T22:15:35.482561+0000","last_clean":"2024-09-10T22:15:35.482561+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:35.482561+0000","last_undegraded":"2024-09-10T22:15:35.482561+0000","last_fullsized":"2024-09-10T22:15:35.482561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116358+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:16:34.116358+0000","last_peered":"2024-09-10T22:16:34.116358+0000","last_clean":"2024-09-10T22:16:34.116358+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:16:34.116358+0000","last_undegraded":"2024-09-10T22:16:34.116358+0000","last_fullsized":"2024-09-10T22:16:34.116358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481854+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:35.481854+0000","last_peered":"2024-09-10T22:15:35.481854+0000","last_clean":"2024-09-10T22:15:35.481854+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:35.481854+0000","last_undegraded":"2024-09-10T22:15:35.481854+0000","last_fullsized":"2024-09-10T22:15:35.481854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.120912+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:16:34.120912+0000","last_peered":"2024-09-10T22:16:34.120912+0000","last_clean":"2024-09-10T22:16:34.120912+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:16:34.120912+0000","last_undegraded":"2024-09-10T22:16:34.120912+0000","last_fullsized":"2024-09-10T22:16:34.120912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103492+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:36.103492+0000","last_peered":"2024-09-10T22:15:36.103492+0000","last_clean":"2024-09-10T22:15:36.103492+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:36.103492+0000","last_undegraded":"2024-09-10T22:15:36.103492+0000","last_fullsized":"2024-09-10T22:15:36.103492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106001+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:16:34.106001+0000","last_peered":"2024-09-10T22:16:34.106001+0000","last_clean":"2024-09-10T22:16:34.106001+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:16:34.106001+0000","last_undegraded":"2024-09-10T22:16:34.106001+0000","last_fullsized":"2024-09-10T22:16:34.106001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483426+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:35.483426+0000","last_peered":"2024-09-10T22:15:35.483426+0000","last_clean":"2024-09-10T22:15:35.483426+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:35.483426+0000","last_undegraded":"2024-09-10T22:15:35.483426+0000","last_fullsized":"2024-09-10T22:15:35.483426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65008,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":616,"num_read_kb":376,"num_write":171,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":195332,"data_compressed":5442,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":843776,"data_stored":408651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906985,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":987136,"data_stored":1060976,"data_compressed":37762,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070509,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":408865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":408763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":1000856,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":408254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1000540,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":408691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":408565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":470795,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":468913,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":409525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61174,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":62748,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":62444,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:16:55.650 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-10T22:16:55.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T22:16:55.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 -- 172.21.15.5:0/1644801245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 msgr2=0x7fa8d0105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 --2- 172.21.15.5:0/1644801245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d0105580 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009900 tx=0x7fa8c002a410 comp rx=0 tx=0).stop 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 -- 172.21.15.5:0/1644801245 shutdown_connections 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 --2- 172.21.15.5:0/1644801245 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d01086c0 0x7fa8d010ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 --2- 172.21.15.5:0/1644801245 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 0x7fa8d0107f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 --2- 172.21.15.5:0/1644801245 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d0105580 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 -- 172.21.15.5:0/1644801245 >> 172.21.15.5:0/1644801245 conn(0x7fa8d00fd150 msgr2=0x7fa8d00ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 -- 172.21.15.5:0/1644801245 shutdown_connections 2024-09-10T22:16:55.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.788+0000 7fa8d512c640 1 -- 172.21.15.5:0/1644801245 wait complete. 2024-09-10T22:16:55.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 Processor -- start 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 -- start start 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d019aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 0x7fa8d019b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d01086c0 0x7fa8d019c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d010e5f0 con 0x7fa8d006beb0 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d010e470 con 0x7fa8d01086c0 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8d512c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa8d010e770 con 0x7fa8d0105b10 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d019aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8ced9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d019aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39396/0 (socket says 172.21.15.5:39396) 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8ced9d640 1 -- 172.21.15.5:0/828455236 learned_addr learned my addr 172.21.15.5:0/828455236 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8cf59e640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d01086c0 0x7fa8d019c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.789+0000 7fa8ce59c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 0x7fa8d019b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ced9d640 1 -- 172.21.15.5:0/828455236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 msgr2=0x7fa8d019b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ced9d640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 0x7fa8d019b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ced9d640 1 -- 172.21.15.5:0/828455236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d01086c0 msgr2=0x7fa8d019c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ced9d640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d01086c0 0x7fa8d019c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ced9d640 1 -- 172.21.15.5:0/828455236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8d019cb30 con 0x7fa8d006beb0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ce59c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 0x7fa8d019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8ced9d640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d019aff0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0005940 tx=0x7fa8c00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c003f030 con 0x7fa8d006beb0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8d019cdc0 con 0x7fa8d006beb0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8c0003cb0 con 0x7fa8d006beb0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0035070 con 0x7fa8d006beb0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.790+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8d01a34f0 con 0x7fa8d006beb0 2024-09-10T22:16:55.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.791+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d0105f70 con 0x7fa8d006beb0 2024-09-10T22:16:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.792+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa8c003bc20 con 0x7fa8d006beb0 2024-09-10T22:16:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.793+0000 7fa8b7fff640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8b80b52e0 0x7fa8b80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.793+0000 7fa8ce59c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8b80b52e0 0x7fa8b80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.793+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fa8c0106570 con 0x7fa8d006beb0 2024-09-10T22:16:55.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.794+0000 7fa8ce59c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8b80b52e0 0x7fa8b80b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009c20 tx=0x7fa8c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:55.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.796+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa8c00cd460 con 0x7fa8d006beb0 2024-09-10T22:16:55.987 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.984+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 --> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8d010a3e0 con 0x7fa8b80b52e0 2024-09-10T22:16:55.991 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.989+0000 7fa8b7fff640 1 -- 172.21.15.5:0/828455236 <== mgr.14150 v2:172.21.15.5:6800/2373125998 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259036 (secure 0 0 0) 0x7fa8d010a3e0 con 0x7fa8b80b52e0 2024-09-10T22:16:55.994 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:55.995 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-10T22:16:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8b80b52e0 msgr2=0x7fa8b80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8b80b52e0 0x7fa8b80b77a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009c20 tx=0x7fa8c4005f90 comp rx=0 tx=0).stop 2024-09-10T22:16:55.996 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 msgr2=0x7fa8d019aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d019aff0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0005940 tx=0x7fa8c00042f0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 shutdown_connections 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa8b80b52e0 0x7fa8b80b77a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa8d01086c0 0x7fa8d019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa8d0105b10 0x7fa8d019b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 --2- 172.21.15.5:0/828455236 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa8d006beb0 0x7fa8d019aff0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 >> 172.21.15.5:0/828455236 conn(0x7fa8d00fd150 msgr2=0x7fa8d00ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 shutdown_connections 2024-09-10T22:16:55.997 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:55.992+0000 7fa8d512c640 1 -- 172.21.15.5:0/828455236 wait complete. 2024-09-10T22:16:56.004 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:55 smithi005 ceph-mon[31115]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:56.005 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2024-09-10T22:16:55.736693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661291,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":714,"num_read_kb":457,"num_write":301,"num_write_kb":2275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951862,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":743,"ondisk_log_size":743,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363780,"kb_used_data":10372,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124578044,"statfs":{"total":1151940427776,"available":1151567917056,"internally_reserved":0,"allocated":10620928,"data_stored":6874756,"data_compressed":113286,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19141,"internal_metadata":361674043},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":47,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"3.3f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112001+0000","last_change":"2024-09-10T22:15:02.355675+0000","last_active":"2024-09-10T22:16:34.112001+0000","last_peered":"2024-09-10T22:16:34.112001+0000","last_clean":"2024-09-10T22:16:34.112001+0000","last_became_active":"2024-09-10T22:15:02.355267+0000","last_became_peered":"2024-09-10T22:15:02.355267+0000","last_unstale":"2024-09-10T22:16:34.112001+0000","last_undegraded":"2024-09-10T22:16:34.112001+0000","last_fullsized":"2024-09-10T22:16:34.112001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:09:59.465395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110999+0000","last_change":"2024-09-10T22:15:02.362416+0000","last_active":"2024-09-10T22:16:34.110999+0000","last_peered":"2024-09-10T22:16:34.110999+0000","last_clean":"2024-09-10T22:16:34.110999+0000","last_became_active":"2024-09-10T22:15:02.361645+0000","last_became_peered":"2024-09-10T22:15:02.361645+0000","last_unstale":"2024-09-10T22:16:34.110999+0000","last_undegraded":"2024-09-10T22:16:34.110999+0000","last_fullsized":"2024-09-10T22:16:34.110999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:47:04.422694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121198+0000","last_change":"2024-09-10T22:15:02.356831+0000","last_active":"2024-09-10T22:16:34.121198+0000","last_peered":"2024-09-10T22:16:34.121198+0000","last_clean":"2024-09-10T22:16:34.121198+0000","last_became_active":"2024-09-10T22:15:02.356545+0000","last_became_peered":"2024-09-10T22:15:02.356545+0000","last_unstale":"2024-09-10T22:16:34.121198+0000","last_undegraded":"2024-09-10T22:16:34.121198+0000","last_fullsized":"2024-09-10T22:16:34.121198+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:14:44.545389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.098362+0000","last_change":"2024-09-10T22:15:02.360124+0000","last_active":"2024-09-10T22:16:34.098362+0000","last_peered":"2024-09-10T22:16:34.098362+0000","last_clean":"2024-09-10T22:16:34.098362+0000","last_became_active":"2024-09-10T22:15:02.358700+0000","last_became_peered":"2024-09-10T22:15:02.358700+0000","last_unstale":"2024-09-10T22:16:34.098362+0000","last_undegraded":"2024-09-10T22:16:34.098362+0000","last_fullsized":"2024-09-10T22:16:34.098362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:05:51.004199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.101802+0000","last_change":"2024-09-10T22:15:02.362084+0000","last_active":"2024-09-10T22:16:34.101802+0000","last_peered":"2024-09-10T22:16:34.101802+0000","last_clean":"2024-09-10T22:16:34.101802+0000","last_became_active":"2024-09-10T22:15:02.361677+0000","last_became_peered":"2024-09-10T22:15:02.361677+0000","last_unstale":"2024-09-10T22:16:34.101802+0000","last_undegraded":"2024-09-10T22:16:34.101802+0000","last_fullsized":"2024-09-10T22:16:34.101802+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:00:07.656279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108619+0000","last_change":"2024-09-10T22:15:02.360934+0000","last_active":"2024-09-10T22:16:34.108619+0000","last_peered":"2024-09-10T22:16:34.108619+0000","last_clean":"2024-09-10T22:16:34.108619+0000","last_became_active":"2024-09-10T22:15:02.360551+0000","last_became_peered":"2024-09-10T22:15:02.360551+0000","last_unstale":"2024-09-10T22:16:34.108619+0000","last_undegraded":"2024-09-10T22:16:34.108619+0000","last_fullsized":"2024-09-10T22:16:34.108619+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:04.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.099889+0000","last_change":"2024-09-10T22:15:02.360094+0000","last_active":"2024-09-10T22:16:34.099889+0000","last_peered":"2024-09-10T22:16:34.099889+0000","last_clean":"2024-09-10T22:16:34.099889+0000","last_became_active":"2024-09-10T22:15:02.359734+0000","last_became_peered":"2024-09-10T22:15:02.359734+0000","last_unstale":"2024-09-10T22:16:34.099889+0000","last_undegraded":"2024-09-10T22:16:34.099889+0000","last_fullsized":"2024-09-10T22:16:34.099889+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:59:38.678083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109664+0000","last_change":"2024-09-10T22:15:02.358812+0000","last_active":"2024-09-10T22:16:34.109664+0000","last_peered":"2024-09-10T22:16:34.109664+0000","last_clean":"2024-09-10T22:16:34.109664+0000","last_became_active":"2024-09-10T22:15:02.358432+0000","last_became_peered":"2024-09-10T22:15:02.358432+0000","last_unstale":"2024-09-10T22:16:34.109664+0000","last_undegraded":"2024-09-10T22:16:34.109664+0000","last_fullsized":"2024-09-10T22:16:34.109664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:56:24.902129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110803+0000","last_change":"2024-09-10T22:15:02.365956+0000","last_active":"2024-09-10T22:16:34.110803+0000","last_peered":"2024-09-10T22:16:34.110803+0000","last_clean":"2024-09-10T22:16:34.110803+0000","last_became_active":"2024-09-10T22:15:02.365614+0000","last_became_peered":"2024-09-10T22:15:02.365614+0000","last_unstale":"2024-09-10T22:16:34.110803+0000","last_undegraded":"2024-09-10T22:16:34.110803+0000","last_fullsized":"2024-09-10T22:16:34.110803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:18:06.437307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"78'16","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110812+0000","last_change":"2024-09-10T22:15:02.364697+0000","last_active":"2024-09-10T22:16:34.110812+0000","last_peered":"2024-09-10T22:16:34.110812+0000","last_clean":"2024-09-10T22:16:34.110812+0000","last_became_active":"2024-09-10T22:15:02.364329+0000","last_became_peered":"2024-09-10T22:15:02.364329+0000","last_unstale":"2024-09-10T22:16:34.110812+0000","last_undegraded":"2024-09-10T22:16:34.110812+0000","last_fullsized":"2024-09-10T22:16:34.110812+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:55:26.633488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121464+0000","last_change":"2024-09-10T22:15:02.357620+0000","last_active":"2024-09-10T22:16:34.121464+0000","last_peered":"2024-09-10T22:16:34.121464+0000","last_clean":"2024-09-10T22:16:34.121464+0000","last_became_active":"2024-09-10T22:15:02.357320+0000","last_became_peered":"2024-09-10T22:15:02.357320+0000","last_unstale":"2024-09-10T22:16:34.121464+0000","last_undegraded":"2024-09-10T22:16:34.121464+0000","last_fullsized":"2024-09-10T22:16:34.121464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:53.156607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.104804+0000","last_change":"2024-09-10T22:15:02.359647+0000","last_active":"2024-09-10T22:16:34.104804+0000","last_peered":"2024-09-10T22:16:34.104804+0000","last_clean":"2024-09-10T22:16:34.104804+0000","last_became_active":"2024-09-10T22:15:02.359262+0000","last_became_peered":"2024-09-10T22:15:02.359262+0000","last_unstale":"2024-09-10T22:16:34.104804+0000","last_undegraded":"2024-09-10T22:16:34.104804+0000","last_fullsized":"2024-09-10T22:16:34.104804+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:12:21.372770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.120445+0000","last_change":"2024-09-10T22:15:02.365215+0000","last_active":"2024-09-10T22:16:34.120445+0000","last_peered":"2024-09-10T22:16:34.120445+0000","last_clean":"2024-09-10T22:16:34.120445+0000","last_became_active":"2024-09-10T22:15:02.364554+0000","last_became_peered":"2024-09-10T22:15:02.364554+0000","last_unstale":"2024-09-10T22:16:34.120445+0000","last_undegraded":"2024-09-10T22:16:34.120445+0000","last_fullsized":"2024-09-10T22:16:34.120445+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:40.715431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121290+0000","last_change":"2024-09-10T22:15:02.361955+0000","last_active":"2024-09-10T22:16:34.121290+0000","last_peered":"2024-09-10T22:16:34.121290+0000","last_clean":"2024-09-10T22:16:34.121290+0000","last_became_active":"2024-09-10T22:15:02.361623+0000","last_became_peered":"2024-09-10T22:15:02.361623+0000","last_unstale":"2024-09-10T22:16:34.121290+0000","last_undegraded":"2024-09-10T22:16:34.121290+0000","last_fullsized":"2024-09-10T22:16:34.121290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:18.562781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125046+0000","last_change":"2024-09-10T22:15:02.366869+0000","last_active":"2024-09-10T22:16:34.125046+0000","last_peered":"2024-09-10T22:16:34.125046+0000","last_clean":"2024-09-10T22:16:34.125046+0000","last_became_active":"2024-09-10T22:15:02.366467+0000","last_became_peered":"2024-09-10T22:15:02.366467+0000","last_unstale":"2024-09-10T22:16:34.125046+0000","last_undegraded":"2024-09-10T22:16:34.125046+0000","last_fullsized":"2024-09-10T22:16:34.125046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:14:28.097993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124439+0000","last_change":"2024-09-10T22:15:02.354382+0000","last_active":"2024-09-10T22:16:34.124439+0000","last_peered":"2024-09-10T22:16:34.124439+0000","last_clean":"2024-09-10T22:16:34.124439+0000","last_became_active":"2024-09-10T22:15:02.353435+0000","last_became_peered":"2024-09-10T22:15:02.353435+0000","last_unstale":"2024-09-10T22:16:34.124439+0000","last_undegraded":"2024-09-10T22:16:34.124439+0000","last_fullsized":"2024-09-10T22:16:34.124439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:18:49.288129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112223+0000","last_change":"2024-09-10T22:15:02.357740+0000","last_active":"2024-09-10T22:16:34.112223+0000","last_peered":"2024-09-10T22:16:34.112223+0000","last_clean":"2024-09-10T22:16:34.112223+0000","last_became_active":"2024-09-10T22:15:02.357231+0000","last_became_peered":"2024-09-10T22:15:02.357231+0000","last_unstale":"2024-09-10T22:16:34.112223+0000","last_undegraded":"2024-09-10T22:16:34.112223+0000","last_fullsized":"2024-09-10T22:16:34.112223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:24:20.397422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109523+0000","last_change":"2024-09-10T22:15:02.352198+0000","last_active":"2024-09-10T22:16:34.109523+0000","last_peered":"2024-09-10T22:16:34.109523+0000","last_clean":"2024-09-10T22:16:34.109523+0000","last_became_active":"2024-09-10T22:15:02.351889+0000","last_became_peered":"2024-09-10T22:15:02.351889+0000","last_unstale":"2024-09-10T22:16:34.109523+0000","last_undegraded":"2024-09-10T22:16:34.109523+0000","last_fullsized":"2024-09-10T22:16:34.109523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:58:19.701991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"78'7","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.102159+0000","last_change":"2024-09-10T22:15:35.484878+0000","last_active":"2024-09-10T22:16:34.102159+0000","last_peered":"2024-09-10T22:16:34.102159+0000","last_clean":"2024-09-10T22:16:34.102159+0000","last_became_active":"2024-09-10T22:15:35.484434+0000","last_became_peered":"2024-09-10T22:15:35.484434+0000","last_unstale":"2024-09-10T22:16:34.102159+0000","last_undegraded":"2024-09-10T22:16:34.102159+0000","last_fullsized":"2024-09-10T22:16:34.102159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:13:12.935958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"78'8","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.109364+0000","last_change":"2024-09-10T22:15:35.484696+0000","last_active":"2024-09-10T22:16:34.109364+0000","last_peered":"2024-09-10T22:16:34.109364+0000","last_clean":"2024-09-10T22:16:34.109364+0000","last_became_active":"2024-09-10T22:15:35.484342+0000","last_became_peered":"2024-09-10T22:15:35.484342+0000","last_unstale":"2024-09-10T22:16:34.109364+0000","last_undegraded":"2024-09-10T22:16:34.109364+0000","last_fullsized":"2024-09-10T22:16:34.109364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:48:44.550800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116718+0000","last_change":"2024-09-10T22:15:02.360071+0000","last_active":"2024-09-10T22:16:34.116718+0000","last_peered":"2024-09-10T22:16:34.116718+0000","last_clean":"2024-09-10T22:16:34.116718+0000","last_became_active":"2024-09-10T22:15:02.359695+0000","last_became_peered":"2024-09-10T22:15:02.359695+0000","last_unstale":"2024-09-10T22:16:34.116718+0000","last_undegraded":"2024-09-10T22:16:34.116718+0000","last_fullsized":"2024-09-10T22:16:34.116718+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:29.692009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124259+0000","last_change":"2024-09-10T22:15:02.353799+0000","last_active":"2024-09-10T22:16:34.124259+0000","last_peered":"2024-09-10T22:16:34.124259+0000","last_clean":"2024-09-10T22:16:34.124259+0000","last_became_active":"2024-09-10T22:15:02.353463+0000","last_became_peered":"2024-09-10T22:15:02.353463+0000","last_unstale":"2024-09-10T22:16:34.124259+0000","last_undegraded":"2024-09-10T22:16:34.124259+0000","last_fullsized":"2024-09-10T22:16:34.124259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:50:08.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112002+0000","last_change":"2024-09-10T22:15:02.365909+0000","last_active":"2024-09-10T22:16:34.112002+0000","last_peered":"2024-09-10T22:16:34.112002+0000","last_clean":"2024-09-10T22:16:34.112002+0000","last_became_active":"2024-09-10T22:15:02.365540+0000","last_became_peered":"2024-09-10T22:15:02.365540+0000","last_unstale":"2024-09-10T22:16:34.112002+0000","last_undegraded":"2024-09-10T22:16:34.112002+0000","last_fullsized":"2024-09-10T22:16:34.112002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:25:36.423121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"78'6","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106097+0000","last_change":"2024-09-10T22:15:36.104261+0000","last_active":"2024-09-10T22:16:34.106097+0000","last_peered":"2024-09-10T22:16:34.106097+0000","last_clean":"2024-09-10T22:16:34.106097+0000","last_became_active":"2024-09-10T22:15:36.103864+0000","last_became_peered":"2024-09-10T22:15:36.103864+0000","last_unstale":"2024-09-10T22:16:34.106097+0000","last_undegraded":"2024-09-10T22:16:34.106097+0000","last_fullsized":"2024-09-10T22:16:34.106097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:24.892850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,3],"acting":[8,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.27","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.105899+0000","last_change":"2024-09-10T22:15:02.366427+0000","last_active":"2024-09-10T22:16:34.105899+0000","last_peered":"2024-09-10T22:16:34.105899+0000","last_clean":"2024-09-10T22:16:34.105899+0000","last_became_active":"2024-09-10T22:15:02.366097+0000","last_became_peered":"2024-09-10T22:15:02.366097+0000","last_unstale":"2024-09-10T22:16:34.105899+0000","last_undegraded":"2024-09-10T22:16:34.105899+0000","last_fullsized":"2024-09-10T22:16:34.105899+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:02:32.924315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.098702+0000","last_change":"2024-09-10T22:15:02.359314+0000","last_active":"2024-09-10T22:16:34.098702+0000","last_peered":"2024-09-10T22:16:34.098702+0000","last_clean":"2024-09-10T22:16:34.098702+0000","last_became_active":"2024-09-10T22:15:02.358963+0000","last_became_peered":"2024-09-10T22:15:02.358963+0000","last_unstale":"2024-09-10T22:16:34.098702+0000","last_undegraded":"2024-09-10T22:16:34.098702+0000","last_fullsized":"2024-09-10T22:16:34.098702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:28:01.946551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.107498+0000","last_change":"2024-09-10T22:15:02.362132+0000","last_active":"2024-09-10T22:16:34.107498+0000","last_peered":"2024-09-10T22:16:34.107498+0000","last_clean":"2024-09-10T22:16:34.107498+0000","last_became_active":"2024-09-10T22:15:02.360526+0000","last_became_peered":"2024-09-10T22:15:02.360526+0000","last_unstale":"2024-09-10T22:16:34.107498+0000","last_undegraded":"2024-09-10T22:16:34.107498+0000","last_fullsized":"2024-09-10T22:16:34.107498+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:34.350731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"78'4","reported_seq":22,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.119762+0000","last_change":"2024-09-10T22:15:02.363793+0000","last_active":"2024-09-10T22:16:34.119762+0000","last_peered":"2024-09-10T22:16:34.119762+0000","last_clean":"2024-09-10T22:16:34.119762+0000","last_became_active":"2024-09-10T22:15:02.363345+0000","last_became_peered":"2024-09-10T22:15:02.363345+0000","last_unstale":"2024-09-10T22:16:34.119762+0000","last_undegraded":"2024-09-10T22:16:34.119762+0000","last_fullsized":"2024-09-10T22:16:34.119762+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:59:35.473410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125257+0000","last_change":"2024-09-10T22:15:02.367186+0000","last_active":"2024-09-10T22:16:34.125257+0000","last_peered":"2024-09-10T22:16:34.125257+0000","last_clean":"2024-09-10T22:16:34.125257+0000","last_became_active":"2024-09-10T22:15:02.366406+0000","last_became_peered":"2024-09-10T22:15:02.366406+0000","last_unstale":"2024-09-10T22:16:34.125257+0000","last_undegraded":"2024-09-10T22:16:34.125257+0000","last_fullsized":"2024-09-10T22:16:34.125257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:45:08.274556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.114117+0000","last_change":"2024-09-10T22:15:02.354503+0000","last_active":"2024-09-10T22:16:34.114117+0000","last_peered":"2024-09-10T22:16:34.114117+0000","last_clean":"2024-09-10T22:16:34.114117+0000","last_became_active":"2024-09-10T22:15:02.354187+0000","last_became_peered":"2024-09-10T22:15:02.354187+0000","last_unstale":"2024-09-10T22:16:34.114117+0000","last_undegraded":"2024-09-10T22:16:34.114117+0000","last_fullsized":"2024-09-10T22:16:34.114117+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:28:35.332015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"78'12","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.103667+0000","last_change":"2024-09-10T22:15:02.367695+0000","last_active":"2024-09-10T22:16:34.103667+0000","last_peered":"2024-09-10T22:16:34.103667+0000","last_clean":"2024-09-10T22:16:34.103667+0000","last_became_active":"2024-09-10T22:15:02.366699+0000","last_became_peered":"2024-09-10T22:15:02.366699+0000","last_unstale":"2024-09-10T22:16:34.103667+0000","last_undegraded":"2024-09-10T22:16:34.103667+0000","last_fullsized":"2024-09-10T22:16:34.103667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:04.317043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.107821+0000","last_change":"2024-09-10T22:15:02.362601+0000","last_active":"2024-09-10T22:16:34.107821+0000","last_peered":"2024-09-10T22:16:34.107821+0000","last_clean":"2024-09-10T22:16:34.107821+0000","last_became_active":"2024-09-10T22:15:02.359446+0000","last_became_peered":"2024-09-10T22:15:02.359446+0000","last_unstale":"2024-09-10T22:16:34.107821+0000","last_undegraded":"2024-09-10T22:16:34.107821+0000","last_fullsized":"2024-09-10T22:16:34.107821+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:20.354772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.101052+0000","last_change":"2024-09-10T22:15:02.362411+0000","last_active":"2024-09-10T22:16:34.101052+0000","last_peered":"2024-09-10T22:16:34.101052+0000","last_clean":"2024-09-10T22:16:34.101052+0000","last_became_active":"2024-09-10T22:15:02.361734+0000","last_became_peered":"2024-09-10T22:15:02.361734+0000","last_unstale":"2024-09-10T22:16:34.101052+0000","last_undegraded":"2024-09-10T22:16:34.101052+0000","last_fullsized":"2024-09-10T22:16:34.101052+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:46:23.442215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"78'7","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:54.559928+0000","last_change":"2024-09-10T22:15:00.339662+0000","last_active":"2024-09-10T22:16:54.559928+0000","last_peered":"2024-09-10T22:16:54.559928+0000","last_clean":"2024-09-10T22:16:54.559928+0000","last_became_active":"2024-09-10T22:15:00.339290+0000","last_became_peered":"2024-09-10T22:15:00.339290+0000","last_unstale":"2024-09-10T22:16:54.559928+0000","last_undegraded":"2024-09-10T22:16:54.559928+0000","last_fullsized":"2024-09-10T22:16:54.559928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:46:53.495832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115547+0000","last_change":"2024-09-10T22:15:02.361331+0000","last_active":"2024-09-10T22:16:34.115547+0000","last_peered":"2024-09-10T22:16:34.115547+0000","last_clean":"2024-09-10T22:16:34.115547+0000","last_became_active":"2024-09-10T22:15:02.361035+0000","last_became_peered":"2024-09-10T22:15:02.361035+0000","last_unstale":"2024-09-10T22:16:34.115547+0000","last_undegraded":"2024-09-10T22:16:34.115547+0000","last_fullsized":"2024-09-10T22:16:34.115547+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:16:31.940600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480566+0000","last_change":"2024-09-10T22:15:00.339539+0000","last_active":"2024-09-10T22:15:35.480566+0000","last_peered":"2024-09-10T22:15:35.480566+0000","last_clean":"2024-09-10T22:15:35.480566+0000","last_became_active":"2024-09-10T22:15:00.339162+0000","last_became_peered":"2024-09-10T22:15:00.339162+0000","last_unstale":"2024-09-10T22:15:35.480566+0000","last_undegraded":"2024-09-10T22:15:35.480566+0000","last_fullsized":"2024-09-10T22:15:35.480566+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:51.600345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.476737+0000","last_change":"2024-09-10T22:15:00.334595+0000","last_active":"2024-09-10T22:15:35.476737+0000","last_peered":"2024-09-10T22:15:35.476737+0000","last_clean":"2024-09-10T22:15:35.476737+0000","last_became_active":"2024-09-10T22:15:00.334164+0000","last_became_peered":"2024-09-10T22:15:00.334164+0000","last_unstale":"2024-09-10T22:15:35.476737+0000","last_undegraded":"2024-09-10T22:15:35.476737+0000","last_fullsized":"2024-09-10T22:15:35.476737+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:11:42.201260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116307+0000","last_change":"2024-09-10T22:15:02.355235+0000","last_active":"2024-09-10T22:16:34.116307+0000","last_peered":"2024-09-10T22:16:34.116307+0000","last_clean":"2024-09-10T22:16:34.116307+0000","last_became_active":"2024-09-10T22:15:02.354948+0000","last_became_peered":"2024-09-10T22:15:02.354948+0000","last_unstale":"2024-09-10T22:16:34.116307+0000","last_undegraded":"2024-09-10T22:16:34.116307+0000","last_fullsized":"2024-09-10T22:16:34.116307+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:29.541810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478017+0000","last_change":"2024-09-10T22:15:00.343233+0000","last_active":"2024-09-10T22:15:35.478017+0000","last_peered":"2024-09-10T22:15:35.478017+0000","last_clean":"2024-09-10T22:15:35.478017+0000","last_became_active":"2024-09-10T22:15:00.342811+0000","last_became_peered":"2024-09-10T22:15:00.342811+0000","last_unstale":"2024-09-10T22:15:35.478017+0000","last_undegraded":"2024-09-10T22:15:35.478017+0000","last_fullsized":"2024-09-10T22:15:35.478017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:24.286533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"78'11","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.110101+0000","last_change":"2024-09-10T22:15:02.355322+0000","last_active":"2024-09-10T22:16:34.110101+0000","last_peered":"2024-09-10T22:16:34.110101+0000","last_clean":"2024-09-10T22:16:34.110101+0000","last_became_active":"2024-09-10T22:15:02.355017+0000","last_became_peered":"2024-09-10T22:15:02.355017+0000","last_unstale":"2024-09-10T22:16:34.110101+0000","last_undegraded":"2024-09-10T22:16:34.110101+0000","last_fullsized":"2024-09-10T22:16:34.110101+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:52:35.639150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"78'4","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:53.557935+0000","last_change":"2024-09-10T22:15:00.340871+0000","last_active":"2024-09-10T22:16:53.557935+0000","last_peered":"2024-09-10T22:16:53.557935+0000","last_clean":"2024-09-10T22:16:53.557935+0000","last_became_active":"2024-09-10T22:15:00.340405+0000","last_became_peered":"2024-09-10T22:15:00.340405+0000","last_unstale":"2024-09-10T22:16:53.557935+0000","last_undegraded":"2024-09-10T22:16:53.557935+0000","last_fullsized":"2024-09-10T22:16:53.557935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:29:03.344929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"78'10","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.118556+0000","last_change":"2024-09-10T22:15:02.358534+0000","last_active":"2024-09-10T22:16:34.118556+0000","last_peered":"2024-09-10T22:16:34.118556+0000","last_clean":"2024-09-10T22:16:34.118556+0000","last_became_active":"2024-09-10T22:15:02.358006+0000","last_became_peered":"2024-09-10T22:15:02.358006+0000","last_unstale":"2024-09-10T22:16:34.118556+0000","last_undegraded":"2024-09-10T22:16:34.118556+0000","last_fullsized":"2024-09-10T22:16:34.118556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:22:10.606007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847900+0000","last_change":"2024-09-10T22:15:00.340599+0000","last_active":"2024-09-10T22:15:36.847900+0000","last_peered":"2024-09-10T22:15:36.847900+0000","last_clean":"2024-09-10T22:15:36.847900+0000","last_became_active":"2024-09-10T22:15:00.340244+0000","last_became_peered":"2024-09-10T22:15:00.340244+0000","last_unstale":"2024-09-10T22:15:36.847900+0000","last_undegraded":"2024-09-10T22:15:36.847900+0000","last_fullsized":"2024-09-10T22:15:36.847900+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:49.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125195+0000","last_change":"2024-09-10T22:15:02.367133+0000","last_active":"2024-09-10T22:16:34.125195+0000","last_peered":"2024-09-10T22:16:34.125195+0000","last_clean":"2024-09-10T22:16:34.125195+0000","last_became_active":"2024-09-10T22:15:02.366839+0000","last_became_peered":"2024-09-10T22:15:02.366839+0000","last_unstale":"2024-09-10T22:16:34.125195+0000","last_undegraded":"2024-09-10T22:16:34.125195+0000","last_fullsized":"2024-09-10T22:16:34.125195+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:08.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478635+0000","last_change":"2024-09-10T22:15:00.548780+0000","last_active":"2024-09-10T22:15:35.478635+0000","last_peered":"2024-09-10T22:15:35.478635+0000","last_clean":"2024-09-10T22:15:35.478635+0000","last_became_active":"2024-09-10T22:15:00.548441+0000","last_became_peered":"2024-09-10T22:15:00.548441+0000","last_unstale":"2024-09-10T22:15:35.478635+0000","last_undegraded":"2024-09-10T22:15:35.478635+0000","last_fullsized":"2024-09-10T22:15:35.478635+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:58:06.186742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"78'11","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.117012+0000","last_change":"2024-09-10T22:15:35.483364+0000","last_active":"2024-09-10T22:16:34.117012+0000","last_peered":"2024-09-10T22:16:34.117012+0000","last_clean":"2024-09-10T22:16:34.117012+0000","last_became_active":"2024-09-10T22:15:35.482977+0000","last_became_peered":"2024-09-10T22:15:35.482977+0000","last_unstale":"2024-09-10T22:16:34.117012+0000","last_undegraded":"2024-09-10T22:16:34.117012+0000","last_fullsized":"2024-09-10T22:16:34.117012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:47:04.194354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,6],"acting":[1,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"78'34","reported_seq":273,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:54.559543+0000","last_change":"2024-09-10T22:15:00.342777+0000","last_active":"2024-09-10T22:16:54.559543+0000","last_peered":"2024-09-10T22:16:54.559543+0000","last_clean":"2024-09-10T22:16:54.559543+0000","last_became_active":"2024-09-10T22:15:00.342399+0000","last_became_peered":"2024-09-10T22:15:00.342399+0000","last_unstale":"2024-09-10T22:16:54.559543+0000","last_undegraded":"2024-09-10T22:16:54.559543+0000","last_fullsized":"2024-09-10T22:16:54.559543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:45.984175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66547,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":216,"num_read_kb":172,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.103602+0000","last_change":"2024-09-10T22:15:02.355735+0000","last_active":"2024-09-10T22:16:34.103602+0000","last_peered":"2024-09-10T22:16:34.103602+0000","last_clean":"2024-09-10T22:16:34.103602+0000","last_became_active":"2024-09-10T22:15:02.355131+0000","last_became_peered":"2024-09-10T22:15:02.355131+0000","last_unstale":"2024-09-10T22:16:34.103602+0000","last_undegraded":"2024-09-10T22:16:34.103602+0000","last_fullsized":"2024-09-10T22:16:34.103602+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:49.235407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'6","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479200+0000","last_change":"2024-09-10T22:15:00.338063+0000","last_active":"2024-09-10T22:15:35.479200+0000","last_peered":"2024-09-10T22:15:35.479200+0000","last_clean":"2024-09-10T22:15:35.479200+0000","last_became_active":"2024-09-10T22:15:00.337713+0000","last_became_peered":"2024-09-10T22:15:00.337713+0000","last_unstale":"2024-09-10T22:15:35.479200+0000","last_undegraded":"2024-09-10T22:15:35.479200+0000","last_fullsized":"2024-09-10T22:15:35.479200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:01:59.076115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116607+0000","last_change":"2024-09-10T22:15:02.357684+0000","last_active":"2024-09-10T22:16:34.116607+0000","last_peered":"2024-09-10T22:16:34.116607+0000","last_clean":"2024-09-10T22:16:34.116607+0000","last_became_active":"2024-09-10T22:15:02.357392+0000","last_became_peered":"2024-09-10T22:15:02.357392+0000","last_unstale":"2024-09-10T22:16:34.116607+0000","last_undegraded":"2024-09-10T22:16:34.116607+0000","last_fullsized":"2024-09-10T22:16:34.116607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:28.894361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479052+0000","last_change":"2024-09-10T22:15:00.342881+0000","last_active":"2024-09-10T22:15:35.479052+0000","last_peered":"2024-09-10T22:15:35.479052+0000","last_clean":"2024-09-10T22:15:35.479052+0000","last_became_active":"2024-09-10T22:15:00.342522+0000","last_became_peered":"2024-09-10T22:15:00.342522+0000","last_unstale":"2024-09-10T22:15:35.479052+0000","last_undegraded":"2024-09-10T22:15:35.479052+0000","last_fullsized":"2024-09-10T22:15:35.479052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:47.102313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.122615+0000","last_change":"2024-09-10T22:15:02.363277+0000","last_active":"2024-09-10T22:16:34.122615+0000","last_peered":"2024-09-10T22:16:34.122615+0000","last_clean":"2024-09-10T22:16:34.122615+0000","last_became_active":"2024-09-10T22:15:02.362894+0000","last_became_peered":"2024-09-10T22:15:02.362894+0000","last_unstale":"2024-09-10T22:16:34.122615+0000","last_undegraded":"2024-09-10T22:16:34.122615+0000","last_fullsized":"2024-09-10T22:16:34.122615+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:43:59.919636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'3","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:49.550022+0000","last_change":"2024-09-10T22:15:00.336459+0000","last_active":"2024-09-10T22:16:49.550022+0000","last_peered":"2024-09-10T22:16:49.550022+0000","last_clean":"2024-09-10T22:16:49.550022+0000","last_became_active":"2024-09-10T22:15:00.336024+0000","last_became_peered":"2024-09-10T22:15:00.336024+0000","last_unstale":"2024-09-10T22:16:49.550022+0000","last_undegraded":"2024-09-10T22:16:49.550022+0000","last_fullsized":"2024-09-10T22:16:49.550022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:25:51.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125079+0000","last_change":"2024-09-10T22:15:02.362241+0000","last_active":"2024-09-10T22:16:34.125079+0000","last_peered":"2024-09-10T22:16:34.125079+0000","last_clean":"2024-09-10T22:16:34.125079+0000","last_became_active":"2024-09-10T22:15:02.361905+0000","last_became_peered":"2024-09-10T22:15:02.361905+0000","last_unstale":"2024-09-10T22:16:34.125079+0000","last_undegraded":"2024-09-10T22:16:34.125079+0000","last_fullsized":"2024-09-10T22:16:34.125079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:09.226288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'15","reported_seq":39,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.480414+0000","last_change":"2024-09-10T22:15:00.548373+0000","last_active":"2024-09-10T22:15:35.480414+0000","last_peered":"2024-09-10T22:15:35.480414+0000","last_clean":"2024-09-10T22:15:35.480414+0000","last_became_active":"2024-09-10T22:15:00.547984+0000","last_became_peered":"2024-09-10T22:15:00.547984+0000","last_unstale":"2024-09-10T22:15:35.480414+0000","last_undegraded":"2024-09-10T22:15:35.480414+0000","last_fullsized":"2024-09-10T22:15:35.480414+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:44:54.915479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115009+0000","last_change":"2024-09-10T22:15:02.365122+0000","last_active":"2024-09-10T22:16:34.115009+0000","last_peered":"2024-09-10T22:16:34.115009+0000","last_clean":"2024-09-10T22:16:34.115009+0000","last_became_active":"2024-09-10T22:15:02.364666+0000","last_became_peered":"2024-09-10T22:15:02.364666+0000","last_unstale":"2024-09-10T22:16:34.115009+0000","last_undegraded":"2024-09-10T22:16:34.115009+0000","last_fullsized":"2024-09-10T22:16:34.115009+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:56:51.036434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481875+0000","last_change":"2024-09-10T22:15:00.341197+0000","last_active":"2024-09-10T22:15:35.481875+0000","last_peered":"2024-09-10T22:15:35.481875+0000","last_clean":"2024-09-10T22:15:35.481875+0000","last_became_active":"2024-09-10T22:15:00.340818+0000","last_became_peered":"2024-09-10T22:15:00.340818+0000","last_unstale":"2024-09-10T22:15:35.481875+0000","last_undegraded":"2024-09-10T22:15:35.481875+0000","last_fullsized":"2024-09-10T22:15:35.481875+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:52.065582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106972+0000","last_change":"2024-09-10T22:15:02.363910+0000","last_active":"2024-09-10T22:16:34.106972+0000","last_peered":"2024-09-10T22:16:34.106972+0000","last_clean":"2024-09-10T22:16:34.106972+0000","last_became_active":"2024-09-10T22:15:02.363528+0000","last_became_peered":"2024-09-10T22:15:02.363528+0000","last_unstale":"2024-09-10T22:16:34.106972+0000","last_undegraded":"2024-09-10T22:16:34.106972+0000","last_fullsized":"2024-09-10T22:16:34.106972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:48:43.338511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477187+0000","last_change":"2024-09-10T22:15:00.337046+0000","last_active":"2024-09-10T22:15:35.477187+0000","last_peered":"2024-09-10T22:15:35.477187+0000","last_clean":"2024-09-10T22:15:35.477187+0000","last_became_active":"2024-09-10T22:15:00.336706+0000","last_became_peered":"2024-09-10T22:15:00.336706+0000","last_unstale":"2024-09-10T22:15:35.477187+0000","last_undegraded":"2024-09-10T22:15:35.477187+0000","last_fullsized":"2024-09-10T22:15:35.477187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:47:39.764759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.124665+0000","last_change":"2024-09-10T22:15:02.355267+0000","last_active":"2024-09-10T22:16:34.124665+0000","last_peered":"2024-09-10T22:16:34.124665+0000","last_clean":"2024-09-10T22:16:34.124665+0000","last_became_active":"2024-09-10T22:15:02.354878+0000","last_became_peered":"2024-09-10T22:15:02.354878+0000","last_unstale":"2024-09-10T22:16:34.124665+0000","last_undegraded":"2024-09-10T22:16:34.124665+0000","last_fullsized":"2024-09-10T22:16:34.124665+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:11:27.802819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'1","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.478753+0000","last_change":"2024-09-10T22:15:00.339129+0000","last_active":"2024-09-10T22:15:35.478753+0000","last_peered":"2024-09-10T22:15:35.478753+0000","last_clean":"2024-09-10T22:15:35.478753+0000","last_became_active":"2024-09-10T22:15:00.338738+0000","last_became_peered":"2024-09-10T22:15:00.338738+0000","last_unstale":"2024-09-10T22:15:35.478753+0000","last_undegraded":"2024-09-10T22:15:35.478753+0000","last_fullsized":"2024-09-10T22:15:35.478753+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:41.408922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.113650+0000","last_change":"2024-09-10T22:15:02.361013+0000","last_active":"2024-09-10T22:16:34.113650+0000","last_peered":"2024-09-10T22:16:34.113650+0000","last_clean":"2024-09-10T22:16:34.113650+0000","last_became_active":"2024-09-10T22:15:02.360655+0000","last_became_peered":"2024-09-10T22:15:02.360655+0000","last_unstale":"2024-09-10T22:16:34.113650+0000","last_undegraded":"2024-09-10T22:16:34.113650+0000","last_fullsized":"2024-09-10T22:16:34.113650+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:11:04.944994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'3","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479310+0000","last_change":"2024-09-10T22:15:00.982900+0000","last_active":"2024-09-10T22:15:35.479310+0000","last_peered":"2024-09-10T22:15:35.479310+0000","last_clean":"2024-09-10T22:15:35.479310+0000","last_became_active":"2024-09-10T22:15:00.982487+0000","last_became_peered":"2024-09-10T22:15:00.982487+0000","last_unstale":"2024-09-10T22:15:35.479310+0000","last_undegraded":"2024-09-10T22:15:35.479310+0000","last_fullsized":"2024-09-10T22:15:35.479310+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:55:02.857384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.123326+0000","last_change":"2024-09-10T22:15:02.356696+0000","last_active":"2024-09-10T22:16:34.123326+0000","last_peered":"2024-09-10T22:16:34.123326+0000","last_clean":"2024-09-10T22:16:34.123326+0000","last_became_active":"2024-09-10T22:15:02.356372+0000","last_became_peered":"2024-09-10T22:15:02.356372+0000","last_unstale":"2024-09-10T22:16:34.123326+0000","last_undegraded":"2024-09-10T22:16:34.123326+0000","last_fullsized":"2024-09-10T22:16:34.123326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:56:18.531269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847758+0000","last_change":"2024-09-10T22:13:46.704396+0000","last_active":"2024-09-10T22:15:36.847758+0000","last_peered":"2024-09-10T22:15:36.847758+0000","last_clean":"2024-09-10T22:15:36.847758+0000","last_became_active":"2024-09-10T22:13:46.699187+0000","last_became_peered":"2024-09-10T22:13:46.699187+0000","last_unstale":"2024-09-10T22:15:36.847758+0000","last_undegraded":"2024-09-10T22:15:36.847758+0000","last_fullsized":"2024-09-10T22:15:36.847758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:10:20.323492+0000","last_clean_scrub_stamp":"2024-09-10T22:10:20.323492+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:50:46.095298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'3","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477570+0000","last_change":"2024-09-10T22:15:00.337439+0000","last_active":"2024-09-10T22:15:35.477570+0000","last_peered":"2024-09-10T22:15:35.477570+0000","last_clean":"2024-09-10T22:15:35.477570+0000","last_became_active":"2024-09-10T22:15:00.337038+0000","last_became_peered":"2024-09-10T22:15:00.337038+0000","last_unstale":"2024-09-10T22:15:35.477570+0000","last_undegraded":"2024-09-10T22:15:35.477570+0000","last_fullsized":"2024-09-10T22:15:35.477570+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:32:39.800586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108644+0000","last_change":"2024-09-10T22:15:02.362232+0000","last_active":"2024-09-10T22:16:34.108644+0000","last_peered":"2024-09-10T22:16:34.108644+0000","last_clean":"2024-09-10T22:16:34.108644+0000","last_became_active":"2024-09-10T22:15:02.361920+0000","last_became_peered":"2024-09-10T22:15:02.361920+0000","last_unstale":"2024-09-10T22:16:34.108644+0000","last_undegraded":"2024-09-10T22:16:34.108644+0000","last_fullsized":"2024-09-10T22:16:34.108644+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:05.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847681+0000","last_change":"2024-09-10T22:15:00.340188+0000","last_active":"2024-09-10T22:15:36.847681+0000","last_peered":"2024-09-10T22:15:36.847681+0000","last_clean":"2024-09-10T22:15:36.847681+0000","last_became_active":"2024-09-10T22:15:00.339684+0000","last_became_peered":"2024-09-10T22:15:00.339684+0000","last_unstale":"2024-09-10T22:15:36.847681+0000","last_undegraded":"2024-09-10T22:15:36.847681+0000","last_fullsized":"2024-09-10T22:15:36.847681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:08:39.131569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.113287+0000","last_change":"2024-09-10T22:15:02.364235+0000","last_active":"2024-09-10T22:16:34.113287+0000","last_peered":"2024-09-10T22:16:34.113287+0000","last_clean":"2024-09-10T22:16:34.113287+0000","last_became_active":"2024-09-10T22:15:02.363971+0000","last_became_peered":"2024-09-10T22:15:02.363971+0000","last_unstale":"2024-09-10T22:16:34.113287+0000","last_undegraded":"2024-09-10T22:16:34.113287+0000","last_fullsized":"2024-09-10T22:16:34.113287+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:34.642564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'4","reported_seq":127,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:51.552453+0000","last_change":"2024-09-10T22:15:00.548217+0000","last_active":"2024-09-10T22:16:51.552453+0000","last_peered":"2024-09-10T22:16:51.552453+0000","last_clean":"2024-09-10T22:16:51.552453+0000","last_became_active":"2024-09-10T22:15:00.547876+0000","last_became_peered":"2024-09-10T22:15:00.547876+0000","last_unstale":"2024-09-10T22:16:51.552453+0000","last_undegraded":"2024-09-10T22:16:51.552453+0000","last_fullsized":"2024-09-10T22:16:51.552453+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:11:55.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115051+0000","last_change":"2024-09-10T22:15:02.363359+0000","last_active":"2024-09-10T22:16:34.115051+0000","last_peered":"2024-09-10T22:16:34.115051+0000","last_clean":"2024-09-10T22:16:34.115051+0000","last_became_active":"2024-09-10T22:15:02.362995+0000","last_became_peered":"2024-09-10T22:15:02.362995+0000","last_unstale":"2024-09-10T22:16:34.115051+0000","last_undegraded":"2024-09-10T22:16:34.115051+0000","last_fullsized":"2024-09-10T22:16:34.115051+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:29:50.495597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.847841+0000","last_change":"2024-09-10T22:15:00.339814+0000","last_active":"2024-09-10T22:15:36.847841+0000","last_peered":"2024-09-10T22:15:36.847841+0000","last_clean":"2024-09-10T22:15:36.847841+0000","last_became_active":"2024-09-10T22:15:00.339414+0000","last_became_peered":"2024-09-10T22:15:00.339414+0000","last_unstale":"2024-09-10T22:15:36.847841+0000","last_undegraded":"2024-09-10T22:15:36.847841+0000","last_fullsized":"2024-09-10T22:15:36.847841+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:05.137157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"78'7","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.097523+0000","last_change":"2024-09-10T22:15:35.484767+0000","last_active":"2024-09-10T22:16:34.097523+0000","last_peered":"2024-09-10T22:16:34.097523+0000","last_clean":"2024-09-10T22:16:34.097523+0000","last_became_active":"2024-09-10T22:15:35.484427+0000","last_became_peered":"2024-09-10T22:15:35.484427+0000","last_unstale":"2024-09-10T22:16:34.097523+0000","last_undegraded":"2024-09-10T22:16:34.097523+0000","last_fullsized":"2024-09-10T22:16:34.097523+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:28:35.528602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483370+0000","last_change":"2024-09-10T22:15:00.551322+0000","last_active":"2024-09-10T22:15:35.483370+0000","last_peered":"2024-09-10T22:15:35.483370+0000","last_clean":"2024-09-10T22:15:35.483370+0000","last_became_active":"2024-09-10T22:15:00.551056+0000","last_became_peered":"2024-09-10T22:15:00.551056+0000","last_unstale":"2024-09-10T22:15:35.483370+0000","last_undegraded":"2024-09-10T22:15:35.483370+0000","last_fullsized":"2024-09-10T22:15:35.483370+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:43:49.296139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.105653+0000","last_change":"2024-09-10T22:15:02.353645+0000","last_active":"2024-09-10T22:16:34.105653+0000","last_peered":"2024-09-10T22:16:34.105653+0000","last_clean":"2024-09-10T22:16:34.105653+0000","last_became_active":"2024-09-10T22:15:02.353108+0000","last_became_peered":"2024-09-10T22:15:02.353108+0000","last_unstale":"2024-09-10T22:16:34.105653+0000","last_undegraded":"2024-09-10T22:16:34.105653+0000","last_fullsized":"2024-09-10T22:16:34.105653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:42:38.151302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.489459+0000","last_change":"2024-09-10T22:15:35.488995+0000","last_active":"2024-09-10T22:15:35.489459+0000","last_peered":"2024-09-10T22:15:35.489459+0000","last_clean":"2024-09-10T22:15:35.489459+0000","last_became_active":"2024-09-10T22:15:35.484278+0000","last_became_peered":"2024-09-10T22:15:35.484278+0000","last_unstale":"2024-09-10T22:15:35.489459+0000","last_undegraded":"2024-09-10T22:15:35.489459+0000","last_fullsized":"2024-09-10T22:15:35.489459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:13:00.474920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.115090+0000","last_change":"2024-09-10T22:15:02.352110+0000","last_active":"2024-09-10T22:16:34.115090+0000","last_peered":"2024-09-10T22:16:34.115090+0000","last_clean":"2024-09-10T22:16:34.115090+0000","last_became_active":"2024-09-10T22:15:02.349559+0000","last_became_peered":"2024-09-10T22:15:02.349559+0000","last_unstale":"2024-09-10T22:16:34.115090+0000","last_undegraded":"2024-09-10T22:16:34.115090+0000","last_fullsized":"2024-09-10T22:16:34.115090+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:30:14.340304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'14","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.360626+0000","last_change":"2024-09-10T22:15:00.338244+0000","last_active":"2024-09-10T22:16:34.360626+0000","last_peered":"2024-09-10T22:16:34.360626+0000","last_clean":"2024-09-10T22:16:34.360626+0000","last_became_active":"2024-09-10T22:15:00.337904+0000","last_became_peered":"2024-09-10T22:15:00.337904+0000","last_unstale":"2024-09-10T22:16:34.360626+0000","last_undegraded":"2024-09-10T22:16:34.360626+0000","last_fullsized":"2024-09-10T22:16:34.360626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:42.649085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.112824+0000","last_change":"2024-09-10T22:15:02.353853+0000","last_active":"2024-09-10T22:16:34.112824+0000","last_peered":"2024-09-10T22:16:34.112824+0000","last_clean":"2024-09-10T22:16:34.112824+0000","last_became_active":"2024-09-10T22:15:02.353544+0000","last_became_peered":"2024-09-10T22:15:02.353544+0000","last_unstale":"2024-09-10T22:16:34.112824+0000","last_undegraded":"2024-09-10T22:16:34.112824+0000","last_fullsized":"2024-09-10T22:16:34.112824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:58.395638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.477897+0000","last_change":"2024-09-10T22:15:00.983199+0000","last_active":"2024-09-10T22:15:35.477897+0000","last_peered":"2024-09-10T22:15:35.477897+0000","last_clean":"2024-09-10T22:15:35.477897+0000","last_became_active":"2024-09-10T22:15:00.982808+0000","last_became_peered":"2024-09-10T22:15:00.982808+0000","last_unstale":"2024-09-10T22:15:35.477897+0000","last_undegraded":"2024-09-10T22:15:35.477897+0000","last_fullsized":"2024-09-10T22:15:35.477897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:57.482436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"78'7","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.125327+0000","last_change":"2024-09-10T22:15:02.363627+0000","last_active":"2024-09-10T22:16:34.125327+0000","last_peered":"2024-09-10T22:16:34.125327+0000","last_clean":"2024-09-10T22:16:34.125327+0000","last_became_active":"2024-09-10T22:15:02.363321+0000","last_became_peered":"2024-09-10T22:15:02.363321+0000","last_unstale":"2024-09-10T22:16:34.125327+0000","last_undegraded":"2024-09-10T22:16:34.125327+0000","last_fullsized":"2024-09-10T22:16:34.125327+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:45:52.112718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":36,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.486805+0000","last_change":"2024-09-10T22:15:35.486730+0000","last_active":"2024-09-10T22:15:35.486805+0000","last_peered":"2024-09-10T22:15:35.486805+0000","last_clean":"2024-09-10T22:15:35.486805+0000","last_became_active":"2024-09-10T22:15:35.483148+0000","last_became_peered":"2024-09-10T22:15:35.483148+0000","last_unstale":"2024-09-10T22:15:35.486805+0000","last_undegraded":"2024-09-10T22:15:35.486805+0000","last_fullsized":"2024-09-10T22:15:35.486805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:47:10.166666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"78'2","reported_seq":20,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.076070+0000","last_change":"2024-09-10T22:15:02.358193+0000","last_active":"2024-09-10T22:16:34.076070+0000","last_peered":"2024-09-10T22:16:34.076070+0000","last_clean":"2024-09-10T22:16:34.076070+0000","last_became_active":"2024-09-10T22:15:02.357312+0000","last_became_peered":"2024-09-10T22:15:02.357312+0000","last_unstale":"2024-09-10T22:16:34.076070+0000","last_undegraded":"2024-09-10T22:16:34.076070+0000","last_fullsized":"2024-09-10T22:16:34.076070+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:54.842837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'3","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.102639+0000","last_change":"2024-09-10T22:15:00.337006+0000","last_active":"2024-09-10T22:15:36.102639+0000","last_peered":"2024-09-10T22:15:36.102639+0000","last_clean":"2024-09-10T22:15:36.102639+0000","last_became_active":"2024-09-10T22:15:00.336565+0000","last_became_peered":"2024-09-10T22:15:00.336565+0000","last_unstale":"2024-09-10T22:15:36.102639+0000","last_undegraded":"2024-09-10T22:15:36.102639+0000","last_fullsized":"2024-09-10T22:15:36.102639+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:39:57.462447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.108112+0000","last_change":"2024-09-10T22:15:02.354730+0000","last_active":"2024-09-10T22:16:34.108112+0000","last_peered":"2024-09-10T22:16:34.108112+0000","last_clean":"2024-09-10T22:16:34.108112+0000","last_became_active":"2024-09-10T22:15:02.354409+0000","last_became_peered":"2024-09-10T22:15:02.354409+0000","last_unstale":"2024-09-10T22:16:34.108112+0000","last_undegraded":"2024-09-10T22:16:34.108112+0000","last_fullsized":"2024-09-10T22:16:34.108112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:25:52.505933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'1","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.479161+0000","last_change":"2024-09-10T22:15:00.339513+0000","last_active":"2024-09-10T22:15:35.479161+0000","last_peered":"2024-09-10T22:15:35.479161+0000","last_clean":"2024-09-10T22:15:35.479161+0000","last_became_active":"2024-09-10T22:15:00.338259+0000","last_became_peered":"2024-09-10T22:15:00.338259+0000","last_unstale":"2024-09-10T22:15:35.479161+0000","last_undegraded":"2024-09-10T22:15:35.479161+0000","last_fullsized":"2024-09-10T22:15:35.479161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:25:26.178518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"78'8","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.119857+0000","last_change":"2024-09-10T22:15:02.359775+0000","last_active":"2024-09-10T22:16:34.119857+0000","last_peered":"2024-09-10T22:16:34.119857+0000","last_clean":"2024-09-10T22:16:34.119857+0000","last_became_active":"2024-09-10T22:15:02.359490+0000","last_became_peered":"2024-09-10T22:15:02.359490+0000","last_unstale":"2024-09-10T22:16:34.119857+0000","last_undegraded":"2024-09-10T22:16:34.119857+0000","last_fullsized":"2024-09-10T22:16:34.119857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:49:56.095068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481286+0000","last_change":"2024-09-10T22:15:00.342807+0000","last_active":"2024-09-10T22:15:35.481286+0000","last_peered":"2024-09-10T22:15:35.481286+0000","last_clean":"2024-09-10T22:15:35.481286+0000","last_became_active":"2024-09-10T22:15:00.342450+0000","last_became_peered":"2024-09-10T22:15:00.342450+0000","last_unstale":"2024-09-10T22:15:35.481286+0000","last_undegraded":"2024-09-10T22:15:35.481286+0000","last_fullsized":"2024-09-10T22:15:35.481286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:17.519331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.121766+0000","last_change":"2024-09-10T22:15:02.359894+0000","last_active":"2024-09-10T22:16:34.121766+0000","last_peered":"2024-09-10T22:16:34.121766+0000","last_clean":"2024-09-10T22:16:34.121766+0000","last_became_active":"2024-09-10T22:15:02.359395+0000","last_became_peered":"2024-09-10T22:15:02.359395+0000","last_unstale":"2024-09-10T22:16:34.121766+0000","last_undegraded":"2024-09-10T22:16:34.121766+0000","last_fullsized":"2024-09-10T22:16:34.121766+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:00:31.318353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"78'15","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116042+0000","last_change":"2024-09-10T22:15:02.358931+0000","last_active":"2024-09-10T22:16:34.116042+0000","last_peered":"2024-09-10T22:16:34.116042+0000","last_clean":"2024-09-10T22:16:34.116042+0000","last_became_active":"2024-09-10T22:15:02.358615+0000","last_became_peered":"2024-09-10T22:15:02.358615+0000","last_unstale":"2024-09-10T22:16:34.116042+0000","last_undegraded":"2024-09-10T22:16:34.116042+0000","last_fullsized":"2024-09-10T22:16:34.116042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:34:29.447757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.482561+0000","last_change":"2024-09-10T22:15:00.341480+0000","last_active":"2024-09-10T22:15:35.482561+0000","last_peered":"2024-09-10T22:15:35.482561+0000","last_clean":"2024-09-10T22:15:35.482561+0000","last_became_active":"2024-09-10T22:15:00.341124+0000","last_became_peered":"2024-09-10T22:15:00.341124+0000","last_unstale":"2024-09-10T22:15:35.482561+0000","last_undegraded":"2024-09-10T22:15:35.482561+0000","last_fullsized":"2024-09-10T22:15:35.482561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:07:54.165485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"78'9","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.116358+0000","last_change":"2024-09-10T22:15:02.361158+0000","last_active":"2024-09-10T22:16:34.116358+0000","last_peered":"2024-09-10T22:16:34.116358+0000","last_clean":"2024-09-10T22:16:34.116358+0000","last_became_active":"2024-09-10T22:15:02.360802+0000","last_became_peered":"2024-09-10T22:15:02.360802+0000","last_unstale":"2024-09-10T22:16:34.116358+0000","last_undegraded":"2024-09-10T22:16:34.116358+0000","last_fullsized":"2024-09-10T22:16:34.116358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:28:02.629953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'4","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.481854+0000","last_change":"2024-09-10T22:15:00.343437+0000","last_active":"2024-09-10T22:15:35.481854+0000","last_peered":"2024-09-10T22:15:35.481854+0000","last_clean":"2024-09-10T22:15:35.481854+0000","last_became_active":"2024-09-10T22:15:00.342362+0000","last_became_peered":"2024-09-10T22:15:00.342362+0000","last_unstale":"2024-09-10T22:15:35.481854+0000","last_undegraded":"2024-09-10T22:15:35.481854+0000","last_fullsized":"2024-09-10T22:15:35.481854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:17:22.850731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"78'6","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.120912+0000","last_change":"2024-09-10T22:15:02.356682+0000","last_active":"2024-09-10T22:16:34.120912+0000","last_peered":"2024-09-10T22:16:34.120912+0000","last_clean":"2024-09-10T22:16:34.120912+0000","last_became_active":"2024-09-10T22:15:02.356313+0000","last_became_peered":"2024-09-10T22:15:02.356313+0000","last_unstale":"2024-09-10T22:16:34.120912+0000","last_undegraded":"2024-09-10T22:16:34.120912+0000","last_fullsized":"2024-09-10T22:16:34.120912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:47:55.047268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":25,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:36.103492+0000","last_change":"2024-09-10T22:15:00.548246+0000","last_active":"2024-09-10T22:15:36.103492+0000","last_peered":"2024-09-10T22:15:36.103492+0000","last_clean":"2024-09-10T22:15:36.103492+0000","last_became_active":"2024-09-10T22:15:00.547787+0000","last_became_peered":"2024-09-10T22:15:00.547787+0000","last_unstale":"2024-09-10T22:15:36.103492+0000","last_undegraded":"2024-09-10T22:15:36.103492+0000","last_fullsized":"2024-09-10T22:15:36.103492+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:03.438800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"78'5","reported_seq":23,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:16:34.106001+0000","last_change":"2024-09-10T22:15:02.359304+0000","last_active":"2024-09-10T22:16:34.106001+0000","last_peered":"2024-09-10T22:16:34.106001+0000","last_clean":"2024-09-10T22:16:34.106001+0000","last_became_active":"2024-09-10T22:15:02.358987+0000","last_became_peered":"2024-09-10T22:15:02.358987+0000","last_unstale":"2024-09-10T22:16:34.106001+0000","last_undegraded":"2024-09-10T22:16:34.106001+0000","last_fullsized":"2024-09-10T22:16:34.106001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:15:01.327146+0000","last_clean_scrub_stamp":"2024-09-10T22:15:01.327146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:24.470202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'9","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-10T22:15:35.483426+0000","last_change":"2024-09-10T22:15:00.342581+0000","last_active":"2024-09-10T22:15:35.483426+0000","last_peered":"2024-09-10T22:15:35.483426+0000","last_clean":"2024-09-10T22:15:35.483426+0000","last_became_active":"2024-09-10T22:15:00.342345+0000","last_became_peered":"2024-09-10T22:15:00.342345+0000","last_unstale":"2024-09-10T22:15:35.483426+0000","last_undegraded":"2024-09-10T22:15:35.483426+0000","last_fullsized":"2024-09-10T22:15:35.483426+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T22:14:59.314859+0000","last_clean_scrub_stamp":"2024-09-10T22:14:59.314859+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:53.993024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70689,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":638,"num_read_kb":393,"num_write":176,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":206694,"data_compressed":5442,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282721,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":843776,"data_stored":408651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906986,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":1066657,"data_compressed":37762,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070510,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":856064,"data_stored":408865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266739,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":851968,"data_stored":408763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36228,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708924,"statfs":{"total":95995035648,"available":95957938176,"internally_reserved":0,"allocated":905216,"data_stored":1000856,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":843776,"data_stored":408254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":1000540,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":847872,"data_stored":408691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":408565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":933888,"data_stored":476476,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":468913,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":864256,"data_stored":409525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34327,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":61174,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68429,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68125,"data_compressed":1814,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T22:16:56.010 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:16:56.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:55 smithi189 ceph-mon[35784]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:56.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:55 smithi052 ceph-mon[34997]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:56.299 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:56.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 -- 172.21.15.5:0/1256739366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178107e80 msgr2=0x7f517810e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 --2- 172.21.15.5:0/1256739366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178107e80 0x7f517810e680 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5170009ca0 tx=0x7f517002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 -- 172.21.15.5:0/1256739366 shutdown_connections 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 --2- 172.21.15.5:0/1256739366 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178107e80 0x7f517810e680 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 --2- 172.21.15.5:0/1256739366 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5178107500 0x7f5178107940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 --2- 172.21.15.5:0/1256739366 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178101af0 0x7f5178101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 -- 172.21.15.5:0/1256739366 >> 172.21.15.5:0/1256739366 conn(0x7f51780fd560 msgr2=0x7f51780ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 -- 172.21.15.5:0/1256739366 shutdown_connections 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.769+0000 7f517d9a1640 1 -- 172.21.15.5:0/1256739366 wait complete. 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 Processor -- start 2024-09-10T22:16:56.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 -- start start 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 0x7f5178199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5178107500 0x7f517819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178107e80 0x7f517819a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f5178111b40 con 0x7f5178101af0 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f51781119c0 con 0x7f5178107e80 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517d9a1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f5178111cc0 con 0x7f5178107500 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.770+0000 7f517c99f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 0x7f5178199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 0x7f5178199d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39406/0 (socket says 172.21.15.5:39406) 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 -- 172.21.15.5:0/4258754876 learned_addr learned my addr 172.21.15.5:0/4258754876 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f5177fff640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5178107500 0x7f517819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517d1a0640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178107e80 0x7f517819a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 -- 172.21.15.5:0/4258754876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5178107500 msgr2=0x7f517819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:56.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5178107500 0x7f517819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 -- 172.21.15.5:0/4258754876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178107e80 msgr2=0x7f517819a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178107e80 0x7f517819a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 -- 172.21.15.5:0/4258754876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51781a5190 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517d1a0640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178107e80 0x7f517819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517c99f640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 0x7f5178199d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c890 tx=0x7f516c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c004220 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f516c0043c0 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51781a5480 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.771+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f516c004a00 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.772+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51781a59c0 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.773+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5178101ed0 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.774+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f516c0079b0 con 0x7f5178101af0 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.775+0000 7f5175ffb640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f51680b5390 0x7f51680b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:56.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.775+0000 7f5177fff640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f51680b5390 0x7f51680b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.775+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f516c0e5940 con 0x7f5178101af0 2024-09-10T22:16:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.775+0000 7f5177fff640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f51680b5390 0x7f51680b7850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f517806bef0 tx=0x7f516400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:56.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:56.779+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f516c014030 con 0x7f5178101af0 2024-09-10T22:16:57.006 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.004+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51781a5c80 con 0x7f5178101af0 2024-09-10T22:16:57.007 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:56 smithi005 ceph-mon[31115]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:57.007 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:56 smithi005 ceph-mon[31115]: pgmap v349: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:16:57.007 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:56 smithi005 ceph-mon[31115]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:57.007 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.005+0000 7f5175ffb640 1 -- 172.21.15.5:0/4258754876 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f516c0ac830 con 0x7f5178101af0 2024-09-10T22:16:57.008 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:57.008 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:16:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:16:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f51680b5390 msgr2=0x7f51680b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f51680b5390 0x7f51680b7850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f517806bef0 tx=0x7f516400b390 comp rx=0 tx=0).stop 2024-09-10T22:16:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 msgr2=0x7f5178199d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 0x7f5178199d90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c890 tx=0x7f516c00cd50 comp rx=0 tx=0).stop 2024-09-10T22:16:57.009 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 shutdown_connections 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f51680b5390 0x7f51680b7850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5178107e80 0x7f517819a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5178107500 0x7f517819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 --2- 172.21.15.5:0/4258754876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5178101af0 0x7f5178199d90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 >> 172.21.15.5:0/4258754876 conn(0x7f51780fd560 msgr2=0x7f5178100a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 shutdown_connections 2024-09-10T22:16:57.010 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:57.007+0000 7f517d9a1640 1 -- 172.21.15.5:0/4258754876 wait complete. 2024-09-10T22:16:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:56 smithi189 ceph-mon[35784]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:56 smithi189 ceph-mon[35784]: pgmap v349: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:16:57.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:56 smithi189 ceph-mon[35784]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:57.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:56 smithi052 ceph-mon[34997]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:56 smithi052 ceph-mon[34997]: pgmap v349: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:16:57.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:56 smithi052 ceph-mon[34997]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-10T22:16:57.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:16:58.079 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:16:58.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:57 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/4258754876' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:58.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:57 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/4258754876' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:58.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:57 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/4258754876' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:16:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 -- 172.21.15.5:0/2426759951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec1087d0 msgr2=0x7f07ec108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/2426759951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec1087d0 0x7f07ec108c10 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f07d4009900 tx=0x7f07d402a410 comp rx=0 tx=0).stop 2024-09-10T22:16:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 -- 172.21.15.5:0/2426759951 shutdown_connections 2024-09-10T22:16:58.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/2426759951 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec109150 0x7f07ec10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/2426759951 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec1087d0 0x7f07ec108c10 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/2426759951 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec102dc0 0x7f07ec1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 -- 172.21.15.5:0/2426759951 >> 172.21.15.5:0/2426759951 conn(0x7f07ec0fe830 msgr2=0x7f07ec100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 -- 172.21.15.5:0/2426759951 shutdown_connections 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.553+0000 7f07f2bfb640 1 -- 172.21.15.5:0/2426759951 wait complete. 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 Processor -- start 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 -- start start 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 0x7f07ec0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec1087d0 0x7f07ec0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec109150 0x7f07ec075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec112df0 con 0x7f07ec102dc0 2024-09-10T22:16:58.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec112c70 con 0x7f07ec1087d0 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f2bfb640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec112f70 con 0x7f07ec109150 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 0x7f07ec0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 0x7f07ec0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39424/0 (socket says 172.21.15.5:39424) 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 -- 172.21.15.5:0/186580987 learned_addr learned my addr 172.21.15.5:0/186580987 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07ebfff640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec1087d0 0x7f07ec0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f1198640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec109150 0x7f07ec075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 -- 172.21.15.5:0/186580987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec109150 msgr2=0x7f07ec075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec109150 0x7f07ec075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 -- 172.21.15.5:0/186580987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec1087d0 msgr2=0x7f07ec0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec1087d0 0x7f07ec0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.554+0000 7f07f0997640 1 -- 172.21.15.5:0/186580987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec1a7660 con 0x7f07ec102dc0 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.555+0000 7f07f0997640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 0x7f07ec0754a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00d950 tx=0x7f07dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:58.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.555+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc017070 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.555+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07ec1a7950 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.555+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07dc009c30 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.555+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00f620 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.555+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07ec1a7eb0 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.556+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07ec1031a0 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.557+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f07dc010460 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.558+0000 7f07e9ffb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f07d80b5360 0x7f07d80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.558+0000 7f07ebfff640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f07d80b5360 0x7f07d80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.558+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f07dc0e5740 con 0x7f07ec102dc0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.559+0000 7f07ebfff640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f07d80b5360 0x7f07d80b7820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07d4005ab0 tx=0x7f07d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:16:58.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.563+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07dc009de0 con 0x7f07ec102dc0 2024-09-10T22:16:58.752 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.750+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07ec1a8290 con 0x7f07ec102dc0 2024-09-10T22:16:58.754 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.751+0000 7f07e9ffb640 1 -- 172.21.15.5:0/186580987 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7f07dc0abf80 con 0x7f07ec102dc0 2024-09-10T22:16:58.754 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:16:58.754 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:16:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f07d80b5360 msgr2=0x7f07d80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f07d80b5360 0x7f07d80b7820 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f07d4005ab0 tx=0x7f07d4005a20 comp rx=0 tx=0).stop 2024-09-10T22:16:58.756 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 msgr2=0x7f07ec0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 0x7f07ec0754a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00d950 tx=0x7f07dc00de10 comp rx=0 tx=0).stop 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 shutdown_connections 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f07d80b5360 0x7f07d80b7820 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f07ec109150 0x7f07ec075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f07ec1087d0 0x7f07ec0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 --2- 172.21.15.5:0/186580987 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f07ec102dc0 0x7f07ec0754a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 >> 172.21.15.5:0/186580987 conn(0x7f07ec0fe830 msgr2=0x7f07ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 shutdown_connections 2024-09-10T22:16:58.757 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:16:58.754+0000 7f07f2bfb640 1 -- 172.21.15.5:0/186580987 wait complete. 2024-09-10T22:16:59.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:58 smithi005 ceph-mon[31115]: pgmap v350: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:16:59.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:16:58 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/186580987' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:59.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:58 smithi189 ceph-mon[35784]: pgmap v350: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:16:59.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:16:58 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/186580987' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:59.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:58 smithi052 ceph-mon[34997]: pgmap v350: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:16:59.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:16:58 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/186580987' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:16:59.544 DEBUG:tasks.fwd_scrub:Yielding 2024-09-10T22:16:59.544 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-10T22:17:00.159 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:17:00.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-10T22:17:00.160 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-10T22:17:00.160 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:17:00.160 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:17:00.164 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T22:17:00.377 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:17:00.377 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T22:17:00.377 INFO:tasks.workunit:timeout=3h 2024-09-10T22:17:00.377 INFO:tasks.workunit:cleanup=True 2024-09-10T22:17:00.378 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-10 22:15:22.808041341 +0000 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-10 22:15:22.808041341 +0000 2024-09-10T22:17:00.396 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-10 22:16:50.452039546 +0000 2024-09-10T22:17:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-10 22:15:22.808041341 +0000 2024-09-10T22:17:00.397 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-10T22:17:00.397 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-10T22:17:00.442 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:00.472 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-10T22:17:00.529 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T22:17:00.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 -- 172.21.15.5:0/74337298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 msgr2=0x7f363c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 --2- 172.21.15.5:0/74337298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c107ae0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3630009900 tx=0x7f363002a3f0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 -- 172.21.15.5:0/74337298 shutdown_connections 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 --2- 172.21.15.5:0/74337298 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c108020 0x7f363c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 --2- 172.21.15.5:0/74337298 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c107ae0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 --2- 172.21.15.5:0/74337298 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c101c90 0x7f363c102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 -- 172.21.15.5:0/74337298 >> 172.21.15.5:0/74337298 conn(0x7f363c0fd700 msgr2=0x7f363c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 -- 172.21.15.5:0/74337298 shutdown_connections 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.930+0000 7f3642a3d640 1 -- 172.21.15.5:0/74337298 wait complete. 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 Processor -- start 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 -- start start 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c101c90 0x7f363c0fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c0fe140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c108020 0x7f363c0fe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f363c111ce0 con 0x7f363c1076a0 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f363c111b60 con 0x7f363c101c90 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f3642a3d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f363c111e60 con 0x7f363c108020 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.931+0000 7f363b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c0fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c0fe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39440/0 (socket says 172.21.15.5:39440) 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 -- 172.21.15.5:0/2637907910 learned_addr learned my addr 172.21.15.5:0/2637907910 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f3640fda640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c108020 0x7f363c0fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363bfff640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c101c90 0x7f363c0fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 -- 172.21.15.5:0/2637907910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c108020 msgr2=0x7f363c0fe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c108020 0x7f363c0fe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 -- 172.21.15.5:0/2637907910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c101c90 msgr2=0x7f363c0fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c101c90 0x7f363c0fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 -- 172.21.15.5:0/2637907910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363c1a76e0 con 0x7f363c1076a0 2024-09-10T22:17:00.953 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363bfff640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c101c90 0x7f363c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f363b7fe640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c0fe140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3630005940 tx=0x7f3630004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f36397fa640 1 -- 172.21.15.5:0/2637907910 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363003f030 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363c1a7970 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f36397fa640 1 -- 172.21.15.5:0/2637907910 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3630003aa0 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f36397fa640 1 -- 172.21.15.5:0/2637907910 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3630035070 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.932+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f363c1a7ea0 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.935+0000 7f36397fa640 1 -- 172.21.15.5:0/2637907910 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f363003bcc0 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f36397fa640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f36240b52e0 0x7f36240b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f363bfff640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f36240b52e0 0x7f36240b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f36397fa640 1 -- 172.21.15.5:0/2637907910 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f36301065a0 con 0x7f363c1076a0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 Processor -- start 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 -- start start 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f363bfff640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f36240b52e0 0x7f36240b77a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f362c009c20 tx=0x7f362c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:00.954 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e9062c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e912250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e914b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556d4e87ce60 con 0x556d4e912790 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556d4e86c290 con 0x556d4e906800 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.936+0000 7f3644e12740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556d4e8700a0 con 0x556d4e905ee0 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e914b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e914b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39452/0 (socket says 172.21.15.5:39452) 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 -- 172.21.15.5:0/2758576409 learned_addr learned my addr 172.21.15.5:0/2758576409 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f363bfff640 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e9062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f363b7fe640 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e912250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 -- 172.21.15.5:0/2758576409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 msgr2=0x556d4e9062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e9062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 -- 172.21.15.5:0/2758576409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 msgr2=0x556d4e912250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.955 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e912250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 -- 172.21.15.5:0/2758576409 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d4e5ca930 con 0x556d4e912790 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f3640fda640 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e914b80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3634007e70 tx=0x7f363400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d84b3acd05a575 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f36227fc640 1 -- 172.21.15.5:0/2758576409 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634010840 con 0x556d4e912790 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f36227fc640 1 -- 172.21.15.5:0/2758576409 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36340183f0 con 0x556d4e912790 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.937+0000 7f36227fc640 1 -- 172.21.15.5:0/2758576409 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36340175a0 con 0x556d4e912790 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 -- 172.21.15.5:0/2758576409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 msgr2=0x556d4e914b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e914b80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3634007e70 tx=0x7f363400f790 comp rx=0 tx=0).stop 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 -- 172.21.15.5:0/2758576409 shutdown_connections 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e914b80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e912250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 --2- 172.21.15.5:0/2758576409 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e9062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 -- 172.21.15.5:0/2758576409 >> 172.21.15.5:0/2758576409 conn(0x556d4e903d10 msgr2=0x556d4e904eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:00.956 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 -- 172.21.15.5:0/2758576409 shutdown_connections 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.938+0000 7f3644e12740 1 -- 172.21.15.5:0/2758576409 wait complete. 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 -- start start 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 Processor -- start 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e90fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e910160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556d4e6cd890 con 0x556d4e905ee0 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556d4e806d40 con 0x556d4e912790 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556d4e915440 con 0x556d4e906800 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3644e12740 10 client.0 _ll_register_callbacks cb 0x556d4e86ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f363bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f363bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39454/0 (socket says 172.21.15.5:39454) 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f363bfff640 1 -- 172.21.15.5:0/70492231 learned_addr learned my addr 172.21.15.5:0/70492231 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:00.957 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f3640fda640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e910160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.939+0000 7f363b7fe640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e90fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f363bfff640 1 -- 172.21.15.5:0/70492231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 msgr2=0x556d4e90fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f363bfff640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e90fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f363bfff640 1 -- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 msgr2=0x556d4e910160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f363bfff640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e910160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f363bfff640 1 -- 172.21.15.5:0/70492231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d4e91e7a0 con 0x556d4e905ee0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f363bfff640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90f6e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f362c012c30 tx=0x7f362c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc84f278868762 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f361b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f361b7fe640 1 -- 172.21.15.5:0/70492231 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c029640 con 0x556d4e905ee0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f361b7fe640 1 -- 172.21.15.5:0/70492231 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f362c0283e0 con 0x556d4e905ee0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36340183f0 con 0x556d4e905ee0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f361b7fe640 1 -- 172.21.15.5:0/70492231 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f362c0297e0 con 0x556d4e905ee0 2024-09-10T22:17:00.958 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f3644e12740 10 client.15351 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.940+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556d4e9211b0 con 0x556d4e905ee0 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f361b7fe640 1 -- 172.21.15.5:0/70492231 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36340183f0 con 0x556d4e905ee0 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f361b7fe640 1 -- 172.21.15.5:0/70492231 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f362c027070 con 0x556d4e905ee0 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f3644e12740 10 client.15351 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f3644e12740 10 client.15351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f3644e12740 20 client.15351 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f3644e12740 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e922710 0x556d4e924b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f3644e12740 4 client.15351 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d4e87edb0 con 0x556d4e922710 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.941+0000 7f363b7fe640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e922710 0x556d4e924b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.942+0000 7f361b7fe640 10 client.15351 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.942+0000 7f363b7fe640 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e922710 0x556d4e924b00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac84aa75c1c074a server_cookie=d10d293ca9eb47e9 in_seq=0 out_seq=0 2024-09-10T22:17:00.959 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.942+0000 7f361b7fe640 1 -- 172.21.15.5:0/70492231 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556d4e87edb0 con 0x556d4e922710 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.942+0000 7f361b7fe640 10 client.15351 handle_command_reply: tid=0 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.942+0000 7f3644e12740 1 client.15351 shutdown 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 msgr2=0x556d4e90f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90f6e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f362c012c30 tx=0x7f362c004730 comp rx=0 tx=0).stop 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 shutdown_connections 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e922710 0x556d4e924b00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e910160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e90fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 --2- 172.21.15.5:0/70492231 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90f6e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 >> 172.21.15.5:0/70492231 conn(0x556d4e903d10 msgr2=0x556d4e902f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f361b7fe640 0 client.15351 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 shutdown_connections 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 1 -- 172.21.15.5:0/70492231 wait complete. 2024-09-10T22:17:00.960 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.943+0000 7f3644e12740 20 client.15351 trim_cache size 0 max 16384 2024-09-10T22:17:00.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.961+0000 7f3644e12740 1 Processor -- start 2024-09-10T22:17:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.961+0000 7f3644e12740 1 -- start start 2024-09-10T22:17:00.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.961+0000 7f3644e12740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.964 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:00 smithi005 ceph-mon[31115]: pgmap v351: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:17:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39458/0 (socket says 172.21.15.5:39458) 2024-09-10T22:17:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 -- 172.21.15.5:0/3018913334 learned_addr learned my addr 172.21.15.5:0/3018913334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3644e12740 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e91dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3644e12740 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e90c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1b2d80 con 0x556d4e905ee0 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1b0650 con 0x556d4e912790 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1ae4a0 con 0x556d4e906800 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363b7fe640 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e91dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 -- 172.21.15.5:0/3018913334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 msgr2=0x556d4e91dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e91dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 -- 172.21.15.5:0/3018913334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 msgr2=0x556d4e90c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3640fda640 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e90c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e90c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f363bfff640 1 -- 172.21.15.5:0/3018913334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d4e903b40 con 0x556d4e905ee0 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.962+0000 7f3640fda640 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e90c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.963+0000 7f363bfff640 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90ef90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f362c0059f0 tx=0x7f362c009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88eb3567f0564ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:00.966 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.963+0000 7f3621ffb640 1 -- 172.21.15.5:0/3018913334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c029640 con 0x556d4e905ee0 2024-09-10T22:17:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.963+0000 7f3621ffb640 1 -- 172.21.15.5:0/3018913334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f362c020c90 con 0x556d4e905ee0 2024-09-10T22:17:00.967 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.963+0000 7f3621ffb640 1 -- 172.21.15.5:0/3018913334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c028920 con 0x556d4e905ee0 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 msgr2=0x556d4e90ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90ef90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f362c0059f0 tx=0x7f362c009fd0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 shutdown_connections 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e912790 0x556d4e90c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e906800 0x556d4e91dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 --2- 172.21.15.5:0/3018913334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e905ee0 0x556d4e90ef90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 >> 172.21.15.5:0/3018913334 conn(0x556d4e903d10 msgr2=0x556d4e91d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:00.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 shutdown_connections 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 -- 172.21.15.5:0/3018913334 wait complete. 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.964+0000 7f3644e12740 1 -- start start 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 Processor -- start 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e91a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e91adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e9176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1aeb10 con 0x556d4e912790 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1aff80 con 0x556d4e906800 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f363c1af1e0 con 0x556d4e905ee0 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3644e12740 10 client.0 _ll_register_callbacks cb 0x7f362c009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3640fda640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e9176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3640fda640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e9176a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39466/0 (socket says 172.21.15.5:39466) 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f3640fda640 1 -- 172.21.15.5:0/175023586 learned_addr learned my addr 172.21.15.5:0/175023586 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:00.970 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.965+0000 7f363bfff640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e91a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f363b7fe640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e91adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3640fda640 1 -- 172.21.15.5:0/175023586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 msgr2=0x556d4e91a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3640fda640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e91a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3640fda640 1 -- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 msgr2=0x556d4e91adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3640fda640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e91adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3640fda640 1 -- 172.21.15.5:0/175023586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d4e904790 con 0x556d4e912790 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f363b7fe640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e91adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3640fda640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e9176a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3634007d60 tx=0x7f3634003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18dd3e0e66f2bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f361b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f361b7fe640 1 -- 172.21.15.5:0/175023586 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3634010640 con 0x556d4e912790 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f361b7fe640 1 -- 172.21.15.5:0/175023586 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f36340107e0 con 0x556d4e912790 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.966+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f362c020c90 con 0x556d4e912790 2024-09-10T22:17:00.971 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f361b7fe640 1 -- 172.21.15.5:0/175023586 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3634033050 con 0x556d4e912790 2024-09-10T22:17:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 10 client.15357 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556d4e98fd90 con 0x556d4e912790 2024-09-10T22:17:00.972 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f361b7fe640 1 -- 172.21.15.5:0/175023586 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36340183f0 con 0x556d4e912790 2024-09-10T22:17:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f361b7fe640 1 -- 172.21.15.5:0/175023586 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36340050b0 con 0x556d4e912790 2024-09-10T22:17:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 10 client.15357 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 10 client.15357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 20 client.15357 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e9902d0 0x556d4e9926f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:00.973 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 4 client.15357 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.967+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f362c020c90 con 0x556d4e9902d0 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.968+0000 7f363bfff640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e9902d0 0x556d4e9926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.968+0000 7f361b7fe640 10 client.15357 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.968+0000 7f363bfff640 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e9902d0 0x556d4e9926f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee862fc11d3d5797 server_cookie=c16766cfd18508f in_seq=0 out_seq=0 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f361b7fe640 1 -- 172.21.15.5:0/175023586 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f362c020c90 con 0x556d4e9902d0 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f361b7fe640 10 client.15357 handle_command_reply: tid=0 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 client.15357 shutdown 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 msgr2=0x556d4e9176a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e9176a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3634007d60 tx=0x7f3634003ba0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 shutdown_connections 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556d4e9902d0 0x556d4e9926f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556d4e912790 0x556d4e9176a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556d4e906800 0x556d4e91adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.974 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f361b7fe640 0 client.15357 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 --2- 172.21.15.5:0/175023586 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556d4e905ee0 0x556d4e91a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 >> 172.21.15.5:0/175023586 conn(0x556d4e903d10 msgr2=0x556d4e90fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.970+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 shutdown_connections 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3644e12740 1 -- 172.21.15.5:0/175023586 wait complete. 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3644e12740 20 client.15357 trim_cache size 0 max 16384 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "ca33c8df-ea06-4594-a818-6505a6146628", 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-09-10T22:17:00.975 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:17:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f36240b52e0 msgr2=0x7f36240b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f36240b52e0 0x7f36240b77a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f362c009c20 tx=0x7f362c005f90 comp rx=0 tx=0).stop 2024-09-10T22:17:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 msgr2=0x7f363c0fe140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c0fe140 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3630005940 tx=0x7f3630004270 comp rx=0 tx=0).stop 2024-09-10T22:17:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 shutdown_connections 2024-09-10T22:17:00.976 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f36240b52e0 0x7f36240b77a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f363c108020 0x7f363c0fe680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f363c1076a0 0x7f363c0fe140 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.971+0000 7f3642a3d640 1 --2- 172.21.15.5:0/2637907910 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f363c101c90 0x7f363c0fdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.972+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 >> 172.21.15.5:0/2637907910 conn(0x7f363c0fd700 msgr2=0x7f363c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.972+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 shutdown_connections 2024-09-10T22:17:00.977 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:00.972+0000 7f3642a3d640 1 -- 172.21.15.5:0/2637907910 wait complete. 2024-09-10T22:17:01.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:00 smithi189 ceph-mon[35784]: pgmap v351: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:17:01.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:00 smithi052 ceph-mon[34997]: pgmap v351: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:17:01.643 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:17:01.944 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:02.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:01 smithi005 ceph-mon[31115]: scrub queued for path: / 2024-09-10T22:17:02.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:01 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:02.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:01 smithi005 ceph-mon[31115]: scrub summary: active paths [/] 2024-09-10T22:17:02.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:01 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:02.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:01 smithi189 ceph-mon[35784]: scrub queued for path: / 2024-09-10T22:17:02.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:01 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:02.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:01 smithi189 ceph-mon[35784]: scrub summary: active paths [/] 2024-09-10T22:17:02.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:01 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:02.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:01 smithi052 ceph-mon[34997]: scrub queued for path: / 2024-09-10T22:17:02.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:01 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:02.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:01 smithi052 ceph-mon[34997]: scrub summary: active paths [/] 2024-09-10T22:17:02.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:01 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 -- 172.21.15.5:0/3049887892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c10d140 msgr2=0x7fea0c10f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.453 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 --2- 172.21.15.5:0/3049887892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c10d140 0x7fea0c10f5a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fea04009ca0 tx=0x7fea0402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 -- 172.21.15.5:0/3049887892 shutdown_connections 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 --2- 172.21.15.5:0/3049887892 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c10d140 0x7fea0c10f5a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 --2- 172.21.15.5:0/3049887892 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea0c104600 0x7fea0c10caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 --2- 172.21.15.5:0/3049887892 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea0c103ce0 0x7fea0c1040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 -- 172.21.15.5:0/3049887892 >> 172.21.15.5:0/3049887892 conn(0x7fea0c0fd720 msgr2=0x7fea0c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 -- 172.21.15.5:0/3049887892 shutdown_connections 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.436+0000 7fea1447f640 1 -- 172.21.15.5:0/3049887892 wait complete. 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.437+0000 7fea1447f640 1 Processor -- start 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.437+0000 7fea1447f640 1 -- start start 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.437+0000 7fea1447f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 0x7fea0c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.437+0000 7fea1447f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea0c104600 0x7fea0c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1447f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea0c10d140 0x7fea0c19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1447f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c112db0 con 0x7fea0c103ce0 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1447f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c112c30 con 0x7fea0c10d140 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1447f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c112f30 con 0x7fea0c104600 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 0x7fea0c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 0x7fea0c1992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44714/0 (socket says 172.21.15.5:44714) 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 -- 172.21.15.5:0/3796624692 learned_addr learned my addr 172.21.15.5:0/3796624692 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea12a1c640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea0c10d140 0x7fea0c19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea11a1a640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea0c104600 0x7fea0c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.455 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 -- 172.21.15.5:0/3796624692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea0c104600 msgr2=0x7fea0c199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea0c104600 0x7fea0c199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 -- 172.21.15.5:0/3796624692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea0c10d140 msgr2=0x7fea0c19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea0c10d140 0x7fea0c19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 -- 172.21.15.5:0/3796624692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea0c19f390 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1221b640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 0x7fea0c1992e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fea0800d950 tx=0x7fea0800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea037fe640 1 -- 172.21.15.5:0/3796624692 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08017070 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea037fe640 1 -- 172.21.15.5:0/3796624692 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea08009c30 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea0c19f680 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea037fe640 1 -- 172.21.15.5:0/3796624692 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0800f620 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.438+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea0c1a5d40 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea037fe640 1 -- 172.21.15.5:0/3796624692 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fea08010460 con 0x7fea0c103ce0 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 Processor -- start 2024-09-10T22:17:02.456 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 -- start start 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x5625551f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555207820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x56255520a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56255516de50 con 0x5625551f70a0 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56255515d280 con 0x562555207d60 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.441+0000 7fea16854740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562555161090 con 0x5625551f79c0 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x5625551f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x5625551f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44726/0 (socket says 172.21.15.5:44726) 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 -- 172.21.15.5:0/1177630667 learned_addr learned my addr 172.21.15.5:0/1177630667 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea11a1a640 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x56255520a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea1221b640 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555207820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.457 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 -- 172.21.15.5:0/1177630667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 msgr2=0x562555207820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555207820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 -- 172.21.15.5:0/1177630667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 msgr2=0x56255520a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x56255520a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea037fe640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9f80b52e0 0x7fe9f80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 -- 172.21.15.5:0/1177630667 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562554ebb650 con 0x5625551f70a0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9f80b52e0 0x7fe9f80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea037fe640 1 -- 172.21.15.5:0/3796624692 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fea080e5790 con 0x7fea0c103ce0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.442+0000 7fea12a1c640 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x5625551f7480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea04009800 tx=0x7fea04009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51883d97c8e7f02b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea00ff9640 1 -- 172.21.15.5:0/1177630667 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0404d070 con 0x5625551f70a0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea00ff9640 1 -- 172.21.15.5:0/1177630667 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea04036070 con 0x5625551f70a0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea00ff9640 1 -- 172.21.15.5:0/1177630667 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0402f860 con 0x5625551f70a0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 -- 172.21.15.5:0/1177630667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 msgr2=0x5625551f7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea12a1c640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9f80b52e0 0x7fe9f80b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fea0404a000 tx=0x7fea0404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:02.458 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x5625551f7480 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fea04009800 tx=0x7fea04009830 comp rx=0 tx=0).stop 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 -- 172.21.15.5:0/1177630667 shutdown_connections 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x56255520a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555207820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 --2- 172.21.15.5:0/1177630667 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x5625551f7480 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.443+0000 7fea16854740 1 -- 172.21.15.5:0/1177630667 >> 172.21.15.5:0/1177630667 conn(0x5625551f4ed0 msgr2=0x5625551f6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 -- 172.21.15.5:0/1177630667 shutdown_connections 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 -- 172.21.15.5:0/1177630667 wait complete. 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 -- start start 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 Processor -- start 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x562555207690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 0x562555204ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x562555205160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562554fbe700 con 0x5625551f79c0 2024-09-10T22:17:02.459 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5625550f8110 con 0x562555207d60 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56255520a890 con 0x5625551f70a0 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea16854740 10 client.0 _ll_register_callbacks cb 0x562555111990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea11a1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 0x562555204ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea11a1a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 0x562555204ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44732/0 (socket says 172.21.15.5:44732) 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea11a1a640 1 -- 172.21.15.5:0/2119163444 learned_addr learned my addr 172.21.15.5:0/2119163444 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea1221b640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x562555207690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.444+0000 7fea12a1c640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x562555205160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea11a1a640 1 -- 172.21.15.5:0/2119163444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 msgr2=0x562555207690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea11a1a640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x562555207690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea11a1a640 1 -- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 msgr2=0x562555205160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea11a1a640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x562555205160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea11a1a640 1 -- 172.21.15.5:0/2119163444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562555125c40 con 0x5625551f79c0 2024-09-10T22:17:02.460 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea12a1c640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x562555205160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea11a1a640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 0x562555204ae0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00bde0 tx=0x7fe9fc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f9263d6e99e0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fe9f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/2119163444 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9fc005020 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/2119163444 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe9fc0051c0 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea04036070 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/2119163444 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe9fc0053c0 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea16854740 10 client.15369 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562555216200 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.445+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/2119163444 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea04036070 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/2119163444 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe9fc010980 con 0x5625551f79c0 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea16854740 10 client.15369 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea16854740 10 client.15369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:02.461 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea16854740 20 client.15369 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea16854740 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552176d0 0x562555219ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea16854740 4 client.15369 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56255516fda0 con 0x5625552176d0 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea1221b640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552176d0 0x562555219ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fea1221b640 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552176d0 0x562555219ac0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=108aebc3decdc547 server_cookie=5804a610d25414cc in_seq=0 out_seq=0 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.446+0000 7fe9f5ffb640 10 client.15369 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/2119163444 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56255516fda0 con 0x5625552176d0 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fe9f5ffb640 10 client.15369 handle_command_reply: tid=0 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 client.15369 shutdown 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 msgr2=0x562555204ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 0x562555204ae0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc00bde0 tx=0x7fe9fc011810 comp rx=0 tx=0).stop 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 shutdown_connections 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552176d0 0x562555219ac0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.462 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x562555205160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f79c0 0x562555204ae0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fe9f5ffb640 0 client.15369 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 --2- 172.21.15.5:0/2119163444 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x562555207690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 >> 172.21.15.5:0/2119163444 conn(0x5625551f4ed0 msgr2=0x5625551faa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 shutdown_connections 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 1 -- 172.21.15.5:0/2119163444 wait complete. 2024-09-10T22:17:02.463 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.447+0000 7fea16854740 20 client.15369 trim_cache size 0 max 16384 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.465+0000 7fea16854740 1 Processor -- start 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.465+0000 7fea16854740 1 -- start start 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.465+0000 7fea16854740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x562555213ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.465+0000 7fea16854740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555203360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.465+0000 7fea16854740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x5625552038a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea16854740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c1aea90 con 0x5625551f70a0 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea16854740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c1ac360 con 0x562555207d60 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea16854740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c1aa1d0 con 0x5625551f79c0 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x562555213ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x562555213ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44742/0 (socket says 172.21.15.5:44742) 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 -- 172.21.15.5:0/1236730919 learned_addr learned my addr 172.21.15.5:0/1236730919 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea11a1a640 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555203360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea12a1c640 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x5625552038a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 -- 172.21.15.5:0/1236730919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 msgr2=0x562555203360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555203360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 -- 172.21.15.5:0/1236730919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 msgr2=0x5625552038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x5625552038a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 -- 172.21.15.5:0/1236730919 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625551f77f0 con 0x5625551f70a0 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fea1221b640 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x562555213ac0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fea080e32c0 tx=0x7fea08010cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4187ccde6f181bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fe9f7fff640 1 -- 172.21.15.5:0/1236730919 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08020040 con 0x5625551f70a0 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fe9f7fff640 1 -- 172.21.15.5:0/1236730919 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea08091e50 con 0x5625551f70a0 2024-09-10T22:17:02.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.466+0000 7fe9f7fff640 1 -- 172.21.15.5:0/1236730919 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea08010780 con 0x5625551f70a0 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 -- 172.21.15.5:0/1236730919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 msgr2=0x562555213ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x562555213ac0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fea080e32c0 tx=0x7fea08010cb0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 -- 172.21.15.5:0/1236730919 shutdown_connections 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562555207d60 0x5625552038a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f79c0 0x562555203360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 --2- 172.21.15.5:0/1236730919 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5625551f70a0 0x562555213ac0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 -- 172.21.15.5:0/1236730919 >> 172.21.15.5:0/1236730919 conn(0x5625551f4ed0 msgr2=0x562555208ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 -- 172.21.15.5:0/1236730919 shutdown_connections 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 -- 172.21.15.5:0/1236730919 wait complete. 2024-09-10T22:17:02.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.467+0000 7fea16854740 1 -- start start 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 Processor -- start 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x56255520fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625551f79c0 0x562555210060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 0x56255520caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c1aa820 con 0x562555207d60 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c1abc90 con 0x5625551f79c0 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fea0c1aaef0 con 0x5625551f70a0 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea16854740 10 client.0 _ll_register_callbacks cb 0x7fe9fc00b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 0x56255520caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 0x56255520caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44756/0 (socket says 172.21.15.5:44756) 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 -- 172.21.15.5:0/4168780728 learned_addr learned my addr 172.21.15.5:0/4168780728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea11a1a640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625551f79c0 0x562555210060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea1221b640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x56255520fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.475 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 -- 172.21.15.5:0/4168780728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 msgr2=0x56255520fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x56255520fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 -- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625551f79c0 msgr2=0x562555210060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625551f79c0 0x562555210060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea12a1c640 1 -- 172.21.15.5:0/4168780728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56255520d030 con 0x562555207d60 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.468+0000 7fea11a1a640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625551f79c0 0x562555210060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea12a1c640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 0x56255520caf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fea040098a0 tx=0x7fea040093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25b6f819880e832 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fe9f5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/4168780728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea0404d040 con 0x562555207d60 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/4168780728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fea04003f00 con 0x562555207d60 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea08091e50 con 0x562555207d60 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/4168780728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fea04004100 con 0x562555207d60 2024-09-10T22:17:02.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 10 client.15375 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562555284c60 con 0x562555207d60 2024-09-10T22:17:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/4168780728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea08091e50 con 0x562555207d60 2024-09-10T22:17:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/4168780728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fea0402fab0 con 0x562555207d60 2024-09-10T22:17:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 10 client.15375 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 10 client.15375 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:02.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 20 client.15375 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552850d0 0x5625552874f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 4 client.15375 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:17:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.469+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56255516b850 con 0x5625552850d0 2024-09-10T22:17:02.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea1221b640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552850d0 0x5625552874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea1221b640 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552850d0 0x5625552874f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbcda5f3856060b7 server_cookie=99b92d7631d044d in_seq=0 out_seq=0 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fe9f5ffb640 10 client.15375 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fe9f5ffb640 1 -- 172.21.15.5:0/4168780728 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x56255516b850 con 0x5625552850d0 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fe9f5ffb640 10 client.15375 handle_command_reply: tid=0 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 client.15375 shutdown 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 msgr2=0x56255520caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 0x56255520caf0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fea040098a0 tx=0x7fea040093d0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 shutdown_connections 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5625552850d0 0x5625552874f0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562555207d60 0x56255520caf0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5625551f79c0 0x562555210060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 --2- 172.21.15.5:0/4168780728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5625551f70a0 0x56255520fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.470+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 >> 172.21.15.5:0/4168780728 conn(0x5625551f4ed0 msgr2=0x5625551f5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fe9f5ffb640 0 client.15375 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 shutdown_connections 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea16854740 1 -- 172.21.15.5:0/4168780728 wait complete. 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea16854740 20 client.15375 trim_cache size 0 max 16384 2024-09-10T22:17:02.480 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "ca33c8df-ea06-4594-a818-6505a6146628", 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:17:02.481 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:17:02.482 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9f80b52e0 msgr2=0x7fe9f80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9f80b52e0 0x7fe9f80b77a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fea0404a000 tx=0x7fea0404b000 comp rx=0 tx=0).stop 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 msgr2=0x7fea0c1992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 0x7fea0c1992e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fea0800d950 tx=0x7fea0800de10 comp rx=0 tx=0).stop 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 shutdown_connections 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe9f80b52e0 0x7fe9f80b77a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fea0c10d140 0x7fea0c19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fea0c104600 0x7fea0c199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 --2- 172.21.15.5:0/3796624692 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fea0c103ce0 0x7fea0c1992e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 >> 172.21.15.5:0/3796624692 conn(0x7fea0c0fd720 msgr2=0x7fea0c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 shutdown_connections 2024-09-10T22:17:02.483 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:02.471+0000 7fea1447f640 1 -- 172.21.15.5:0/3796624692 wait complete. 2024-09-10T22:17:03.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:02 smithi005 ceph-mon[31115]: pgmap v352: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:17:03.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:02 smithi189 ceph-mon[35784]: pgmap v352: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:17:03.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:02 smithi052 ceph-mon[34997]: pgmap v352: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:17:03.258 INFO:tasks.cephfs.filesystem:scrub status for tag:ca33c8df-ea06-4594-a818-6505a6146628 - {'path': '/', 'tag': 'ca33c8df-ea06-4594-a818-6505a6146628', 'options': 'recursive,force'} 2024-09-10T22:17:05.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:04 smithi005 ceph-mon[31115]: pgmap v353: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:17:05.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:04 smithi189 ceph-mon[35784]: pgmap v353: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:17:05.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:04 smithi052 ceph-mon[34997]: pgmap v353: 97 pgs: 97 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-10T22:17:07.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:06 smithi189 ceph-mon[35784]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-10T22:17:07.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:06 smithi052 ceph-mon[34997]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-10T22:17:07.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:06 smithi005 ceph-mon[31115]: pgmap v354: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-09-10T22:17:09.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:08 smithi189 ceph-mon[35784]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:09.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:08 smithi052 ceph-mon[34997]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:09.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:08 smithi005 ceph-mon[31115]: pgmap v355: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:10 smithi189 ceph-mon[35784]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:11.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:10 smithi052 ceph-mon[34997]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:11.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:10 smithi005 ceph-mon[31115]: pgmap v356: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:12.120 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:11 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:12.142 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:11 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:12.220 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:11 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:17:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:17:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: scrub summary: idle 2024-09-10T22:17:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:12 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: scrub summary: idle 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:12 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 -- 172.21.15.5:0/4018566681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d01044a0 msgr2=0x7ff3d010ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/4018566681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d01044a0 0x7ff3d010ae20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009cd0 tx=0x7ff3c802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.318 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 -- 172.21.15.5:0/4018566681 shutdown_connections 2024-09-10T22:17:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/4018566681 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d01044a0 0x7ff3d010ae20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/4018566681 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/4018566681 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 0x7ff3d0102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 -- 172.21.15.5:0/4018566681 >> 172.21.15.5:0/4018566681 conn(0x7ff3d00fe210 msgr2=0x7ff3d0100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 -- 172.21.15.5:0/4018566681 shutdown_connections 2024-09-10T22:17:13.319 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 -- 172.21.15.5:0/4018566681 wait complete. 2024-09-10T22:17:13.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.317+0000 7ff3d6a60640 1 Processor -- start 2024-09-10T22:17:13.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 -- start start 2024-09-10T22:17:13.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 0x7ff3d0198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.321 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d01044a0 0x7ff3d0199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d010e600 con 0x7ff3d0103ae0 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d010e480 con 0x7ff3d0102990 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d6a60640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d010e780 con 0x7ff3d01044a0 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3cf7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37378/0 (socket says 172.21.15.5:37378) 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3cf7fe640 1 -- 172.21.15.5:0/3998380359 learned_addr learned my addr 172.21.15.5:0/3998380359 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3cffff640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 0x7ff3d0198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.318+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d01044a0 0x7ff3d0199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cf7fe640 1 -- 172.21.15.5:0/3998380359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d01044a0 msgr2=0x7ff3d0199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d01044a0 0x7ff3d0199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cf7fe640 1 -- 172.21.15.5:0/3998380359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 msgr2=0x7ff3d0198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 0x7ff3d0198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.322 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cf7fe640 1 -- 172.21.15.5:0/3998380359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d019a890 con 0x7ff3d0103ae0 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cffff640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 0x7ff3d0198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0199410 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400e9f0 tx=0x7ff3c400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cd7fa640 1 -- 172.21.15.5:0/3998380359 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400cd80 con 0x7ff3d0103ae0 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cd7fa640 1 -- 172.21.15.5:0/3998380359 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c40054d0 con 0x7ff3d0103ae0 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d019ab80 con 0x7ff3d0103ae0 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3cd7fa640 1 -- 172.21.15.5:0/3998380359 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4010690 con 0x7ff3d0103ae0 2024-09-10T22:17:13.323 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.319+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d01a1250 con 0x7ff3d0103ae0 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 Processor -- start 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 -- start start 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128ef8c70 0x556128efb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128efd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128efdfe0 0x556128f004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556128e666f0 con 0x556128efdfe0 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556128e55b20 con 0x556128efb5a0 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d982e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556128e59930 con 0x556128ef8c70 2024-09-10T22:17:13.329 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128efd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128efd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:44474/0 (socket says 172.21.15.5:44474) 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3cffff640 1 -- 172.21.15.5:0/79392479 learned_addr learned my addr 172.21.15.5:0/79392479 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.322+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128ef8c70 0x556128efb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cffff640 1 -- 172.21.15.5:0/79392479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128ef8c70 msgr2=0x556128efb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cffff640 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128ef8c70 0x556128efb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cffff640 1 -- 172.21.15.5:0/79392479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128efdfe0 msgr2=0x556128f004a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cffff640 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128efdfe0 0x556128f004a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cffff640 1 -- 172.21.15.5:0/79392479 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556128e1b530 con 0x556128efb5a0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cffff640 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128efd990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0011540 tx=0x7ff3c0011a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932c87d4d463a514 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3cd7fa640 1 -- 172.21.15.5:0/3998380359 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff3c4004e90 con 0x7ff3d0103ae0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3b67fc640 1 -- 172.21.15.5:0/79392479 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c000f640 con 0x556128efb5a0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3b67fc640 1 -- 172.21.15.5:0/79392479 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c000fc90 con 0x556128efb5a0 2024-09-10T22:17:13.330 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.323+0000 7ff3b67fc640 1 -- 172.21.15.5:0/79392479 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0019cf0 con 0x556128efb5a0 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3cd7fa640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3b80b5360 0x7ff3b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 -- 172.21.15.5:0/79392479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 msgr2=0x556128efd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128efd990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0011540 tx=0x7ff3c0011a00 comp rx=0 tx=0).stop 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 -- 172.21.15.5:0/79392479 shutdown_connections 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128efdfe0 0x556128f004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3b80b5360 0x7ff3b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128efd990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 --2- 172.21.15.5:0/79392479 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128ef8c70 0x556128efb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 -- 172.21.15.5:0/79392479 >> 172.21.15.5:0/79392479 conn(0x556128eef9b0 msgr2=0x556128ef0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3cd7fa640 1 -- 172.21.15.5:0/3998380359 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff3c40e5f80 con 0x7ff3d0103ae0 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 -- 172.21.15.5:0/79392479 shutdown_connections 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 -- 172.21.15.5:0/79392479 wait complete. 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d982e740 1 -- start start 2024-09-10T22:17:13.331 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.324+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3b80b5360 0x7ff3b80b7820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0199b40 tx=0x7ff3c803d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 Processor -- start 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f02360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128f02a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efdfe0 0x556128f035d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556128d8dab0 con 0x556128ef8c70 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556128dfb730 con 0x556128efb5a0 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556128f00fc0 con 0x556128efdfe0 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d982e740 10 client.0 _ll_register_callbacks cb 0x556128e4f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f02360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f02360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37386/0 (socket says 172.21.15.5:37386) 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 -- 172.21.15.5:0/1829201282 learned_addr learned my addr 172.21.15.5:0/1829201282 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128f02a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.332 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efdfe0 0x556128f035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 -- 172.21.15.5:0/1829201282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efdfe0 msgr2=0x556128f035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efdfe0 0x556128f035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 -- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 msgr2=0x556128f02a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128f02a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cffff640 1 -- 172.21.15.5:0/1829201282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556128bb7790 con 0x556128ef8c70 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.325+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128f02a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3cffff640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f02360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001b040 tx=0x7ff3c0019c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c51d7ab512ea16 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3af7fe640 1 -- 172.21.15.5:0/1829201282 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0026020 con 0x556128ef8c70 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c000fc90 con 0x556128ef8c70 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3af7fe640 1 -- 172.21.15.5:0/1829201282 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff3c000f640 con 0x556128ef8c70 2024-09-10T22:17:13.333 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3af7fe640 1 -- 172.21.15.5:0/1829201282 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff3c000f840 con 0x556128ef8c70 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 10 client.15384 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556128c30620 con 0x556128ef8c70 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3af7fe640 1 -- 172.21.15.5:0/1829201282 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c000fc90 con 0x556128ef8c70 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3af7fe640 1 -- 172.21.15.5:0/1829201282 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff3c0004930 con 0x556128ef8c70 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 10 client.15384 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 10 client.15384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 20 client.15384 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f0da10 0x556128f0fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 4 client.15384 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.326+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556128e68640 con 0x556128f0da10 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.327+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f0da10 0x556128f0fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.334 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.327+0000 7ff3af7fe640 10 client.15384 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.327+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f0da10 0x556128f0fe00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab3aedb7a6b05a5f server_cookie=2b33109e1e445748 in_seq=0 out_seq=0 2024-09-10T22:17:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3af7fe640 1 -- 172.21.15.5:0/1829201282 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556128e68640 con 0x556128f0da10 2024-09-10T22:17:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3af7fe640 10 client.15384 handle_command_reply: tid=0 2024-09-10T22:17:13.335 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 client.15384 shutdown 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 msgr2=0x556128f02360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f02360 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff3c001b040 tx=0x7ff3c0019c20 comp rx=0 tx=0).stop 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 shutdown_connections 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f0da10 0x556128f0fe00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efdfe0 0x556128f035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3af7fe640 0 client.15384 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efb5a0 0x556128f02a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1829201282 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f02360 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 >> 172.21.15.5:0/1829201282 conn(0x556128eef9b0 msgr2=0x556128eeebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:13.336 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 shutdown_connections 2024-09-10T22:17:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 1 -- 172.21.15.5:0/1829201282 wait complete. 2024-09-10T22:17:13.337 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.328+0000 7ff3d982e740 20 client.15384 trim_cache size 0 max 16384 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: pgmap v357: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: scrub summary: idle 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:12 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 Processor -- start 2024-09-10T22:17:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 -- start start 2024-09-10T22:17:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128eff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128eff580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128effac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01aa510 con 0x556128ef8c70 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01a7de0 con 0x556128efdfe0 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d982e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01a5c50 con 0x556128efb5a0 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128eff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128eff040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37396/0 (socket says 172.21.15.5:37396) 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 -- 172.21.15.5:0/1623370030 learned_addr learned my addr 172.21.15.5:0/1623370030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128effac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128eff580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 -- 172.21.15.5:0/1623370030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 msgr2=0x556128eff580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128eff580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 -- 172.21.15.5:0/1623370030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 msgr2=0x556128effac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128effac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.348+0000 7ff3cffff640 1 -- 172.21.15.5:0/1623370030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556128efdd00 con 0x556128ef8c70 2024-09-10T22:17:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.349+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128effac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.349+0000 7ff3cffff640 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128eff040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0004d80 tx=0x7ff3c000f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf2b14104dd472c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.349+0000 7ff3b5ffb640 1 -- 172.21.15.5:0/1623370030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0026040 con 0x556128ef8c70 2024-09-10T22:17:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.349+0000 7ff3b5ffb640 1 -- 172.21.15.5:0/1623370030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c0015070 con 0x556128ef8c70 2024-09-10T22:17:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.349+0000 7ff3b5ffb640 1 -- 172.21.15.5:0/1623370030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0022c60 con 0x556128ef8c70 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- 172.21.15.5:0/1623370030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 msgr2=0x556128eff040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128eff040 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0004d80 tx=0x7ff3c000f7d0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- 172.21.15.5:0/1623370030 shutdown_connections 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128effac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128eff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- 172.21.15.5:0/1623370030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128eff040 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- 172.21.15.5:0/1623370030 >> 172.21.15.5:0/1623370030 conn(0x556128eef9b0 msgr2=0x556128efe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- 172.21.15.5:0/1623370030 shutdown_connections 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- 172.21.15.5:0/1623370030 wait complete. 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- start start 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 Processor -- start 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f070e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128f07780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128f08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.350+0000 7ff3d982e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01a62a0 con 0x556128ef8c70 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3d982e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01a7710 con 0x556128efdfe0 2024-09-10T22:17:13.356 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3d982e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d01a6970 con 0x556128efb5a0 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3d982e740 10 client.0 _ll_register_callbacks cb 0x7ff3c0011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37410/0 (socket says 172.21.15.5:37410) 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 -- 172.21.15.5:0/3874716428 learned_addr learned my addr 172.21.15.5:0/3874716428 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128f07780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3d4ffd640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128f08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 -- 172.21.15.5:0/3874716428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 msgr2=0x556128f07780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128f07780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 -- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 msgr2=0x556128f08350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128f08350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 -- 172.21.15.5:0/3874716428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556128f08b80 con 0x556128ef8c70 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3cffff640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f070e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0014040 tx=0x7ff3c0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2546b1bcf363c12b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:13.357 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3af7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3af7fe640 1 -- 172.21.15.5:0/3874716428 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0026040 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3af7fe640 1 -- 172.21.15.5:0/3874716428 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff3c000fbe0 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.351+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c0015070 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3af7fe640 1 -- 172.21.15.5:0/3874716428 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff3c0023e60 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 10 client.15390 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556128f09ef0 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3af7fe640 1 -- 172.21.15.5:0/3874716428 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c0015070 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3af7fe640 1 -- 172.21.15.5:0/3874716428 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff3c003d020 con 0x556128ef8c70 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 10 client.15390 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 10 client.15390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 20 client.15390 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f7aa80 0x556128f7cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 4 client.15390 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:17:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556128e640f0 con 0x556128f7aa80 2024-09-10T22:17:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f7aa80 0x556128f7cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3af7fe640 10 client.15390 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.352+0000 7ff3cf7fe640 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f7aa80 0x556128f7cea0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e791e45e980c1e7c server_cookie=4fc134936bc2058b in_seq=0 out_seq=0 2024-09-10T22:17:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3af7fe640 1 -- 172.21.15.5:0/3874716428 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556128e640f0 con 0x556128f7aa80 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3af7fe640 10 client.15390 handle_command_reply: tid=0 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 client.15390 shutdown 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 msgr2=0x556128f070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f070e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0014040 tx=0x7ff3c0009260 comp rx=0 tx=0).stop 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 shutdown_connections 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556128f7aa80 0x556128f7cea0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556128efdfe0 0x556128f08350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556128efb5a0 0x556128f07780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3af7fe640 0 client.15390 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 --2- 172.21.15.5:0/3874716428 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556128ef8c70 0x556128f070e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 >> 172.21.15.5:0/3874716428 conn(0x556128eef9b0 msgr2=0x556128eeebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 shutdown_connections 2024-09-10T22:17:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 1 -- 172.21.15.5:0/3874716428 wait complete. 2024-09-10T22:17:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.362+0000 7ff3d982e740 20 client.15390 trim_cache size 0 max 16384 2024-09-10T22:17:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:17:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:17:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:17:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3b80b5360 msgr2=0x7ff3b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3b80b5360 0x7ff3b80b7820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3d0199b40 tx=0x7ff3c803d040 comp rx=0 tx=0).stop 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 msgr2=0x7ff3d0199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0199410 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400e9f0 tx=0x7ff3c400edf0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 shutdown_connections 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff3b80b5360 0x7ff3b80b7820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff3d01044a0 0x7ff3d0199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff3d0103ae0 0x7ff3d0199410 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 --2- 172.21.15.5:0/3998380359 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff3d0102990 0x7ff3d0198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 >> 172.21.15.5:0/3998380359 conn(0x7ff3d00fe210 msgr2=0x7ff3d0106e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 shutdown_connections 2024-09-10T22:17:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:13.363+0000 7ff3d6a60640 1 -- 172.21.15.5:0/3998380359 wait complete. 2024-09-10T22:17:14.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:14.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:14.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:13 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:14.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:14.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:14.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:13 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:14.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:17:14.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:17:14.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:13 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:17:15.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:15 smithi005 ceph-mon[31115]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:15.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:15 smithi189 ceph-mon[35784]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:15.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:15 smithi052 ceph-mon[34997]: pgmap v358: 97 pgs: 97 active+clean; 652 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-10T22:17:17.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:17 smithi005 ceph-mon[31115]: pgmap v359: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-10T22:17:17.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:17 smithi189 ceph-mon[35784]: pgmap v359: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-10T22:17:17.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:17 smithi052 ceph-mon[34997]: pgmap v359: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-09-10T22:17:19.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:19 smithi005 ceph-mon[31115]: pgmap v360: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:19 smithi189 ceph-mon[35784]: pgmap v360: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:19.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:19 smithi052 ceph-mon[34997]: pgmap v360: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:21.552 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:21 smithi052 ceph-mon[34997]: pgmap v361: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:21.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:21 smithi005 ceph-mon[31115]: pgmap v361: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:21.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:21 smithi189 ceph-mon[35784]: pgmap v361: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:23.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:23 smithi005 ceph-mon[31115]: pgmap v362: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-10T22:17:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:23 smithi189 ceph-mon[35784]: pgmap v362: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-10T22:17:23.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:23 smithi052 ceph-mon[34997]: pgmap v362: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-10T22:17:25.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:25 smithi005 ceph-mon[31115]: pgmap v363: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:25.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:25 smithi189 ceph-mon[35784]: pgmap v363: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:25.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:25 smithi052 ceph-mon[34997]: pgmap v363: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-10T22:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 -- 172.21.15.5:0/3887325564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c103380 msgr2=0x7f751c109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 --2- 172.21.15.5:0/3887325564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c103380 0x7f751c109d00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7514009cd0 tx=0x7f751402a8e0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 -- 172.21.15.5:0/3887325564 shutdown_connections 2024-09-10T22:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 --2- 172.21.15.5:0/3887325564 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c103380 0x7f751c109d00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 --2- 172.21.15.5:0/3887325564 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c1029c0 0x7f751c102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.502 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 --2- 172.21.15.5:0/3887325564 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c101870 0x7f751c101c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.500+0000 7f75241d3640 1 -- 172.21.15.5:0/3887325564 >> 172.21.15.5:0/3887325564 conn(0x7f751c0fd110 msgr2=0x7f751c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:26.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.501+0000 7f75241d3640 1 -- 172.21.15.5:0/3887325564 shutdown_connections 2024-09-10T22:17:26.503 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.501+0000 7f75241d3640 1 -- 172.21.15.5:0/3887325564 wait complete. 2024-09-10T22:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.501+0000 7f75241d3640 1 Processor -- start 2024-09-10T22:17:26.504 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 -- start start 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 0x7f751c196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 0x7f751c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c103380 0x7f751c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f751c10c400 con 0x7f751c1029c0 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f751c10c280 con 0x7f751c101870 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f75241d3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f751c10c580 con 0x7f751c103380 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f752176e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 0x7f751c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f7521f6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 0x7f751c196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f7521f6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 0x7f751c196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:36214/0 (socket says 172.21.15.5:36214) 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f752176e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 0x7f751c197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51802/0 (socket says 172.21.15.5:51802) 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f7521f6f640 1 -- 172.21.15.5:0/4287221962 learned_addr learned my addr 172.21.15.5:0/4287221962 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.502+0000 7f7522770640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c103380 0x7f751c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.505 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7521f6f640 1 -- 172.21.15.5:0/4287221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c103380 msgr2=0x7f751c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7521f6f640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c103380 0x7f751c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7521f6f640 1 -- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 msgr2=0x7f751c197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7521f6f640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 0x7f751c197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7521f6f640 1 -- 172.21.15.5:0/4287221962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c198670 con 0x7f751c101870 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f752176e640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 0x7f751c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7522770640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c103380 0x7f751c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7521f6f640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 0x7f751c196b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f751800d770 tx=0x7f751800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7512ffd640 1 -- 172.21.15.5:0/4287221962 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518017070 con 0x7f751c101870 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7512ffd640 1 -- 172.21.15.5:0/4287221962 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75180054d0 con 0x7f751c101870 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c198960 con 0x7f751c101870 2024-09-10T22:17:26.506 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.503+0000 7f7512ffd640 1 -- 172.21.15.5:0/4287221962 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7518004d40 con 0x7f751c101870 2024-09-10T22:17:26.507 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.504+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c19f030 con 0x7f751c101870 2024-09-10T22:17:26.509 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.507+0000 7f752707b740 1 Processor -- start 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 -- start start 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f7512ffd640 1 -- 172.21.15.5:0/4287221962 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7518023060 con 0x7f751c101870 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556decedbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556decfcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556decff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5556dec616f0 con 0x5556decfd470 2024-09-10T22:17:26.511 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556dec50b20 con 0x5556decee110 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752707b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5556dec54930 con 0x5556deced7d0 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f7521f6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556decfcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f7521f6f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556decfcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:36230/0 (socket says 172.21.15.5:36230) 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f7521f6f640 1 -- 172.21.15.5:0/872011194 learned_addr learned my addr 172.21.15.5:0/872011194 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f7522770640 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556decedbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.508+0000 7f752176e640 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556decff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7522770640 1 -- 172.21.15.5:0/872011194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 msgr2=0x5556decfcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7522770640 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556decfcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.512 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7522770640 1 -- 172.21.15.5:0/872011194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 msgr2=0x5556decff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7522770640 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556decff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7522770640 1 -- 172.21.15.5:0/872011194 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556dec16530 con 0x5556deced7d0 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f752176e640 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556decff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7512ffd640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f75080b52e0 0x7f75080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7522770640 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556decedbd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7514009ca0 tx=0x7f7514009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=984f0e88fb4cb660 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.509+0000 7f7521f6f640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f75080b52e0 0x7f75080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.510+0000 7f7507fff640 1 -- 172.21.15.5:0/872011194 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514031b50 con 0x5556deced7d0 2024-09-10T22:17:26.513 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.510+0000 7f7507fff640 1 -- 172.21.15.5:0/872011194 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7514036040 con 0x5556deced7d0 2024-09-10T22:17:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.510+0000 7f7512ffd640 1 -- 172.21.15.5:0/4287221962 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f75180e4ff0 con 0x7f751c101870 2024-09-10T22:17:26.514 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.510+0000 7f7507fff640 1 -- 172.21.15.5:0/872011194 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75140045e0 con 0x5556deced7d0 2024-09-10T22:17:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 -- 172.21.15.5:0/872011194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 msgr2=0x5556decedbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f7521f6f640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f75080b52e0 0x7f75080b77a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75180e2b20 tx=0x7f75180e8ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556decedbd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7514009ca0 tx=0x7f7514009a20 comp rx=0 tx=0).stop 2024-09-10T22:17:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 -- 172.21.15.5:0/872011194 shutdown_connections 2024-09-10T22:17:26.518 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556decff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556decfcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 --2- 172.21.15.5:0/872011194 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556decedbd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 -- 172.21.15.5:0/872011194 >> 172.21.15.5:0/872011194 conn(0x5556decea930 msgr2=0x5556deceb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 -- 172.21.15.5:0/872011194 shutdown_connections 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 -- 172.21.15.5:0/872011194 wait complete. 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.511+0000 7f752707b740 1 -- start start 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 Processor -- start 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 0x5556ded016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f7522770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 0x5556ded016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f7522770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 0x5556ded016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51822/0 (socket says 172.21.15.5:51822) 2024-09-10T22:17:26.519 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f7522770640 1 -- 172.21.15.5:0/740636609 learned_addr learned my addr 172.21.15.5:0/740636609 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decee110 0x5556ded01d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decfd470 0x5556ded02910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5556deb88ab0 con 0x5556deced7d0 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5556debf6730 con 0x5556decfd470 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.512+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5556ded00360 con 0x5556decee110 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f752176e640 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decee110 0x5556ded01d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f7522770640 1 -- 172.21.15.5:0/740636609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decee110 msgr2=0x5556ded01d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f7522770640 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decee110 0x5556ded01d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f7522770640 1 -- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decfd470 msgr2=0x5556ded02910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:17:26.520 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f7522770640 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decfd470 0x5556ded02910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f7522770640 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556de9b2790 con 0x5556deced7d0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f752707b740 10 client.0 _ll_register_callbacks cb 0x5556dec4a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7514036040 con 0x5556deced7d0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f7522770640 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 0x5556ded016a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7514005e30 tx=0x7f7514003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26cb75fb543036a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.513+0000 7f75057fa640 10 client.15402 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f75057fa640 1 -- 172.21.15.5:0/740636609 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7514031530 con 0x5556deced7d0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f75057fa640 1 -- 172.21.15.5:0/740636609 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7514003d40 con 0x5556deced7d0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f75057fa640 1 -- 172.21.15.5:0/740636609 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7514003f60 con 0x5556deced7d0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f752707b740 10 client.15402 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5556dea2b620 con 0x5556deced7d0 2024-09-10T22:17:26.521 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f75057fa640 1 -- 172.21.15.5:0/740636609 <== mon.0 v2:172.21.15.5:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7514058030 con 0x5556deced7d0 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f752707b740 10 client.15402 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.514+0000 7f752707b740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f752707b740 20 client.15402 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded0ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f752707b740 4 client.15402 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556dec63640 con 0x5556ded0c880 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f752176e640 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded0ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f752176e640 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded0ec70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6daaf32baddb45cf server_cookie=cd3bde0f75f381fd in_seq=0 out_seq=0 2024-09-10T22:17:26.522 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.515+0000 7f75057fa640 10 client.15402 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f75057fa640 1 -- 172.21.15.5:0/740636609 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556dec63640 con 0x5556ded0c880 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f75057fa640 10 client.15402 handle_command_reply: tid=0 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f752707b740 1 client.15402 shutdown 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 msgr2=0x5556ded016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 0x5556ded016a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7514005e30 tx=0x7f7514003ba0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 shutdown_connections 2024-09-10T22:17:26.523 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.516+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded0ec70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f75057fa640 0 client.15402 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decfd470 0x5556ded02910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decee110 0x5556ded01d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 1 --2- 172.21.15.5:0/740636609 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556deced7d0 0x5556ded016a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 >> 172.21.15.5:0/740636609 conn(0x5556decea930 msgr2=0x5556dece9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 shutdown_connections 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 1 -- 172.21.15.5:0/740636609 wait complete. 2024-09-10T22:17:26.524 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.517+0000 7f752707b740 20 client.15402 trim_cache size 0 max 16384 2024-09-10T22:17:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 Processor -- start 2024-09-10T22:17:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 -- start start 2024-09-10T22:17:26.547 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556deced7d0 0x5556decf9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 0x5556decfa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.548 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decfd470 0x5556decfa820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1aa420 con 0x5556decee110 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1a7cf0 con 0x5556deced7d0 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752707b740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1a5b90 con 0x5556decfd470 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752176e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 0x5556decfa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752176e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 0x5556decfa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51832/0 (socket says 172.21.15.5:51832) 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.546+0000 7f752176e640 1 -- 172.21.15.5:0/2279921546 learned_addr learned my addr 172.21.15.5:0/2279921546 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:26.549 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f7522770640 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556deced7d0 0x5556decf9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f7522770640 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decfd470 0x5556decfa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f752176e640 1 -- 172.21.15.5:0/2279921546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decfd470 msgr2=0x5556decfa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f752176e640 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decfd470 0x5556decfa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f752176e640 1 -- 172.21.15.5:0/2279921546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556deced7d0 msgr2=0x5556decf9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f752176e640 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556deced7d0 0x5556decf9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f752176e640 1 -- 172.21.15.5:0/2279921546 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ded01a10 con 0x5556decee110 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f7522770640 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556deced7d0 0x5556decf9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f752176e640 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 0x5556decfa2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f750c011540 tx=0x7f750c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ba6c9399754036 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f75077fe640 1 -- 172.21.15.5:0/2279921546 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c004220 con 0x5556decee110 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f75077fe640 1 -- 172.21.15.5:0/2279921546 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f750c010de0 con 0x5556decee110 2024-09-10T22:17:26.550 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.547+0000 7f75077fe640 1 -- 172.21.15.5:0/2279921546 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f750c003e20 con 0x5556decee110 2024-09-10T22:17:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 -- 172.21.15.5:0/2279921546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 msgr2=0x5556decfa2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 0x5556decfa2e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f750c011540 tx=0x7f750c00b390 comp rx=0 tx=0).stop 2024-09-10T22:17:26.554 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 -- 172.21.15.5:0/2279921546 shutdown_connections 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556decfd470 0x5556decfa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decee110 0x5556decfa2e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 --2- 172.21.15.5:0/2279921546 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556deced7d0 0x5556decf9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 -- 172.21.15.5:0/2279921546 >> 172.21.15.5:0/2279921546 conn(0x5556decea930 msgr2=0x5556decf8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 -- 172.21.15.5:0/2279921546 shutdown_connections 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.548+0000 7f752707b740 1 -- 172.21.15.5:0/2279921546 wait complete. 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.549+0000 7f752707b740 1 -- start start 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.549+0000 7f752707b740 1 Processor -- start 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.549+0000 7f752707b740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556ded08e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.549+0000 7f752707b740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556ded07b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.555 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.549+0000 7f752707b740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556ded08050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556ded08050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556ded08050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:51842/0 (socket says 172.21.15.5:51842) 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 -- 172.21.15.5:0/1102448127 learned_addr learned my addr 172.21.15.5:0/1102448127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1a61b0 con 0x5556decfd470 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1a7620 con 0x5556decee110 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f751c1a6880 con 0x5556deced7d0 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f752176e640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556ded07b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.556 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556ded08e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 -- 172.21.15.5:0/1102448127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 msgr2=0x5556ded08e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556ded08e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 -- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 msgr2=0x5556ded07b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556ded07b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ded08590 con 0x5556decfd470 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f752707b740 10 client.0 _ll_register_callbacks cb 0x7f750c00bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:26.557 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f7522770640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556ded08050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7514009620 tx=0x7f751404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1f8f3c876e2b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.550+0000 7f75057fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f750c010de0 con 0x5556decfd470 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f75057fa640 1 -- 172.21.15.5:0/1102448127 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75140309e0 con 0x5556decfd470 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f75057fa640 1 -- 172.21.15.5:0/1102448127 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f751402e040 con 0x5556decfd470 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f75057fa640 1 -- 172.21.15.5:0/1102448127 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7514030b80 con 0x5556decfd470 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 10 client.15408 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5556ded07250 con 0x5556decfd470 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f75057fa640 1 -- 172.21.15.5:0/1102448127 <== mon.0 v2:172.21.15.5:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7514058070 con 0x5556decfd470 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 10 client.15408 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 10 client.15408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 20 client.15408 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:26.558 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded7bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 4 client.15408 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.551+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f750c010de0 con 0x5556ded0c880 2024-09-10T22:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.552+0000 7f752176e640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded7bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.552+0000 7f752176e640 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded7bb80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6495a22f25409e01 server_cookie=7cafeca910f6eda4 in_seq=0 out_seq=0 2024-09-10T22:17:26.559 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.552+0000 7f75057fa640 10 client.15408 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.556+0000 7f75057fa640 1 -- 172.21.15.5:0/1102448127 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f750c010de0 con 0x5556ded0c880 2024-09-10T22:17:26.560 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.556+0000 7f75057fa640 10 client.15408 handle_command_reply: tid=0 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.556+0000 7f752707b740 1 client.15408 shutdown 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.556+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 msgr2=0x5556ded08050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.556+0000 7f752707b740 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556ded08050 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f7514009620 tx=0x7f751404c000 comp rx=0 tx=0).stop 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 shutdown_connections 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5556ded0c880 0x5556ded7bb80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f75057fa640 0 client.15408 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5556decfd470 0x5556ded08050 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.561 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5556decee110 0x5556ded07b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 --2- 172.21.15.5:0/1102448127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5556deced7d0 0x5556ded08e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 >> 172.21.15.5:0/1102448127 conn(0x5556decea930 msgr2=0x5556decf9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 shutdown_connections 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 1 -- 172.21.15.5:0/1102448127 wait complete. 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f752707b740 20 client.15408 trim_cache size 0 max 16384 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:17:26.562 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f75080b52e0 msgr2=0x7f75080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f75241d3640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f75080b52e0 0x7f75080b77a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75180e2b20 tx=0x7f75180e8ad0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.563 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 msgr2=0x7f751c196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.557+0000 7f75241d3640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 0x7f751c196b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f751800d770 tx=0x7f751800dc30 comp rx=0 tx=0).stop 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 shutdown_connections 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f75080b52e0 0x7f75080b77a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f751c103380 0x7f751c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f751c1029c0 0x7f751c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 --2- 172.21.15.5:0/4287221962 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f751c101870 0x7f751c196b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 >> 172.21.15.5:0/4287221962 conn(0x7f751c0fd110 msgr2=0x7f751c105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 shutdown_connections 2024-09-10T22:17:26.564 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:26.558+0000 7f75241d3640 1 -- 172.21.15.5:0/4287221962 wait complete. 2024-09-10T22:17:27.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:27 smithi005 ceph-mon[31115]: pgmap v364: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T22:17:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:27 smithi189 ceph-mon[35784]: pgmap v364: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T22:17:27.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:27 smithi052 ceph-mon[34997]: pgmap v364: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-10T22:17:29.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:29 smithi005 ceph-mon[31115]: pgmap v365: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:17:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:29 smithi189 ceph-mon[35784]: pgmap v365: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:17:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:29 smithi052 ceph-mon[34997]: pgmap v365: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-10T22:17:31.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:31 smithi005 ceph-mon[31115]: pgmap v366: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T22:17:31.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:31 smithi189 ceph-mon[35784]: pgmap v366: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T22:17:31.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:31 smithi052 ceph-mon[34997]: pgmap v366: 97 pgs: 97 active+clean; 653 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-10T22:17:33.259 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:17:33.569 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:33.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:33 smithi005 ceph-mon[31115]: pgmap v367: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:17:33.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:33 smithi189 ceph-mon[35784]: pgmap v367: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:17:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:33 smithi052 ceph-mon[34997]: pgmap v367: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 -- 172.21.15.5:0/2058758091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 msgr2=0x7fd838102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/2058758091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838102070 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd834009ca0 tx=0x7fd83402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 -- 172.21.15.5:0/2058758091 shutdown_connections 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/2058758091 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd838108020 0x7fd83810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/2058758091 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd8381076a0 0x7fd838107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/2058758091 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838102070 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.092+0000 7fd83ef3a640 1 -- 172.21.15.5:0/2058758091 >> 172.21.15.5:0/2058758091 conn(0x7fd8380fd700 msgr2=0x7fd8380ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.093+0000 7fd83ef3a640 1 -- 172.21.15.5:0/2058758091 shutdown_connections 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.093+0000 7fd83ef3a640 1 -- 172.21.15.5:0/2058758091 wait complete. 2024-09-10T22:17:34.118 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.094+0000 7fd83ef3a640 1 Processor -- start 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.094+0000 7fd83ef3a640 1 -- start start 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.094+0000 7fd83ef3a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ccd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ccd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37926/0 (socket says 172.21.15.5:37926) 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ccd6640 1 -- 172.21.15.5:0/344619360 learned_addr learned my addr 172.21.15.5:0/344619360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8381076a0 0x7fd838198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838108020 0x7fd83819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd838111d30 con 0x7fd838101c90 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd82ffff640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8381076a0 0x7fd838198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd838111bb0 con 0x7fd838108020 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd838111eb0 con 0x7fd8381076a0 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.095+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838108020 0x7fd83819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.119 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83d4d7640 1 -- 172.21.15.5:0/344619360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8381076a0 msgr2=0x7fd838198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8381076a0 0x7fd838198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83d4d7640 1 -- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 msgr2=0x7fd838198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83d4d7640 1 -- 172.21.15.5:0/344619360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83819e2b0 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838108020 0x7fd83819dae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d6b0 tx=0x7fd83000db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.096+0000 7fd82dffb640 1 -- 172.21.15.5:0/344619360 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830016070 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.097+0000 7fd82dffb640 1 -- 172.21.15.5:0/344619360 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd830009cd0 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.097+0000 7fd82dffb640 1 -- 172.21.15.5:0/344619360 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830003c50 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.097+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd83819e5a0 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.097+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd83806aab0 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.101+0000 7fd82dffb640 1 -- 172.21.15.5:0/344619360 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd830009820 con 0x7fd838108020 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.101+0000 7fd84130f740 1 Processor -- start 2024-09-10T22:17:34.120 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.101+0000 7fd84130f740 1 -- start start 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd84130f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afc1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd82dffb640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8200b5360 0x7fd8200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd84130f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afcd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd82dffb640 1 -- 172.21.15.5:0/344619360 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd8300e72c0 con 0x7fd838108020 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd84130f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 0x55931afd0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd84130f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55931af33e50 con 0x55931afcdd60 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd84130f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55931af23280 con 0x55931afc1dd0 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd84130f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55931af27090 con 0x55931afc14b0 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd83d4d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 0x55931afd0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd83d4d7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 0x55931afd0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37940/0 (socket says 172.21.15.5:37940) 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd83d4d7640 1 -- 172.21.15.5:0/4276198752 learned_addr learned my addr 172.21.15.5:0/4276198752 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.102+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8200b5360 0x7fd8200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.121 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd82ffff640 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afc1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd82ffff640 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afcd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8200b5360 0x7fd8200b7820 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd834000f80 tx=0x7fd834005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd83d4d7640 1 -- 172.21.15.5:0/4276198752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 msgr2=0x55931afc1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afc1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd83d4d7640 1 -- 172.21.15.5:0/4276198752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 msgr2=0x55931afcd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afcd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.103+0000 7fd83d4d7640 1 -- 172.21.15.5:0/4276198752 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931ac81650 con 0x55931afcdd60 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.104+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 0x55931afd0150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd8300aad20 tx=0x7fd8300a9950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cd89fb5307f64d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.104+0000 7fd81effd640 1 -- 172.21.15.5:0/4276198752 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8300ad220 con 0x55931afcdd60 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.104+0000 7fd81effd640 1 -- 172.21.15.5:0/4276198752 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8300ad5c0 con 0x55931afcdd60 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.104+0000 7fd81effd640 1 -- 172.21.15.5:0/4276198752 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8300b7040 con 0x55931afcdd60 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 -- 172.21.15.5:0/4276198752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 msgr2=0x55931afd0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 0x55931afd0150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd8300aad20 tx=0x7fd8300a9950 comp rx=0 tx=0).stop 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 -- 172.21.15.5:0/4276198752 shutdown_connections 2024-09-10T22:17:34.122 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afcdd60 0x55931afd0150 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afcd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 --2- 172.21.15.5:0/4276198752 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afc1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 -- 172.21.15.5:0/4276198752 >> 172.21.15.5:0/4276198752 conn(0x55931afbf2e0 msgr2=0x55931afc0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 -- 172.21.15.5:0/4276198752 shutdown_connections 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 -- 172.21.15.5:0/4276198752 wait complete. 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 -- start start 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.105+0000 7fd84130f740 1 Processor -- start 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc14b0 0x55931afcd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afcd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afc6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.123 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55931ad84700 con 0x55931afc1dd0 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55931aebe110 con 0x55931afc14b0 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55931afd09e0 con 0x55931afcdd60 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afcd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afcd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37952/0 (socket says 172.21.15.5:37952) 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 -- 172.21.15.5:0/3667247360 learned_addr learned my addr 172.21.15.5:0/3667247360 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd84130f740 10 client.0 _ll_register_callbacks cb 0x55931aed7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc14b0 0x55931afcd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afc6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 -- 172.21.15.5:0/3667247360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 msgr2=0x55931afc6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afc6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 -- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc14b0 msgr2=0x55931afcd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc14b0 0x55931afcd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 -- 172.21.15.5:0/3667247360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931aeebc40 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc14b0 0x55931afcd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afc6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afcd7d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd82800bf00 tx=0x7fd828012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8345c0c0a3f899b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.106+0000 7fd817fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd817fff640 1 -- 172.21.15.5:0/3667247360 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828010690 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd817fff640 1 -- 172.21.15.5:0/3667247360 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd828010830 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8300ad5c0 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd817fff640 1 -- 172.21.15.5:0/3667247360 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd828010a30 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 10 client.15420 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55931afd0d10 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd817fff640 1 -- 172.21.15.5:0/3667247360 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8300ad5c0 con 0x55931afc1dd0 2024-09-10T22:17:34.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd817fff640 1 -- 172.21.15.5:0/3667247360 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd82802f420 con 0x55931afc1dd0 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 10 client.15420 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 20 client.15420 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931afd21e0 0x55931afd4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 4 client.15420 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.107+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55931af35da0 con 0x55931afd21e0 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.109+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931afd21e0 0x55931afd4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.109+0000 7fd817fff640 10 client.15420 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.109+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931afd21e0 0x55931afd4620 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9720b6076cd7d66 server_cookie=b14e0b2cb049c36c in_seq=0 out_seq=0 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd817fff640 1 -- 172.21.15.5:0/3667247360 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55931af35da0 con 0x55931afd21e0 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd817fff640 10 client.15420 handle_command_reply: tid=0 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 client.15420 shutdown 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 msgr2=0x55931afcd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afcd7d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fd82800bf00 tx=0x7fd828012820 comp rx=0 tx=0).stop 2024-09-10T22:17:34.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 shutdown_connections 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931afd21e0 0x55931afd4620 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afc6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afcd7d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd817fff640 0 client.15420 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 --2- 172.21.15.5:0/3667247360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc14b0 0x55931afcd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 >> 172.21.15.5:0/3667247360 conn(0x55931afbf2e0 msgr2=0x55931afc4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 shutdown_connections 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 1 -- 172.21.15.5:0/3667247360 wait complete. 2024-09-10T22:17:34.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.110+0000 7fd84130f740 20 client.15420 trim_cache size 0 max 16384 2024-09-10T22:17:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.129+0000 7fd84130f740 1 Processor -- start 2024-09-10T22:17:34.130 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.129+0000 7fd84130f740 1 -- start start 2024-09-10T22:17:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.129+0000 7fd84130f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afbe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.129+0000 7fd84130f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afbe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd84130f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afcdd60 0x55931afbfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd84130f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd8381aea10 con 0x55931afc1dd0 2024-09-10T22:17:34.131 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd84130f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8381ac2e0 con 0x55931afcdd60 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd84130f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8381aa130 con 0x55931afc14b0 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afbe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afbe970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37954/0 (socket says 172.21.15.5:37954) 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 -- 172.21.15.5:0/3624104531 learned_addr learned my addr 172.21.15.5:0/3624104531 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afcdd60 0x55931afbfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afbe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 -- 172.21.15.5:0/3624104531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 msgr2=0x55931afbe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afbe430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 -- 172.21.15.5:0/3624104531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afcdd60 msgr2=0x55931afbfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afcdd60 0x55931afbfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.130+0000 7fd82ffff640 1 -- 172.21.15.5:0/3624104531 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55931afcce40 con 0x55931afc1dd0 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.131+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afbe970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd82802f890 tx=0x7fd82800bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28cb1c2dba593d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.131+0000 7fd81e7fc640 1 -- 172.21.15.5:0/3624104531 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82804b070 con 0x55931afc1dd0 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.131+0000 7fd81e7fc640 1 -- 172.21.15.5:0/3624104531 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd828029030 con 0x55931afc1dd0 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.131+0000 7fd81e7fc640 1 -- 172.21.15.5:0/3624104531 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82803b6c0 con 0x55931afc1dd0 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 -- 172.21.15.5:0/3624104531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 msgr2=0x55931afbe970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afbe970 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd82802f890 tx=0x7fd82800bb20 comp rx=0 tx=0).stop 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 -- 172.21.15.5:0/3624104531 shutdown_connections 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afcdd60 0x55931afbfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc1dd0 0x55931afbe970 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 --2- 172.21.15.5:0/3624104531 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afc14b0 0x55931afbe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 -- 172.21.15.5:0/3624104531 >> 172.21.15.5:0/3624104531 conn(0x55931afbf2e0 msgr2=0x55931afbade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 -- 172.21.15.5:0/3624104531 shutdown_connections 2024-09-10T22:17:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.132+0000 7fd84130f740 1 -- 172.21.15.5:0/3624104531 wait complete. 2024-09-10T22:17:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 -- start start 2024-09-10T22:17:34.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 Processor -- start 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 0x55931afe3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afe3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd83ccd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 0x55931afe3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd83ccd6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 0x55931afe3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37970/0 (socket says 172.21.15.5:37970) 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd83ccd6640 1 -- 172.21.15.5:0/3704515876 learned_addr learned my addr 172.21.15.5:0/3704515876 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afe4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd8381aa7a0 con 0x55931afc14b0 2024-09-10T22:17:34.137 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd8381abc10 con 0x55931afc1dd0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.133+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd8381aae70 con 0x55931afcdd60 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd84130f740 10 client.0 _ll_register_callbacks cb 0x7fd82800bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afe3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83d4d7640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afe4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83ccd6640 1 -- 172.21.15.5:0/3704515876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 msgr2=0x55931afe4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afe4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83ccd6640 1 -- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 msgr2=0x55931afe3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afe3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83ccd6640 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55931b045af0 con 0x55931afc14b0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd83ccd6640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 0x55931afe3800 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd834009a60 tx=0x7fd83402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e905dff5611e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.134+0000 7fd817fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd817fff640 1 -- 172.21.15.5:0/3704515876 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83405e060 con 0x55931afc14b0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd817fff640 1 -- 172.21.15.5:0/3704515876 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd834004040 con 0x55931afc14b0 2024-09-10T22:17:34.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd828029030 con 0x55931afc14b0 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd817fff640 1 -- 172.21.15.5:0/3704515876 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd834004240 con 0x55931afc14b0 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd84130f740 10 client.15426 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55931b046dc0 con 0x55931afc14b0 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.135+0000 7fd817fff640 1 -- 172.21.15.5:0/3704515876 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd828029030 con 0x55931afc14b0 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd817fff640 1 -- 172.21.15.5:0/3704515876 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd834044040 con 0x55931afc14b0 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd84130f740 10 client.15426 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd84130f740 10 client.15426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd84130f740 20 client.15426 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931b047520 0x55931b049940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd84130f740 4 client.15426 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55931af31850 con 0x55931b047520 2024-09-10T22:17:34.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931b047520 0x55931b049940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.136+0000 7fd817fff640 10 client.15426 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd82ffff640 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931b047520 0x55931b049940 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4619419aafe054a9 server_cookie=705087802c9f6673 in_seq=0 out_seq=0 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd817fff640 1 -- 172.21.15.5:0/3704515876 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x55931af31850 con 0x55931b047520 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd817fff640 10 client.15426 handle_command_reply: tid=0 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd84130f740 1 client.15426 shutdown 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 msgr2=0x55931afe3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 0x55931afe3800 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd834009a60 tx=0x7fd83402a8c0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 shutdown_connections 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.137+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55931b047520 0x55931b049940 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55931afcdd60 0x55931afe4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd817fff640 0 client.15426 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55931afc1dd0 0x55931afe3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 1 --2- 172.21.15.5:0/3704515876 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55931afc14b0 0x55931afe3800 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 >> 172.21.15.5:0/3704515876 conn(0x55931afbf2e0 msgr2=0x55931afbfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 shutdown_connections 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 1 -- 172.21.15.5:0/3704515876 wait complete. 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.138+0000 7fd84130f740 20 client.15426 trim_cache size 0 max 16384 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-09-10T22:17:34.142 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:34.143 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:17:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8200b5360 msgr2=0x7fd8200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.144 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8200b5360 0x7fd8200b7820 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd834000f80 tx=0x7fd834005d80 comp rx=0 tx=0).stop 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838108020 msgr2=0x7fd83819dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838108020 0x7fd83819dae0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd83000d6b0 tx=0x7fd83000db70 comp rx=0 tx=0).stop 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 shutdown_connections 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8200b5360 0x7fd8200b7820 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd838108020 0x7fd83819dae0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd8381076a0 0x7fd838198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 --2- 172.21.15.5:0/344619360 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd838101c90 0x7fd838198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 >> 172.21.15.5:0/344619360 conn(0x7fd8380fd700 msgr2=0x7fd8380ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 shutdown_connections 2024-09-10T22:17:34.145 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:34.139+0000 7fd83ef3a640 1 -- 172.21.15.5:0/344619360 wait complete. 2024-09-10T22:17:34.792 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:17:34.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:17:35.110 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:35.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:35 smithi005 ceph-mon[31115]: pgmap v368: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:17:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 -- 172.21.15.5:0/3623558671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 msgr2=0x7f329010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:35.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 --2- 172.21.15.5:0/3623558671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329010f560 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3288009ca0 tx=0x7f328802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 -- 172.21.15.5:0/3623558671 shutdown_connections 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 --2- 172.21.15.5:0/3623558671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329010f560 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 --2- 172.21.15.5:0/3623558671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f32901045c0 0x7f329010cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 --2- 172.21.15.5:0/3623558671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3290103ca0 0x7f3290104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 -- 172.21.15.5:0/3623558671 >> 172.21.15.5:0/3623558671 conn(0x7f32900fd700 msgr2=0x7f32900ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 -- 172.21.15.5:0/3623558671 shutdown_connections 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.592+0000 7f3298422640 1 -- 172.21.15.5:0/3623558671 wait complete. 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.593+0000 7f3298422640 1 Processor -- start 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.593+0000 7f3298422640 1 -- start start 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f3298422640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3290103ca0 0x7f329010bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:35.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f3298422640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32901045c0 0x7f329010c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f3298422640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f3298422640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112d70 con 0x7f329010d100 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f3298422640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112bf0 con 0x7f3290103ca0 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f3298422640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3290112ef0 con 0x7f32901045c0 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329019fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37990/0 (socket says 172.21.15.5:37990) 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 -- 172.21.15.5:0/3778457904 learned_addr learned my addr 172.21.15.5:0/3778457904 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32959bd640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32901045c0 0x7f329010c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32961be640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3290103ca0 0x7f329010bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 -- 172.21.15.5:0/3778457904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32901045c0 msgr2=0x7f329010c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32901045c0 0x7f329010c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 -- 172.21.15.5:0/3778457904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3290103ca0 msgr2=0x7f329010bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3290103ca0 0x7f329010bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32969bf640 1 -- 172.21.15.5:0/3778457904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32901a02f0 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.594+0000 7f32959bd640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32901045c0 0x7f329010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.595+0000 7f32969bf640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329019fb70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3288005cc0 tx=0x7f328802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.595+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3288003bf0 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.595+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32901a0580 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.595+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3288003d90 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.595+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328802fbc0 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.595+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3290199980 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.596+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3290104080 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.598+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3288004610 con 0x7f329010d100 2024-09-10T22:17:35.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.599+0000 7f32877fe640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f327c0b5360 0x7f327c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.599+0000 7f32961be640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f327c0b5360 0x7f327c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.599+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3288104d00 con 0x7f329010d100 2024-09-10T22:17:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.600+0000 7f32961be640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f327c0b5360 0x7f327c0b7820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f328c005fd0 tx=0x7f328c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:35.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.602+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f32880ce040 con 0x7f329010d100 2024-09-10T22:17:35.695 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:35 smithi189 ceph-mon[35784]: pgmap v368: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:17:35.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:35 smithi052 ceph-mon[34997]: pgmap v368: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:17:35.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.848+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3290198260 con 0x7f329010d100 2024-09-10T22:17:35.854 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.849+0000 7f32877fe640 1 -- 172.21.15.5:0/3778457904 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f3290198260 con 0x7f329010d100 2024-09-10T22:17:35.857 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:17:35.857 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:17:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:17:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f327c0b5360 msgr2=0x7f327c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f327c0b5360 0x7f327c0b7820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f328c005fd0 tx=0x7f328c00b390 comp rx=0 tx=0).stop 2024-09-10T22:17:35.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 msgr2=0x7f329019fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329019fb70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3288005cc0 tx=0x7f328802f380 comp rx=0 tx=0).stop 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 shutdown_connections 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f327c0b5360 0x7f327c0b7820 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f329010d100 0x7f329019fb70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f32901045c0 0x7f329010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 --2- 172.21.15.5:0/3778457904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3290103ca0 0x7f329010bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 >> 172.21.15.5:0/3778457904 conn(0x7f32900fd700 msgr2=0x7f329010f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 shutdown_connections 2024-09-10T22:17:35.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:35.851+0000 7f3298422640 1 -- 172.21.15.5:0/3778457904 wait complete. 2024-09-10T22:17:36.515 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:36 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3778457904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:17:36.556 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:17:36.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:36 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3778457904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:17:36.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:36 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3778457904' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:17:36.844 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 -- 172.21.15.5:0/918392976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 msgr2=0x7fd82c102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 --2- 172.21.15.5:0/918392976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c102070 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd828009900 tx=0x7fd82802a410 comp rx=0 tx=0).stop 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 -- 172.21.15.5:0/918392976 shutdown_connections 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 --2- 172.21.15.5:0/918392976 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd82c108020 0x7fd82c10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 --2- 172.21.15.5:0/918392976 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd82c1076a0 0x7fd82c107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 --2- 172.21.15.5:0/918392976 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c102070 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 -- 172.21.15.5:0/918392976 >> 172.21.15.5:0/918392976 conn(0x7fd82c0fd700 msgr2=0x7fd82c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:37.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 -- 172.21.15.5:0/918392976 shutdown_connections 2024-09-10T22:17:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.301+0000 7fd833d19640 1 -- 172.21.15.5:0/918392976 wait complete. 2024-09-10T22:17:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.302+0000 7fd833d19640 1 Processor -- start 2024-09-10T22:17:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.302+0000 7fd833d19640 1 -- start start 2024-09-10T22:17:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd833d19640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c110c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd833d19640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd82c1076a0 0x7fd82c10f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd833d19640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd82c108020 0x7fd82c10f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c110c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd833d19640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c112e00 con 0x7fd82c101c90 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c110c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38004/0 (socket says 172.21.15.5:38004) 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 -- 172.21.15.5:0/2096120561 learned_addr learned my addr 172.21.15.5:0/2096120561 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c112c80 con 0x7fd82c1076a0 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c112f80 con 0x7fd82c108020 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd8312b4640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd82c1076a0 0x7fd82c10f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 -- 172.21.15.5:0/2096120561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd82c108020 msgr2=0x7fd82c10f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd82c108020 0x7fd82c10f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 -- 172.21.15.5:0/2096120561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd82c1076a0 msgr2=0x7fd82c10f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd82c1076a0 0x7fd82c10f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.303+0000 7fd831ab5640 1 -- 172.21.15.5:0/2096120561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c1abc10 con 0x7fd82c101c90 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.304+0000 7fd831ab5640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c110c30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ab0 tx=0x7fd828003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.304+0000 7fd822ffd640 1 -- 172.21.15.5:0/2096120561 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82803f070 con 0x7fd82c101c90 2024-09-10T22:17:37.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.304+0000 7fd822ffd640 1 -- 172.21.15.5:0/2096120561 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd828031d60 con 0x7fd82c101c90 2024-09-10T22:17:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.304+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c1abde0 con 0x7fd82c101c90 2024-09-10T22:17:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.304+0000 7fd822ffd640 1 -- 172.21.15.5:0/2096120561 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828035030 con 0x7fd82c101c90 2024-09-10T22:17:37.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.304+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c1ac1d0 con 0x7fd82c101c90 2024-09-10T22:17:37.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.307+0000 7fd822ffd640 1 -- 172.21.15.5:0/2096120561 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd82803b580 con 0x7fd82c101c90 2024-09-10T22:17:37.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.308+0000 7fd8360ee740 1 Processor -- start 2024-09-10T22:17:37.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.308+0000 7fd822ffd640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8180b5360 0x7fd8180b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.308+0000 7fd822ffd640 1 -- 172.21.15.5:0/2096120561 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd8281068a0 con 0x7fd82c101c90 2024-09-10T22:17:37.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.308+0000 7fd8322b6640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8180b5360 0x7fd8180b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.308+0000 7fd8360ee740 1 -- start start 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e3fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e406840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e409170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8360ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55729e370ea0 con 0x55729e3fa4d0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8360ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55729e3602d0 con 0x55729e3fadf0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8360ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55729e3640e0 con 0x55729e406d80 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8322b6640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8180b5360 0x7fd8180b7820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd8240092f0 tx=0x7fd824009220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e3fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e3fa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38018/0 (socket says 172.21.15.5:38018) 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 -- 172.21.15.5:0/3552652419 learned_addr learned my addr 172.21.15.5:0/3552652419 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8322b6640 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e409170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd8312b4640 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e406840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 -- 172.21.15.5:0/3552652419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 msgr2=0x55729e409170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.311 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e409170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 -- 172.21.15.5:0/3552652419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 msgr2=0x55729e406840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e406840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.312 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.309+0000 7fd831ab5640 1 -- 172.21.15.5:0/3552652419 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729e0be650 con 0x55729e3fa4d0 2024-09-10T22:17:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.310+0000 7fd831ab5640 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e3fa8b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd828005e60 tx=0x7fd828031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e14eb4be6adb9c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.310+0000 7fd817fff640 1 -- 172.21.15.5:0/3552652419 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828049070 con 0x55729e3fa4d0 2024-09-10T22:17:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.310+0000 7fd817fff640 1 -- 172.21.15.5:0/3552652419 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8280b2e50 con 0x55729e3fa4d0 2024-09-10T22:17:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.310+0000 7fd817fff640 1 -- 172.21.15.5:0/3552652419 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280cd4f0 con 0x55729e3fa4d0 2024-09-10T22:17:37.313 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 -- 172.21.15.5:0/3552652419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 msgr2=0x55729e3fa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e3fa8b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd828005e60 tx=0x7fd828031400 comp rx=0 tx=0).stop 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 -- 172.21.15.5:0/3552652419 shutdown_connections 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e409170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e406840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 --2- 172.21.15.5:0/3552652419 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e3fa8b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.311+0000 7fd8360ee740 1 -- 172.21.15.5:0/3552652419 >> 172.21.15.5:0/3552652419 conn(0x55729e3f8300 msgr2=0x55729e3f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.312+0000 7fd8360ee740 1 -- 172.21.15.5:0/3552652419 shutdown_connections 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.312+0000 7fd8360ee740 1 -- 172.21.15.5:0/3552652419 wait complete. 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.312+0000 7fd8360ee740 1 -- start start 2024-09-10T22:17:37.314 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.312+0000 7fd8360ee740 1 Processor -- start 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fa4d0 0x55729e4066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fadf0 0x55729e403b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e404180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55729e1c1700 con 0x55729e3fadf0 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55729e2fb160 con 0x55729e406d80 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55729e4097c0 con 0x55729e3fa4d0 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8360ee740 10 client.0 _ll_register_callbacks cb 0x55729e3149e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e404180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e404180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49188/0 (socket says 172.21.15.5:49188) 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 -- 172.21.15.5:0/845680441 learned_addr learned my addr 172.21.15.5:0/845680441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd831ab5640 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fa4d0 0x55729e4066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 -- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fa4d0 msgr2=0x55729e4066b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.317 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fa4d0 0x55729e4066b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 -- 172.21.15.5:0/845680441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fadf0 msgr2=0x55729e403b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fadf0 0x55729e403b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 -- 172.21.15.5:0/845680441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729e328c90 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8322b6640 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e404180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd824011c30 tx=0x7fd824004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f45063bbc25979b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.313+0000 7fd8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8157fa640 1 -- 172.21.15.5:0/845680441 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824011c60 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8157fa640 1 -- 172.21.15.5:0/845680441 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd824011e00 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8280b2e50 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8157fa640 1 -- 172.21.15.5:0/845680441 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd82402e070 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8360ee740 10 client.25067 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55729e415110 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.314+0000 7fd8157fa640 1 -- 172.21.15.5:0/845680441 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8280b2e50 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8157fa640 1 -- 172.21.15.5:0/845680441 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd82400f040 con 0x55729e406d80 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8360ee740 10 client.25067 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:37.318 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8360ee740 10 client.25067 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8360ee740 20 client.25067 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8360ee740 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e416670 0x55729e418aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8360ee740 4 client.25067 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55729e372df0 con 0x55729e416670 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.315+0000 7fd831ab5640 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e416670 0x55729e418aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.316+0000 7fd8157fa640 10 client.25067 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:17:37.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.316+0000 7fd831ab5640 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e416670 0x55729e418aa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85c15e769d3e467f server_cookie=a03dbf206aa950ce in_seq=0 out_seq=0 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.316+0000 7fd8157fa640 1 -- 172.21.15.5:0/845680441 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55729e372df0 con 0x55729e416670 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.316+0000 7fd8157fa640 10 client.25067 handle_command_reply: tid=0 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.316+0000 7fd8360ee740 1 client.25067 shutdown 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 msgr2=0x55729e404180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e404180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd824011c30 tx=0x7fd824004a40 comp rx=0 tx=0).stop 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 shutdown_connections 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e416670 0x55729e418aa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.320 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e404180 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fadf0 0x55729e403b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8157fa640 0 client.25067 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 --2- 172.21.15.5:0/845680441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fa4d0 0x55729e4066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 >> 172.21.15.5:0/845680441 conn(0x55729e3f8300 msgr2=0x55729e3fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 shutdown_connections 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 1 -- 172.21.15.5:0/845680441 wait complete. 2024-09-10T22:17:37.321 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.317+0000 7fd8360ee740 20 client.25067 trim_cache size 0 max 16384 2024-09-10T22:17:37.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.343+0000 7fd8360ee740 1 Processor -- start 2024-09-10T22:17:37.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.343+0000 7fd8360ee740 1 -- start start 2024-09-10T22:17:37.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e4129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fadf0 0x55729e405840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e408170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8360ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b7280 con 0x55729e3fa4d0 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8360ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b4b50 con 0x55729e406d80 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8360ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b29a0 con 0x55729e3fadf0 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8312b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fadf0 0x55729e405840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e4129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8312b4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fadf0 0x55729e405840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:39704/0 (socket says 172.21.15.5:39704) 2024-09-10T22:17:37.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8312b4640 1 -- 172.21.15.5:0/1207338627 learned_addr learned my addr 172.21.15.5:0/1207338627 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd8322b6640 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e408170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd831ab5640 1 -- 172.21.15.5:0/1207338627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fadf0 msgr2=0x55729e405840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd831ab5640 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fadf0 0x55729e405840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd831ab5640 1 -- 172.21.15.5:0/1207338627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 msgr2=0x55729e408170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd831ab5640 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e408170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.344+0000 7fd831ab5640 1 -- 172.21.15.5:0/1207338627 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729e406a20 con 0x55729e3fa4d0 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.345+0000 7fd831ab5640 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e4129b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ec0 tx=0x7fd828009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ab29a2d9cbddc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.345+0000 7fd8177fe640 1 -- 172.21.15.5:0/1207338627 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828049040 con 0x55729e3fa4d0 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.345+0000 7fd8177fe640 1 -- 172.21.15.5:0/1207338627 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8280b2e50 con 0x55729e3fa4d0 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.345+0000 7fd8177fe640 1 -- 172.21.15.5:0/1207338627 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8280cd4d0 con 0x55729e3fa4d0 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 -- 172.21.15.5:0/1207338627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 msgr2=0x55729e4129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e4129b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ec0 tx=0x7fd828009260 comp rx=0 tx=0).stop 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 -- 172.21.15.5:0/1207338627 shutdown_connections 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e406d80 0x55729e408170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e3fadf0 0x55729e405840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 --2- 172.21.15.5:0/1207338627 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e4129b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 -- 172.21.15.5:0/1207338627 >> 172.21.15.5:0/1207338627 conn(0x55729e3f8300 msgr2=0x55729e405130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 -- 172.21.15.5:0/1207338627 shutdown_connections 2024-09-10T22:17:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 -- 172.21.15.5:0/1207338627 wait complete. 2024-09-10T22:17:37.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 -- start start 2024-09-10T22:17:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.346+0000 7fd8360ee740 1 Processor -- start 2024-09-10T22:17:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e40ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e40f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e4099d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b3010 con 0x55729e3fa4d0 2024-09-10T22:17:37.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b4480 con 0x55729e3fadf0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b36e0 con 0x55729e406d80 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8360ee740 10 client.0 _ll_register_callbacks cb 0x7fd8240118e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e40ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e40ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38042/0 (socket says 172.21.15.5:38042) 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 -- 172.21.15.5:0/2292120557 learned_addr learned my addr 172.21.15.5:0/2292120557 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8312b4640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e40f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd8322b6640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e4099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 -- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 msgr2=0x55729e4099d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e4099d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 -- 172.21.15.5:0/2292120557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 msgr2=0x55729e40f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e40f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.347+0000 7fd831ab5640 1 -- 172.21.15.5:0/2292120557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729e40a0c0 con 0x55729e3fa4d0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd831ab5640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e40ec00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd828005c20 tx=0x7fd82802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ea7d90a80d4f5a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:37.351 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8157fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8157fa640 1 -- 172.21.15.5:0/2292120557 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd828049070 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8157fa640 1 -- 172.21.15.5:0/2292120557 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd8280cd490 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8280b2e50 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8157fa640 1 -- 172.21.15.5:0/2292120557 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd8280d65c0 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8360ee740 10 client.15447 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55729e483f70 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.348+0000 7fd8157fa640 1 -- 172.21.15.5:0/2292120557 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8280b2e50 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8157fa640 1 -- 172.21.15.5:0/2292120557 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd828031a40 con 0x55729e3fa4d0 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8360ee740 10 client.15447 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8360ee740 10 client.15447 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8360ee740 20 client.15447 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8360ee740 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e484240 0x55729e486660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8360ee740 4 client.15447 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:17:37.352 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55729e36e8a0 con 0x55729e484240 2024-09-10T22:17:37.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8312b4640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e484240 0x55729e486660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:37.353 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8157fa640 10 client.15447 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.349+0000 7fd8312b4640 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e484240 0x55729e486660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=968748ac3d4dad50 server_cookie=3e40d7302cdcc8ad in_seq=0 out_seq=0 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8157fa640 1 -- 172.21.15.5:0/2292120557 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55729e36e8a0 con 0x55729e484240 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8157fa640 10 client.15447 handle_command_reply: tid=0 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 client.15447 shutdown 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 msgr2=0x55729e40ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e40ec00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd828005c20 tx=0x7fd82802a410 comp rx=0 tx=0).stop 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 shutdown_connections 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55729e406d80 0x55729e4099d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55729e484240 0x55729e486660 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8157fa640 0 client.15447 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55729e3fadf0 0x55729e40f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 --2- 172.21.15.5:0/2292120557 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55729e3fa4d0 0x55729e40ec00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.354 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 >> 172.21.15.5:0/2292120557 conn(0x55729e3f8300 msgr2=0x55729e405950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 shutdown_connections 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 1 -- 172.21.15.5:0/2292120557 wait complete. 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.350+0000 7fd8360ee740 20 client.15447 trim_cache size 0 max 16384 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8180b5360 msgr2=0x7fd8180b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8180b5360 0x7fd8180b7820 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd8240092f0 tx=0x7fd824009220 comp rx=0 tx=0).stop 2024-09-10T22:17:37.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 msgr2=0x7fd82c110c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c110c30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ab0 tx=0x7fd828003cd0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 shutdown_connections 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd8180b5360 0x7fd8180b7820 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd82c108020 0x7fd82c10f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd82c1076a0 0x7fd82c10f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 --2- 172.21.15.5:0/2096120561 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd82c101c90 0x7fd82c110c30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 >> 172.21.15.5:0/2096120561 conn(0x7fd82c0fd700 msgr2=0x7fd82c0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 shutdown_connections 2024-09-10T22:17:37.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:37.351+0000 7fd833d19640 1 -- 172.21.15.5:0/2096120561 wait complete. 2024-09-10T22:17:37.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:37 smithi005 ceph-mon[31115]: pgmap v369: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:17:37.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:37 smithi189 ceph-mon[35784]: pgmap v369: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:17:37.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:37 smithi052 ceph-mon[34997]: pgmap v369: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:17:38.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:17:38.325 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 -- 172.21.15.5:0/4228740370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 msgr2=0x7fb8a4102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/4228740370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a4102070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb898009900 tx=0x7fb89802a410 comp rx=0 tx=0).stop 2024-09-10T22:17:38.869 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 -- 172.21.15.5:0/4228740370 shutdown_connections 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/4228740370 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8a4108020 0x7fb8a410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/4228740370 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a41076a0 0x7fb8a4107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/4228740370 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a4102070 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 -- 172.21.15.5:0/4228740370 >> 172.21.15.5:0/4228740370 conn(0x7fb8a40fd700 msgr2=0x7fb8a40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.866+0000 7fb8aafcf640 1 -- 172.21.15.5:0/4228740370 shutdown_connections 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.867+0000 7fb8aafcf640 1 -- 172.21.15.5:0/4228740370 wait complete. 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.868+0000 7fb8aafcf640 1 Processor -- start 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.868+0000 7fb8aafcf640 1 -- start start 2024-09-10T22:17:38.870 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.868+0000 7fb8aafcf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a419eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.871 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a419eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a419eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38052/0 (socket says 172.21.15.5:38052) 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/3571928597 learned_addr learned my addr 172.21.15.5:0/3571928597 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8a41076a0 0x7fb8a419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a4108020 0x7fb8a41993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a4111d30 con 0x7fb8a4101c90 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a4111bb0 con 0x7fb8a41076a0 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a4111eb0 con 0x7fb8a4108020 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8a956c640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a4108020 0x7fb8a41993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.869+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8a41076a0 0x7fb8a419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a956c640 1 -- 172.21.15.5:0/3571928597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8a41076a0 msgr2=0x7fb8a419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a956c640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8a41076a0 0x7fb8a419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.872 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a956c640 1 -- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 msgr2=0x7fb8a419eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a956c640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a419eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a956c640 1 -- 172.21.15.5:0/3571928597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a4199c70 con 0x7fb8a4108020 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a956c640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a4108020 0x7fb8a41993b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009fd0 tx=0x7fb89c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a1ffb640 1 -- 172.21.15.5:0/3571928597 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00ce20 con 0x7fb8a4108020 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a1ffb640 1 -- 172.21.15.5:0/3571928597 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb89c005020 con 0x7fb8a4108020 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8a1ffb640 1 -- 172.21.15.5:0/3571928597 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c010690 con 0x7fb8a4108020 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.870+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a4199ea0 con 0x7fb8a4108020 2024-09-10T22:17:38.873 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.871+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a41a5cf0 con 0x7fb8a4108020 2024-09-10T22:17:38.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.874+0000 7fb8ad3a4740 1 Processor -- start 2024-09-10T22:17:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8a1ffb640 1 -- 172.21.15.5:0/3571928597 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb89c020070 con 0x7fb8a4108020 2024-09-10T22:17:38.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 -- start start 2024-09-10T22:17:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2fa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588fe261ea0 con 0x5588fe2f7d80 2024-09-10T22:17:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5588fe2512d0 con 0x5588fe2ebdf0 2024-09-10T22:17:38.877 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.875+0000 7fb8ad3a4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5588fe2550e0 con 0x5588fe2eb4d0 2024-09-10T22:17:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2fa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49220/0 (socket says 172.21.15.5:49220) 2024-09-10T22:17:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/3152165878 learned_addr learned my addr 172.21.15.5:0/3152165878 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a1ffb640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8940b5360 0x7fb8940b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a1ffb640 1 -- 172.21.15.5:0/3571928597 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb89c0e62d0 con 0x7fb8a4108020 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/3152165878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 msgr2=0x5588fe2eb8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eb8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/3152165878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 msgr2=0x5588fe2fa170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a956c640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8940b5360 0x7fb8940b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2fa170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/3152165878 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588fdfaf650 con 0x5588fe2ebdf0 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.876+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.877+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f7840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb898006010 tx=0x7fb898005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f6ecb080810f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.877+0000 7fb88effd640 1 -- 172.21.15.5:0/3152165878 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898040070 con 0x5588fe2ebdf0 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.877+0000 7fb88effd640 1 -- 172.21.15.5:0/3152165878 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8980054d0 con 0x5588fe2ebdf0 2024-09-10T22:17:38.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.877+0000 7fb88effd640 1 -- 172.21.15.5:0/3152165878 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898035040 con 0x5588fe2ebdf0 2024-09-10T22:17:38.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3152165878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 msgr2=0x5588fe2f7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f7840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb898006010 tx=0x7fb898005c00 comp rx=0 tx=0).stop 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8a956c640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8940b5360 0x7fb8940b7820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0ac760 tx=0x7fb89c005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3152165878 shutdown_connections 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2fa170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f7840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3152165878 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3152165878 >> 172.21.15.5:0/3152165878 conn(0x5588fe2e9300 msgr2=0x5588fe2ea4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3152165878 shutdown_connections 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.878+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3152165878 wait complete. 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.879+0000 7fb8ad3a4740 1 -- start start 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.879+0000 7fb8ad3a4740 1 Processor -- start 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.879+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2f5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49226/0 (socket says 172.21.15.5:49226) 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2f5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2f5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38078/0 (socket says 172.21.15.5:38078) 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/3321558617 learned_addr learned my addr 172.21.15.5:0/3321558617 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5588fe0b2700 con 0x5588fe2f7d80 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5588fe1ec160 con 0x5588fe2ebdf0 2024-09-10T22:17:38.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5588fe2fee00 con 0x5588fe2eb4d0 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.880+0000 7fb8ad3a4740 10 client.0 _ll_register_callbacks cb 0x5588fe2059e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3321558617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 msgr2=0x5588fe2f76b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2f76b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 msgr2=0x5588fe2f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588fe219c90 con 0x5588fe2f7d80 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2f5180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb890012a40 tx=0x7fb890012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bacdf917673eff server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb883fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb883fff640 1 -- 172.21.15.5:0/3321558617 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890020060 con 0x5588fe2f7d80 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb883fff640 1 -- 172.21.15.5:0/3321558617 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb890012190 con 0x5588fe2f7d80 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.881+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8980054d0 con 0x5588fe2f7d80 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb883fff640 1 -- 172.21.15.5:0/3321558617 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb89000f8a0 con 0x5588fe2f7d80 2024-09-10T22:17:38.884 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5588fe30a770 con 0x5588fe2f7d80 2024-09-10T22:17:38.885 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb883fff640 1 -- 172.21.15.5:0/3321558617 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8980054d0 con 0x5588fe2f7d80 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb883fff640 1 -- 172.21.15.5:0/3321558617 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8900109d0 con 0x5588fe2f7d80 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 10 client.15459 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 20 client.15459 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe30bbd0 0x5588fe30dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 4 client.15459 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.882+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588fe263df0 con 0x5588fe30bbd0 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.883+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe30bbd0 0x5588fe30dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.886 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.883+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe30bbd0 0x5588fe30dfc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bba2350c3e313b2 server_cookie=4a60eae118365aee in_seq=0 out_seq=0 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.883+0000 7fb883fff640 10 client.15459 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb883fff640 1 -- 172.21.15.5:0/3321558617 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588fe263df0 con 0x5588fe30bbd0 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb883fff640 10 client.15459 handle_command_reply: tid=0 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 client.15459 shutdown 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 msgr2=0x5588fe2f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2f5180 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb890012a40 tx=0x7fb890012f00 comp rx=0 tx=0).stop 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 shutdown_connections 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe30bbd0 0x5588fe30dfc0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb883fff640 0 client.15459 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f7d80 0x5588fe2f5180 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3321558617 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.884+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 >> 172.21.15.5:0/3321558617 conn(0x5588fe2e9300 msgr2=0x5588fe2eeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.885+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 shutdown_connections 2024-09-10T22:17:38.887 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.885+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3321558617 wait complete. 2024-09-10T22:17:38.888 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.885+0000 7fb8ad3a4740 20 client.15459 trim_cache size 0 max 16384 2024-09-10T22:17:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.898+0000 7fb8ad3a4740 1 Processor -- start 2024-09-10T22:17:38.899 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.898+0000 7fb8ad3a4740 1 -- start start 2024-09-10T22:17:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.898+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2ebdf0 0x5588fe2e8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2f9170 0x5588fe2f9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8ad3a4740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a41ae9c0 con 0x5588fe2eb4d0 2024-09-10T22:17:38.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8ad3a4740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a41ac290 con 0x5588fe2f9170 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8ad3a4740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a41aa0e0 con 0x5588fe2ebdf0 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38082/0 (socket says 172.21.15.5:38082) 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3026877054 learned_addr learned my addr 172.21.15.5:0/3026877054 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2ebdf0 0x5588fe2e8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3026877054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2ebdf0 msgr2=0x5588fe2e8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2ebdf0 0x5588fe2e8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3026877054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2f9170 msgr2=0x5588fe2f9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2f9170 0x5588fe2f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 -- 172.21.15.5:0/3026877054 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588fe2f5dc0 con 0x5588fe2eb4d0 2024-09-10T22:17:38.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2ebdf0 0x5588fe2e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.899+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eaad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8900059f0 tx=0x7fb890009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839f0c3d6f3f132f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:38.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.900+0000 7fb88e7fc640 1 -- 172.21.15.5:0/3026877054 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89002a080 con 0x5588fe2eb4d0 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.900+0000 7fb88e7fc640 1 -- 172.21.15.5:0/3026877054 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb890012190 con 0x5588fe2eb4d0 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.900+0000 7fb88e7fc640 1 -- 172.21.15.5:0/3026877054 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8900054d0 con 0x5588fe2eb4d0 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3026877054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 msgr2=0x5588fe2eaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eaad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8900059f0 tx=0x7fb890009d10 comp rx=0 tx=0).stop 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3026877054 shutdown_connections 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2f9170 0x5588fe2f9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2ebdf0 0x5588fe2e8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/3026877054 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2eb4d0 0x5588fe2eaad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3026877054 >> 172.21.15.5:0/3026877054 conn(0x5588fe2e9300 msgr2=0x5588fe2ea3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3026877054 shutdown_connections 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/3026877054 wait complete. 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 -- start start 2024-09-10T22:17:38.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.901+0000 7fb8ad3a4740 1 Processor -- start 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.902+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2ff0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.902+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2ff620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.902+0000 7fb8ad3a4740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 0x5588fe2ffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.902+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2ff620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.902+0000 7fb8a8d6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2ff620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49240/0 (socket says 172.21.15.5:49240) 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.902+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 0x5588fe2ffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 0x5588fe2ffb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38086/0 (socket says 172.21.15.5:38086) 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/2263337127 learned_addr learned my addr 172.21.15.5:0/2263337127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a41aa750 con 0x5588fe2f9170 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a41abbc0 con 0x5588fe2ebdf0 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a41aae20 con 0x5588fe2eb4d0 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8ad3a4740 10 client.0 _ll_register_callbacks cb 0x7fb890009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/2263337127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 msgr2=0x5588fe2ff0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:38.905 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2ff0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/2263337127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 msgr2=0x5588fe2ffb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 0x5588fe2ffb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a8d6b640 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588fe378bc0 con 0x5588fe2ebdf0 2024-09-10T22:17:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.903+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 0x5588fe2ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb8a8d6b640 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2ff620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb898000c00 tx=0x7fb8980041b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df959d9db0eadf81 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:38.906 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb883fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:17:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb883fff640 1 -- 172.21.15.5:0/2263337127 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898040040 con 0x5588fe2ebdf0 2024-09-10T22:17:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb883fff640 1 -- 172.21.15.5:0/2263337127 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb898004f30 con 0x5588fe2ebdf0 2024-09-10T22:17:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb890012190 con 0x5588fe2ebdf0 2024-09-10T22:17:38.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb883fff640 1 -- 172.21.15.5:0/2263337127 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb898035040 con 0x5588fe2ebdf0 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb8ad3a4740 10 client.25088 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.904+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5588fe379e60 con 0x5588fe2ebdf0 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb883fff640 1 -- 172.21.15.5:0/2263337127 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8980055e0 con 0x5588fe2ebdf0 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb883fff640 1 -- 172.21.15.5:0/2263337127 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb898003b10 con 0x5588fe2ebdf0 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8ad3a4740 10 client.25088 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8ad3a4740 10 client.25088 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8ad3a4740 20 client.25088 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe37a140 0x5588fe37c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8ad3a4740 4 client.25088 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fb890012190 con 0x5588fe37a140 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.905+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe37a140 0x5588fe37c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb883fff640 10 client.25088 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:17:38.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8a3fff640 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe37a140 0x5588fe37c530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3905567db6ce3836 server_cookie=6a700992994a7145 in_seq=0 out_seq=0 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb883fff640 1 -- 172.21.15.5:0/2263337127 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fb890012190 con 0x5588fe37a140 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb883fff640 10 client.25088 handle_command_reply: tid=0 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 client.25088 shutdown 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 msgr2=0x5588fe2ff620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2ff620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb898000c00 tx=0x7fb8980041b0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 shutdown_connections 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5588fe37a140 0x5588fe37c530 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5588fe2f9170 0x5588fe2ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb883fff640 0 client.25088 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5588fe2ebdf0 0x5588fe2ff620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.906+0000 7fb8ad3a4740 1 --2- 172.21.15.5:0/2263337127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5588fe2eb4d0 0x5588fe2ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.907+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 >> 172.21.15.5:0/2263337127 conn(0x5588fe2e9300 msgr2=0x5588fe2ea350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.907+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 shutdown_connections 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.907+0000 7fb8ad3a4740 1 -- 172.21.15.5:0/2263337127 wait complete. 2024-09-10T22:17:38.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.907+0000 7fb8ad3a4740 20 client.25088 trim_cache size 0 max 16384 2024-09-10T22:17:38.911 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:17:38.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8940b5360 msgr2=0x7fb8940b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8940b5360 0x7fb8940b7820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0ac760 tx=0x7fb89c005f70 comp rx=0 tx=0).stop 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a4108020 msgr2=0x7fb8a41993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a4108020 0x7fb8a41993b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009fd0 tx=0x7fb89c00ef10 comp rx=0 tx=0).stop 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 shutdown_connections 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb8940b5360 0x7fb8940b7820 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb8a4108020 0x7fb8a41993b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb8a41076a0 0x7fb8a419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 --2- 172.21.15.5:0/3571928597 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb8a4101c90 0x7fb8a419eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 >> 172.21.15.5:0/3571928597 conn(0x7fb8a40fd700 msgr2=0x7fb8a4105f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.908+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 shutdown_connections 2024-09-10T22:17:38.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:38.909+0000 7fb8aafcf640 1 -- 172.21.15.5:0/3571928597 wait complete. 2024-09-10T22:17:39.558 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:39 smithi005 ceph-mon[31115]: pgmap v370: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:17:39.592 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:17:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:39 smithi189 ceph-mon[35784]: pgmap v370: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 -- 172.21.15.5:0/2693563656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 msgr2=0x7f5794101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 --2- 172.21.15.5:0/2693563656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794101c70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5784009890 tx=0x7f578402a380 comp rx=0 tx=0).stop 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 -- 172.21.15.5:0/2693563656 shutdown_connections 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 --2- 172.21.15.5:0/2693563656 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 0x7f5794109d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 --2- 172.21.15.5:0/2693563656 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 --2- 172.21.15.5:0/2693563656 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794101c70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.701 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 -- 172.21.15.5:0/2693563656 >> 172.21.15.5:0/2693563656 conn(0x7f57940fd150 msgr2=0x7f57940ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.699+0000 7f5799724640 1 -- 172.21.15.5:0/2693563656 shutdown_connections 2024-09-10T22:17:39.702 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.700+0000 7f5799724640 1 -- 172.21.15.5:0/2693563656 wait complete. 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.700+0000 7f5799724640 1 Processor -- start 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.700+0000 7f5799724640 1 -- start start 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5799724640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794105630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5799724640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794103e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5799724640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 0x7f57941043d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5799724640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f579410d4e0 con 0x7f57941029c0 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5799724640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f579410d360 con 0x7f5794103380 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5799724640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f579410d660 con 0x7f5794101870 2024-09-10T22:17:39.704 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f57927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794103e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f57937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 0x7f57941043d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f5792ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794105630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f57937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 0x7f57941043d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49256/0 (socket says 172.21.15.5:49256) 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f57937fe640 1 -- 172.21.15.5:0/2871500019 learned_addr learned my addr 172.21.15.5:0/2871500019 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.701+0000 7f57927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794103e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38108/0 (socket says 172.21.15.5:38108) 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f5792ffd640 1 -- 172.21.15.5:0/2871500019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 msgr2=0x7f57941043d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 0x7f57941043d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f5792ffd640 1 -- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 msgr2=0x7f5794103e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794103e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f5792ffd640 1 -- 172.21.15.5:0/2871500019 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794104c40 con 0x7f5794101870 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f57927fc640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794105630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f578402a8a0 tx=0x7f5784032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f577bfff640 1 -- 172.21.15.5:0/2871500019 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784040020 con 0x7f5794101870 2024-09-10T22:17:39.705 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f577bfff640 1 -- 172.21.15.5:0/2871500019 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5784030d50 con 0x7f5794101870 2024-09-10T22:17:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.702+0000 7f577bfff640 1 -- 172.21.15.5:0/2871500019 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784037040 con 0x7f5794101870 2024-09-10T22:17:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.703+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57941a2e70 con 0x7f5794101870 2024-09-10T22:17:39.706 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.703+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57941a3220 con 0x7f5794101870 2024-09-10T22:17:39.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.706+0000 7f579c5cb740 1 Processor -- start 2024-09-10T22:17:39.707 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.706+0000 7f579c5cb740 1 -- start start 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.706+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 0x55d5ee923460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee925d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9263e0 0x55d5ee9288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f579c5cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d5ee88a6f0 con 0x55d5ee9239a0 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f579c5cb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5ee879b20 con 0x55d5ee9263e0 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f579c5cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5ee87d930 con 0x55d5ee921070 2024-09-10T22:17:39.708 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 0x55d5ee923460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 0x55d5ee923460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:39796/0 (socket says 172.21.15.5:39796) 2024-09-10T22:17:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 -- 172.21.15.5:0/964319823 learned_addr learned my addr 172.21.15.5:0/964319823 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57927fc640 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9263e0 0x55d5ee9288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 -- 172.21.15.5:0/964319823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9263e0 msgr2=0x55d5ee9288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9263e0 0x55d5ee9288a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.709 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 -- 172.21.15.5:0/964319823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 msgr2=0x55d5ee925d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:17:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee925d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.707+0000 7f57937fe640 1 -- 172.21.15.5:0/964319823 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5ee83f530 con 0x55d5ee921070 2024-09-10T22:17:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.708+0000 7f57937fe640 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 0x55d5ee923460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f578c011570 tx=0x7f578c011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2116d78f40e92193 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:39.710 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.708+0000 7f577bfff640 1 -- 172.21.15.5:0/2871500019 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f57840040d0 con 0x7f5794101870 2024-09-10T22:17:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.709+0000 7f57797fa640 1 -- 172.21.15.5:0/964319823 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c004b20 con 0x55d5ee921070 2024-09-10T22:17:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.709+0000 7f57797fa640 1 -- 172.21.15.5:0/964319823 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f578c004cc0 con 0x55d5ee921070 2024-09-10T22:17:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.709+0000 7f57797fa640 1 -- 172.21.15.5:0/964319823 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c005420 con 0x55d5ee921070 2024-09-10T22:17:39.711 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.709+0000 7f577bfff640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f577c0b5360 0x7f577c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.709+0000 7f577bfff640 1 -- 172.21.15.5:0/2871500019 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f5784105770 con 0x7f5794101870 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.709+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f577c0b5360 0x7f577c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f5792ffd640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f577c0b5360 0x7f577c0b7820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f57840044b0 tx=0x7f578402a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 -- 172.21.15.5:0/964319823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 msgr2=0x55d5ee923460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 0x55d5ee923460 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f578c011570 tx=0x7f578c011a30 comp rx=0 tx=0).stop 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 -- 172.21.15.5:0/964319823 shutdown_connections 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9263e0 0x55d5ee9288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee925d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 --2- 172.21.15.5:0/964319823 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee921070 0x55d5ee923460 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 -- 172.21.15.5:0/964319823 >> 172.21.15.5:0/964319823 conn(0x55d5ee91c1c0 msgr2=0x55d5ee91cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 -- 172.21.15.5:0/964319823 shutdown_connections 2024-09-10T22:17:39.712 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.710+0000 7f579c5cb740 1 -- 172.21.15.5:0/964319823 wait complete. 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.711+0000 7f579c5cb740 1 -- start start 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.711+0000 7f579c5cb740 1 Processor -- start 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.711+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee92ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f57937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f57937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49276/0 (socket says 172.21.15.5:49276) 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f57927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee92ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f57927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee92ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38126/0 (socket says 172.21.15.5:38126) 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f57937fe640 1 -- 172.21.15.5:0/896930515 learned_addr learned my addr 172.21.15.5:0/896930515 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee92b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.714 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d5ee7b1ab0 con 0x55d5ee9239a0 2024-09-10T22:17:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d5ee81f730 con 0x55d5ee921070 2024-09-10T22:17:39.715 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.712+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d5ee9293c0 con 0x55d5ee9263e0 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee92b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 -- 172.21.15.5:0/896930515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 msgr2=0x55d5ee92b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee92b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 -- 172.21.15.5:0/896930515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 msgr2=0x55d5ee92ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee92ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5ee5db790 con 0x55d5ee921070 2024-09-10T22:17:39.716 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f579c5cb740 10 client.0 _ll_register_callbacks cb 0x55d5ee8736b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f57937fe640 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a6b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f578c004ff0 tx=0x7f578c004f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec847f20ab5e25a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f5776ff5640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.713+0000 7f5776ff5640 1 -- 172.21.15.5:0/896930515 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c02b020 con 0x55d5ee921070 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.714+0000 7f5776ff5640 1 -- 172.21.15.5:0/896930515 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f578c005330 con 0x55d5ee921070 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.714+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f578c004cc0 con 0x55d5ee921070 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.714+0000 7f5776ff5640 1 -- 172.21.15.5:0/896930515 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f578c005530 con 0x55d5ee921070 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.714+0000 7f579c5cb740 10 client.25100 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.714+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55d5ee654620 con 0x55d5ee921070 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f5776ff5640 1 -- 172.21.15.5:0/896930515 <== mon.2 v2:172.21.15.52:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f578c0056d0 con 0x55d5ee921070 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f579c5cb740 10 client.25100 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f579c5cb740 10 client.25100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f579c5cb740 20 client.25100 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:39.717 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee936180 0x55d5ee938640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f579c5cb740 4 client.25100 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:39.718 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f578c004cc0 con 0x55d5ee936180 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.715+0000 7f57927fc640 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee936180 0x55d5ee938640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.716+0000 7f57927fc640 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee936180 0x55d5ee938640 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5e57b5622760457 server_cookie=2f94019a7d9b3a43 in_seq=0 out_seq=0 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.716+0000 7f5776ff5640 10 client.25100 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.716+0000 7f5776ff5640 1 -- 172.21.15.5:0/896930515 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f578c004cc0 con 0x55d5ee936180 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.716+0000 7f5776ff5640 10 client.25100 handle_command_reply: tid=0 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 client.25100 shutdown 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 msgr2=0x55d5ee92a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a6b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f578c004ff0 tx=0x7f578c004f00 comp rx=0 tx=0).stop 2024-09-10T22:17:39.719 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 shutdown_connections 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee936180 0x55d5ee938640 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee92b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f5776ff5640 0 client.25100 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee92ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 --2- 172.21.15.5:0/896930515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a6b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 >> 172.21.15.5:0/896930515 conn(0x55d5ee91c1c0 msgr2=0x55d5ee923d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 shutdown_connections 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 1 -- 172.21.15.5:0/896930515 wait complete. 2024-09-10T22:17:39.720 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.717+0000 7f579c5cb740 20 client.25100 trim_cache size 0 max 16384 2024-09-10T22:17:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:39 smithi052 ceph-mon[34997]: pgmap v370: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:17:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 Processor -- start 2024-09-10T22:17:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 -- start start 2024-09-10T22:17:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee9204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee920a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57941aa420 con 0x55d5ee9239a0 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57941a7cf0 con 0x55d5ee921070 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f579c5cb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57941a5b80 con 0x55d5ee9263e0 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee9204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57927fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee9204d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38140/0 (socket says 172.21.15.5:38140) 2024-09-10T22:17:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57927fc640 1 -- 172.21.15.5:0/466173314 learned_addr learned my addr 172.21.15.5:0/466173314 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee920a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 -- 172.21.15.5:0/466173314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 msgr2=0x55d5ee920a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee920a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 -- 172.21.15.5:0/466173314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 msgr2=0x55d5ee9204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee9204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.749+0000 7f57937fe640 1 -- 172.21.15.5:0/466173314 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5ee9237d0 con 0x55d5ee921070 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.750+0000 7f57937fe640 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f578c005d70 tx=0x7f578c014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714116570b40b690 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.750+0000 7f5778ff9640 1 -- 172.21.15.5:0/466173314 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c00fe10 con 0x55d5ee921070 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.750+0000 7f5778ff9640 1 -- 172.21.15.5:0/466173314 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f578c0056d0 con 0x55d5ee921070 2024-09-10T22:17:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.750+0000 7f5778ff9640 1 -- 172.21.15.5:0/466173314 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c0279a0 con 0x55d5ee921070 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 -- 172.21.15.5:0/466173314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 msgr2=0x55d5ee92a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a250 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f578c005d70 tx=0x7f578c014040 comp rx=0 tx=0).stop 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 -- 172.21.15.5:0/466173314 shutdown_connections 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee920a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee9239a0 0x55d5ee9204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 --2- 172.21.15.5:0/466173314 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee921070 0x55d5ee92a250 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 -- 172.21.15.5:0/466173314 >> 172.21.15.5:0/466173314 conn(0x55d5ee91c1c0 msgr2=0x55d5ee91cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 -- 172.21.15.5:0/466173314 shutdown_connections 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 -- 172.21.15.5:0/466173314 wait complete. 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.751+0000 7f579c5cb740 1 -- start start 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 Processor -- start 2024-09-10T22:17:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 0x55d5ee92f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9239a0 0x55d5ee92fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f57937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 0x55d5ee92f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f57937fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 0x55d5ee92f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38146/0 (socket says 172.21.15.5:38146) 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f57937fe640 1 -- 172.21.15.5:0/703050373 learned_addr learned my addr 172.21.15.5:0/703050373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee930750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f57941a61d0 con 0x55d5ee921070 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f57941a7620 con 0x55d5ee9239a0 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.752+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f57941a6880 con 0x55d5ee9263e0 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57927fc640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9239a0 0x55d5ee92fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57937fe640 1 -- 172.21.15.5:0/703050373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 msgr2=0x55d5ee930750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57937fe640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee930750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57937fe640 1 -- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9239a0 msgr2=0x55d5ee92fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57937fe640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9239a0 0x55d5ee92fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57937fe640 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5ee930f80 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57927fc640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9239a0 0x55d5ee92fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f579c5cb740 10 client.0 _ll_register_callbacks cb 0x7f578c00fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f578c0056d0 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f57937fe640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 0x55d5ee92f570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f578c0050f0 tx=0x7f578c00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c6fa6e2bac0740 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.753+0000 7f5776ff5640 10 client.15480 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.754+0000 7f5776ff5640 1 -- 172.21.15.5:0/703050373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578c005880 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.754+0000 7f5776ff5640 1 -- 172.21.15.5:0/703050373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f578c027950 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.754+0000 7f5776ff5640 1 -- 172.21.15.5:0/703050373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f578c027b70 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.754+0000 7f579c5cb740 10 client.15480 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.754+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55d5ee932140 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.754+0000 7f5776ff5640 1 -- 172.21.15.5:0/703050373 <== mon.0 v2:172.21.15.5:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f578c03d470 con 0x55d5ee921070 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f579c5cb740 10 client.15480 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f579c5cb740 10 client.15480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f579c5cb740 20 client.15480 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee9a3150 0x55d5ee9a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f579c5cb740 4 client.15480 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:17:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d5ee88c640 con 0x55d5ee9a3150 2024-09-10T22:17:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f57927fc640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee9a3150 0x55d5ee9a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f57927fc640 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee9a3150 0x55d5ee9a5540 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2360e976d1b2668 server_cookie=dfa59dd765a85cb0 in_seq=0 out_seq=0 2024-09-10T22:17:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.755+0000 7f5776ff5640 10 client.15480 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f5776ff5640 1 -- 172.21.15.5:0/703050373 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d5ee88c640 con 0x55d5ee9a3150 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f5776ff5640 10 client.15480 handle_command_reply: tid=0 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 client.15480 shutdown 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 msgr2=0x55d5ee92f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 0x55d5ee92f570 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f578c0050f0 tx=0x7f578c00fc70 comp rx=0 tx=0).stop 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 shutdown_connections 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d5ee9a3150 0x55d5ee9a5540 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d5ee9263e0 0x55d5ee930750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d5ee9239a0 0x55d5ee92fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 --2- 172.21.15.5:0/703050373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d5ee921070 0x55d5ee92f570 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 >> 172.21.15.5:0/703050373 conn(0x55d5ee91c1c0 msgr2=0x55d5ee92a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.764+0000 7f5776ff5640 0 client.15480 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 shutdown_connections 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f579c5cb740 1 -- 172.21.15.5:0/703050373 wait complete. 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f579c5cb740 20 client.15480 trim_cache size 0 max 16384 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:17:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:17:39.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f577c0b5360 msgr2=0x7f577c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.768 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f5799724640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f577c0b5360 0x7f577c0b7820 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f57840044b0 tx=0x7f578402a380 comp rx=0 tx=0).stop 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 msgr2=0x7f5794105630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.765+0000 7f5799724640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794105630 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f578402a8a0 tx=0x7f5784032d50 comp rx=0 tx=0).stop 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 shutdown_connections 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f577c0b5360 0x7f577c0b7820 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5794103380 0x7f57941043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f57941029c0 0x7f5794103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 --2- 172.21.15.5:0/2871500019 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5794101870 0x7f5794105630 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f578402a8a0 tx=0x7f5784032d50 comp rx=0 tx=0).stop 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 >> 172.21.15.5:0/2871500019 conn(0x7f57940fd150 msgr2=0x7f57940febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 shutdown_connections 2024-09-10T22:17:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:39.766+0000 7f5799724640 1 -- 172.21.15.5:0/2871500019 wait complete. 2024-09-10T22:17:39.895 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 -- 172.21.15.5:0/2831766069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778810d0e0 msgr2=0x7f778810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 --2- 172.21.15.5:0/2831766069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778810d0e0 0x7f778810f550 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7780009ca0 tx=0x7f778002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 -- 172.21.15.5:0/2831766069 shutdown_connections 2024-09-10T22:17:40.424 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 --2- 172.21.15.5:0/2831766069 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f778810d0e0 0x7f778810f550 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 --2- 172.21.15.5:0/2831766069 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7788104530 0x7f778810cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 --2- 172.21.15.5:0/2831766069 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 0x7f7788103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 -- 172.21.15.5:0/2831766069 >> 172.21.15.5:0/2831766069 conn(0x7f77880fd700 msgr2=0x7f77880ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 -- 172.21.15.5:0/2831766069 shutdown_connections 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.422+0000 7f778d385640 1 -- 172.21.15.5:0/2831766069 wait complete. 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.423+0000 7f778d385640 1 Processor -- start 2024-09-10T22:17:40.425 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.423+0000 7f778d385640 1 -- start start 2024-09-10T22:17:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.423+0000 7f778d385640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 0x7f7788199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f778d385640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788104530 0x7f7788199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f778d385640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f778810d0e0 0x7f778819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f778d385640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7788112db0 con 0x7f7788104530 2024-09-10T22:17:40.426 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f778d385640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7788112c30 con 0x7f7788103b30 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 0x7f7788199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f778d385640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7788112f30 con 0x7f778810d0e0 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 0x7f7788199220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49318/0 (socket says 172.21.15.5:49318) 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77867fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788104530 0x7f7788199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f7786ffd640 1 -- 172.21.15.5:0/3561538155 learned_addr learned my addr 172.21.15.5:0/3561538155 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77877fe640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f778810d0e0 0x7f778819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77867fc640 1 -- 172.21.15.5:0/3561538155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f778810d0e0 msgr2=0x7f778819eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77867fc640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f778810d0e0 0x7f778819eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77867fc640 1 -- 172.21.15.5:0/3561538155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 msgr2=0x7f7788199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77867fc640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 0x7f7788199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77867fc640 1 -- 172.21.15.5:0/3561538155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778819f2d0 con 0x7f7788104530 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.424+0000 7f77877fe640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f778810d0e0 0x7f778819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.425+0000 7f77867fc640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788104530 0x7f7788199760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f777c005fd0 tx=0x7f777c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:40.427 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.425+0000 7f776ffff640 1 -- 172.21.15.5:0/3561538155 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c009c30 con 0x7f7788104530 2024-09-10T22:17:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.425+0000 7f776ffff640 1 -- 172.21.15.5:0/3561538155 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f777c009dd0 con 0x7f7788104530 2024-09-10T22:17:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.425+0000 7f776ffff640 1 -- 172.21.15.5:0/3561538155 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c010460 con 0x7f7788104530 2024-09-10T22:17:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.425+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778819f5c0 con 0x7f7788104530 2024-09-10T22:17:40.428 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.426+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77881a5c80 con 0x7f7788104530 2024-09-10T22:17:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.429+0000 7f776ffff640 1 -- 172.21.15.5:0/3561538155 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f777c023060 con 0x7f7788104530 2024-09-10T22:17:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.429+0000 7f778f75a740 1 Processor -- start 2024-09-10T22:17:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 -- start start 2024-09-10T22:17:40.431 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 0x55c55c7828b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c793190 0x55c55c795580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c55c6f8ea0 con 0x55c55c7824d0 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c55c6e82d0 con 0x55c55c793190 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f778f75a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c55c6ec0e0 con 0x55c55c782df0 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f77877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 0x55c55c7828b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f77877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 0x55c55c7828b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38168/0 (socket says 172.21.15.5:38168) 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f77867fc640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c793190 0x55c55c795580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f77877fe640 1 -- 172.21.15.5:0/3357423717 learned_addr learned my addr 172.21.15.5:0/3357423717 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:40.432 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.430+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f7786ffd640 1 -- 172.21.15.5:0/3357423717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c793190 msgr2=0x55c55c795580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c793190 0x55c55c795580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f7786ffd640 1 -- 172.21.15.5:0/3357423717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 msgr2=0x55c55c7828b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f776ffff640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f77700b5430 0x7f77700b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 0x55c55c7828b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f7786ffd640 1 -- 172.21.15.5:0/3357423717 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c55c446650 con 0x55c55c782df0 2024-09-10T22:17:40.433 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f77877fe640 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 0x55c55c7828b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.431+0000 7f776ffff640 1 -- 172.21.15.5:0/3561538155 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f777c0e4e70 con 0x7f7788104530 2024-09-10T22:17:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.432+0000 7f77867fc640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f77700b5430 0x7f77700b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.432+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77780058c0 tx=0x7f77780107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3888743e2aee52db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.432+0000 7f77867fc640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f77700b5430 0x7f77700b78f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f777c0a8a00 tx=0x7f777c0e8950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:40.434 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.432+0000 7f776d7fa640 1 -- 172.21.15.5:0/3357423717 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778004230 con 0x55c55c782df0 2024-09-10T22:17:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.433+0000 7f776d7fa640 1 -- 172.21.15.5:0/3357423717 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f777800be90 con 0x55c55c782df0 2024-09-10T22:17:40.435 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.433+0000 7f776d7fa640 1 -- 172.21.15.5:0/3357423717 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77780116c0 con 0x55c55c782df0 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 -- 172.21.15.5:0/3357423717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 msgr2=0x55c55c792c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792c50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77780058c0 tx=0x7f77780107a0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 -- 172.21.15.5:0/3357423717 shutdown_connections 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c793190 0x55c55c795580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792c50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 --2- 172.21.15.5:0/3357423717 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c7824d0 0x55c55c7828b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 -- 172.21.15.5:0/3357423717 >> 172.21.15.5:0/3357423717 conn(0x55c55c780300 msgr2=0x55c55c7814a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 -- 172.21.15.5:0/3357423717 shutdown_connections 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 -- 172.21.15.5:0/3357423717 wait complete. 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.434+0000 7f778f75a740 1 -- start start 2024-09-10T22:17:40.436 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 Processor -- start 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 0x55c55c78bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f77877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 0x55c55c78bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f77877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 0x55c55c78bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38184/0 (socket says 172.21.15.5:38184) 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f77877fe640 1 -- 172.21.15.5:0/3974039924 learned_addr learned my addr 172.21.15.5:0/3974039924 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55c55c549700 con 0x55c55c793190 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55c55c683160 con 0x55c55c7824d0 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55c55c795e90 con 0x55c55c782df0 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.435+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f7786ffd640 1 -- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 msgr2=0x55c55c7925d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7925d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.438 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f7786ffd640 1 -- 172.21.15.5:0/3974039924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 msgr2=0x55c55c78bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 0x55c55c78bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f7786ffd640 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c55c6b0c90 con 0x55c55c782df0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f778f75a740 10 client.0 _ll_register_callbacks cb 0x55c55c69c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f777800be90 con 0x55c55c782df0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f77877fe640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 0x55c55c78bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7778000c00 tx=0x7f7778003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba7e91eead7b1c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f776aff5640 10 client.25099 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f776aff5640 1 -- 172.21.15.5:0/3974039924 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778003fe0 con 0x55c55c782df0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.436+0000 7f776aff5640 1 -- 172.21.15.5:0/3974039924 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7778004180 con 0x55c55c782df0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f776aff5640 1 -- 172.21.15.5:0/3974039924 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77780043c0 con 0x55c55c782df0 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 10 client.25099 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:40.439 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55c55c7a5b80 con 0x55c55c782df0 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f776aff5640 1 -- 172.21.15.5:0/3974039924 <== mon.1 v2:172.21.15.189:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7778005030 con 0x55c55c782df0 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 10 client.25099 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 10 client.25099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 20 client.25099 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c7a6ed0 0x55c55c7a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 4 client.25099 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c55c6fadf0 con 0x55c55c7a6ed0 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.437+0000 7f77877fe640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c7a6ed0 0x55c55c7a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.441 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.438+0000 7f77877fe640 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c7a6ed0 0x55c55c7a92c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d51af13de33fe101 server_cookie=cb0f99122dd9d5fb in_seq=0 out_seq=0 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.438+0000 7f776aff5640 10 client.25099 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f776aff5640 1 -- 172.21.15.5:0/3974039924 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c55c6fadf0 con 0x55c55c7a6ed0 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f776aff5640 10 client.25099 handle_command_reply: tid=0 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 client.25099 shutdown 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 msgr2=0x55c55c792b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792b70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7778000c00 tx=0x7f7778003820 comp rx=0 tx=0).stop 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 shutdown_connections 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c7a6ed0 0x55c55c7a92c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c793190 0x55c55c78bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c792b70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f776aff5640 0 client.25099 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 --2- 172.21.15.5:0/3974039924 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 >> 172.21.15.5:0/3974039924 conn(0x55c55c780300 msgr2=0x55c55c785e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:40.442 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 shutdown_connections 2024-09-10T22:17:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 1 -- 172.21.15.5:0/3974039924 wait complete. 2024-09-10T22:17:40.443 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.439+0000 7f778f75a740 20 client.25099 trim_cache size 0 max 16384 2024-09-10T22:17:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 Processor -- start 2024-09-10T22:17:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 -- start start 2024-09-10T22:17:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c780300 0x55c55c794580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c794ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.467 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c788c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77881ae910 con 0x55c55c780300 2024-09-10T22:17:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77881ac1e0 con 0x55c55c7824d0 2024-09-10T22:17:40.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f778f75a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f77881aa030 con 0x55c55c782df0 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c794ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f7786ffd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c794ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:49358/0 (socket says 172.21.15.5:49358) 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.466+0000 7f7786ffd640 1 -- 172.21.15.5:0/3315882216 learned_addr learned my addr 172.21.15.5:0/3315882216 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f77877fe640 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c780300 0x55c55c794580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f77877fe640 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c788c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f7786ffd640 1 -- 172.21.15.5:0/3315882216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 msgr2=0x55c55c788c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c788c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f7786ffd640 1 -- 172.21.15.5:0/3315882216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c780300 msgr2=0x55c55c794580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c780300 0x55c55c794580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f7786ffd640 1 -- 172.21.15.5:0/3315882216 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c55c78bee0 con 0x55c55c7824d0 2024-09-10T22:17:40.469 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f7786ffd640 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c794ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7778001eb0 tx=0x7f7778022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d21d71e34dcdbe47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:40.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f776cff9640 1 -- 172.21.15.5:0/3315882216 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777800b8c0 con 0x55c55c7824d0 2024-09-10T22:17:40.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f776cff9640 1 -- 172.21.15.5:0/3315882216 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f777800be90 con 0x55c55c7824d0 2024-09-10T22:17:40.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.467+0000 7f776cff9640 1 -- 172.21.15.5:0/3315882216 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77780119e0 con 0x55c55c7824d0 2024-09-10T22:17:40.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 -- 172.21.15.5:0/3315882216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 msgr2=0x55c55c794ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c794ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7778001eb0 tx=0x7f7778022000 comp rx=0 tx=0).stop 2024-09-10T22:17:40.471 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 -- 172.21.15.5:0/3315882216 shutdown_connections 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c782df0 0x55c55c788c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c794ac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 --2- 172.21.15.5:0/3315882216 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c780300 0x55c55c794580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 -- 172.21.15.5:0/3315882216 >> 172.21.15.5:0/3315882216 conn(0x55c55c7957c0 msgr2=0x55c55c7819c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 -- 172.21.15.5:0/3315882216 shutdown_connections 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.468+0000 7f778f75a740 1 -- 172.21.15.5:0/3315882216 wait complete. 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 -- start start 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 Processor -- start 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c780300 0x55c55c7a1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7a2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.472 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 0x55c55c7a2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f77881aa6a0 con 0x55c55c782df0 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f77881abb10 con 0x55c55c7824d0 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f77881aad70 con 0x55c55c780300 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f778f75a740 10 client.0 _ll_register_callbacks cb 0x7f7780009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f77877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 0x55c55c7a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f77877fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 0x55c55c7a2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:38206/0 (socket says 172.21.15.5:38206) 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.469+0000 7f77877fe640 1 -- 172.21.15.5:0/2392719619 learned_addr learned my addr 172.21.15.5:0/2392719619 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c780300 0x55c55c7a1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f7786ffd640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7a2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 -- 172.21.15.5:0/2392719619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c780300 msgr2=0x55c55c7a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c780300 0x55c55c7a1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 -- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 msgr2=0x55c55c7a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7a2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 -- 172.21.15.5:0/2392719619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c55c812b70 con 0x55c55c782df0 2024-09-10T22:17:40.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f77877fe640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 0x55c55c7a2550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7780009a30 tx=0x7f77800021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db46b784925c865 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:40.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f776aff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f776aff5640 1 -- 172.21.15.5:0/2392719619 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778004b040 con 0x55c55c782df0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f776aff5640 1 -- 172.21.15.5:0/2392719619 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f77800044a0 con 0x55c55c782df0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.470+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f777800be90 con 0x55c55c782df0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f776aff5640 1 -- 172.21.15.5:0/2392719619 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f77800046a0 con 0x55c55c782df0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 10 client.15498 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c55c813e50 con 0x55c55c782df0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f776aff5640 1 -- 172.21.15.5:0/2392719619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f777800be90 con 0x55c55c782df0 2024-09-10T22:17:40.476 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f776aff5640 1 -- 172.21.15.5:0/2392719619 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7780051040 con 0x55c55c782df0 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 10 client.15498 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 20 client.15498 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c793190 0x55c55c8165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 4 client.15498 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.471+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c55c6f68a0 con 0x55c55c793190 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.472+0000 7f7786ffd640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c793190 0x55c55c8165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.472+0000 7f776aff5640 10 client.15498 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.472+0000 7f7786ffd640 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c793190 0x55c55c8165b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50d672ca9abc278d server_cookie=99f157157f55962a in_seq=0 out_seq=0 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.472+0000 7f776aff5640 1 -- 172.21.15.5:0/2392719619 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c55c6f68a0 con 0x55c55c793190 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.472+0000 7f776aff5640 10 client.15498 handle_command_reply: tid=0 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.472+0000 7f778f75a740 1 client.15498 shutdown 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 msgr2=0x55c55c7a2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 0x55c55c7a2550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7780009a30 tx=0x7f77800021d0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 shutdown_connections 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55c55c793190 0x55c55c8165b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f776aff5640 0 client.15498 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55c55c782df0 0x55c55c7a2550 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55c55c7824d0 0x55c55c7a2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 --2- 172.21.15.5:0/2392719619 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55c55c780300 0x55c55c7a1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 >> 172.21.15.5:0/2392719619 conn(0x55c55c7957c0 msgr2=0x55c55c785610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 shutdown_connections 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 1 -- 172.21.15.5:0/2392719619 wait complete. 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.473+0000 7f778f75a740 20 client.15498 trim_cache size 0 max 16384 2024-09-10T22:17:40.478 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f77700b5430 msgr2=0x7f77700b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f77700b5430 0x7f77700b78f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f777c0a8a00 tx=0x7f777c0e8950 comp rx=0 tx=0).stop 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788104530 msgr2=0x7f7788199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788104530 0x7f7788199760 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f777c005fd0 tx=0x7f777c00dde0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 shutdown_connections 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f77700b5430 0x7f77700b78f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f778810d0e0 0x7f778819eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.479 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7788104530 0x7f7788199760 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 --2- 172.21.15.5:0/3561538155 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7788103b30 0x7f7788199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 >> 172.21.15.5:0/3561538155 conn(0x7f77880fd700 msgr2=0x7f778810f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 shutdown_connections 2024-09-10T22:17:40.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:40.474+0000 7f778d385640 1 -- 172.21.15.5:0/3561538155 wait complete. 2024-09-10T22:17:41.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:41 smithi005 ceph-mon[31115]: pgmap v371: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-10T22:17:41.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:41 smithi189 ceph-mon[35784]: pgmap v371: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-10T22:17:41.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:41 smithi052 ceph-mon[34997]: pgmap v371: 97 pgs: 97 active+clean; 654 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-10T22:17:42.207 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:17:42.208 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:17:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 -- 172.21.15.5:0/485930449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001810a9f0 msgr2=0x7f001810ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 --2- 172.21.15.5:0/485930449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001810a9f0 0x7f001810ae30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f000c009900 tx=0x7f000c02a410 comp rx=0 tx=0).stop 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 -- 172.21.15.5:0/485930449 shutdown_connections 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 --2- 172.21.15.5:0/485930449 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001810b370 0x7f0018111b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 --2- 172.21.15.5:0/485930449 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f001810a9f0 0x7f001810ae30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 --2- 172.21.15.5:0/485930449 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f0018104fe0 0x7f00181053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 -- 172.21.15.5:0/485930449 >> 172.21.15.5:0/485930449 conn(0x7f0018100a10 msgr2=0x7f0018102e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:43.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 -- 172.21.15.5:0/485930449 shutdown_connections 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.043+0000 7f001e672640 1 -- 172.21.15.5:0/485930449 wait complete. 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 Processor -- start 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 -- start start 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 0x7f001819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001810a9f0 0x7f001819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001810b370 0x7f00181a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f0018114f80 con 0x7f0018104fe0 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f0018114e00 con 0x7f001810b370 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f001e672640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f0018115100 con 0x7f001810a9f0 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f0017fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 0x7f001819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f0017fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 0x7f001819b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59116/0 (socket says 172.21.15.5:59116) 2024-09-10T22:17:43.050 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f0017fff640 1 -- 172.21.15.5:0/4181988677 learned_addr learned my addr 172.21.15.5:0/4181988677 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.044+0000 7f00177fe640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001810a9f0 0x7f001819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f0017fff640 1 -- 172.21.15.5:0/4181988677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001810a9f0 msgr2=0x7f001819ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f001cc0f640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001810b370 0x7f00181a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f0017fff640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001810a9f0 0x7f001819ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f0017fff640 1 -- 172.21.15.5:0/4181988677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001810b370 msgr2=0x7f00181a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f0017fff640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001810b370 0x7f00181a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f0017fff640 1 -- 172.21.15.5:0/4181988677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00181a1580 con 0x7f0018104fe0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f001cc0f640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001810b370 0x7f00181a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f0017fff640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 0x7f001819b4d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f000800d950 tx=0x7f000800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f00157fa640 1 -- 172.21.15.5:0/4181988677 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0008017030 con 0x7f0018104fe0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f00157fa640 1 -- 172.21.15.5:0/4181988677 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0008004020 con 0x7f0018104fe0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f00157fa640 1 -- 172.21.15.5:0/4181988677 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00080047a0 con 0x7f0018104fe0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00181a1870 con 0x7f0018104fe0 2024-09-10T22:17:43.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.045+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00181a7f30 con 0x7f0018104fe0 2024-09-10T22:17:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.048+0000 7f0020a47740 1 Processor -- start 2024-09-10T22:17:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 -- start start 2024-09-10T22:17:43.053 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 0x55d268a172c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a23250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a25b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d26898de60 con 0x55d268a16ee0 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d26897d290 con 0x55d268a17800 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f0020a47740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d2689810a0 con 0x55d268a23790 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 0x55d268a172c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 0x55d268a172c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59132/0 (socket says 172.21.15.5:59132) 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 -- 172.21.15.5:0/1035167795 learned_addr learned my addr 172.21.15.5:0/1035167795 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f00157fa640 1 -- 172.21.15.5:0/4181988677 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f0008009a30 con 0x7f0018104fe0 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f00177fe640 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a25b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 -- 172.21.15.5:0/1035167795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 msgr2=0x55d268a25b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a25b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 -- 172.21.15.5:0/1035167795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 msgr2=0x55d268a23250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.049+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a23250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7f001cc0f640 1 -- 172.21.15.5:0/1035167795 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2686db930 con 0x55d268a16ee0 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7f00177fe640 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a25b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 0x55d268a172c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e70 tx=0x7f001000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66b159fe707d825 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7efffe7fc640 1 -- 172.21.15.5:0/1035167795 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010004d20 con 0x55d268a16ee0 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7efffe7fc640 1 -- 172.21.15.5:0/1035167795 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00100054d0 con 0x55d268a16ee0 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7efffe7fc640 1 -- 172.21.15.5:0/1035167795 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010011860 con 0x55d268a16ee0 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.050+0000 7f00157fa640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00000b52e0 0x7f00000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0017fff640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00000b52e0 0x7f00000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f00157fa640 1 -- 172.21.15.5:0/4181988677 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f00080e4d20 con 0x7f0018104fe0 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 -- 172.21.15.5:0/1035167795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 msgr2=0x55d268a172c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 0x55d268a172c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e70 tx=0x7f001000f730 comp rx=0 tx=0).stop 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 -- 172.21.15.5:0/1035167795 shutdown_connections 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a25b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a23250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 --2- 172.21.15.5:0/1035167795 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a16ee0 0x55d268a172c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 -- 172.21.15.5:0/1035167795 >> 172.21.15.5:0/1035167795 conn(0x55d268a14d10 msgr2=0x55d268a15eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0017fff640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00000b52e0 0x7f00000b77a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f00080a8780 tx=0x7f000809fdc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 -- 172.21.15.5:0/1035167795 shutdown_connections 2024-09-10T22:17:43.056 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.051+0000 7f0020a47740 1 -- 172.21.15.5:0/1035167795 wait complete. 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 -- start start 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 Processor -- start 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a16ee0 0x55d268a207a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a20ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 0x55d268a21220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55d2687de890 con 0x55d268a23790 2024-09-10T22:17:43.060 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55d268917d40 con 0x55d268a17800 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.052+0000 7f0020a47740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55d268a26440 con 0x55d268a16ee0 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f0020a47740 10 client.0 _ll_register_callbacks cb 0x55d26897bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 0x55d268a21220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 0x55d268a21220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59134/0 (socket says 172.21.15.5:59134) 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 -- 172.21.15.5:0/4246992204 learned_addr learned my addr 172.21.15.5:0/4246992204 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f00177fe640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a20ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a16ee0 0x55d268a207a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 -- 172.21.15.5:0/4246992204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a16ee0 msgr2=0x55d268a207a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a16ee0 0x55d268a207a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 -- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 msgr2=0x55d268a20ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.061 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a20ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 -- 172.21.15.5:0/4246992204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d268a2f870 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7f001cc0f640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 0x55d268a21220 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0010009c00 tx=0x7f0010011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5ee64f0f4b5950 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.053+0000 7efff77fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7efff77fe640 1 -- 172.21.15.5:0/4246992204 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010004c50 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7efff77fe640 1 -- 172.21.15.5:0/4246992204 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f0010005680 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00100054d0 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7efff77fe640 1 -- 172.21.15.5:0/4246992204 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0010005880 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7f0020a47740 10 client.15510 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d268a32220 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7efff77fe640 1 -- 172.21.15.5:0/4246992204 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00100054d0 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.054+0000 7efff77fe640 1 -- 172.21.15.5:0/4246992204 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0010032800 con 0x55d268a23790 2024-09-10T22:17:43.062 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f0020a47740 10 client.15510 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f0020a47740 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f0020a47740 20 client.15510 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f0020a47740 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268a33990 0x55d268a35db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f0020a47740 4 client.15510 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d26898fdb0 con 0x55d268a33990 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.055+0000 7f00177fe640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268a33990 0x55d268a35db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.056+0000 7efff77fe640 10 client.15510 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.056+0000 7f00177fe640 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268a33990 0x55d268a35db0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f294ff695dc89bf6 server_cookie=7b48886cc0c8fd36 in_seq=0 out_seq=0 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.056+0000 7efff77fe640 1 -- 172.21.15.5:0/4246992204 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d26898fdb0 con 0x55d268a33990 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.056+0000 7efff77fe640 10 client.15510 handle_command_reply: tid=0 2024-09-10T22:17:43.063 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.056+0000 7f0020a47740 1 client.15510 shutdown 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 msgr2=0x55d268a21220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 0x55d268a21220 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0010009c00 tx=0x7f0010011440 comp rx=0 tx=0).stop 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 shutdown_connections 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268a33990 0x55d268a35db0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a23790 0x55d268a21220 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a17800 0x55d268a20ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 --2- 172.21.15.5:0/4246992204 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a16ee0 0x55d268a207a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 >> 172.21.15.5:0/4246992204 conn(0x55d268a14d10 msgr2=0x55d268a13f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7efff77fe640 0 client.15510 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 shutdown_connections 2024-09-10T22:17:43.064 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 1 -- 172.21.15.5:0/4246992204 wait complete. 2024-09-10T22:17:43.065 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.057+0000 7f0020a47740 20 client.15510 trim_cache size 0 max 16384 2024-09-10T22:17:43.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 Processor -- start 2024-09-10T22:17:43.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 -- start start 2024-09-10T22:17:43.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a162c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a1dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a1e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f00181b2e90 con 0x55d268a17800 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00181b0760 con 0x55d268a16ee0 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f0020a47740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00181ae5b0 con 0x55d268a23790 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a1dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a1dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59140/0 (socket says 172.21.15.5:59140) 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 -- 172.21.15.5:0/1231644429 learned_addr learned my addr 172.21.15.5:0/1231644429 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a1e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 -- 172.21.15.5:0/1231644429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 msgr2=0x55d268a1e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a1e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 -- 172.21.15.5:0/1231644429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 msgr2=0x55d268a162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.088+0000 7f00177fe640 1 -- 172.21.15.5:0/1231644429 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d268a1f700 con 0x55d268a17800 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.089+0000 7f00177fe640 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a1dbc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f000c02a930 tx=0x7f000c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1b1a3d28442252 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.089+0000 7efffdffb640 1 -- 172.21.15.5:0/1231644429 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c035040 con 0x55d268a17800 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.089+0000 7efffdffb640 1 -- 172.21.15.5:0/1231644429 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f000c0054f0 con 0x55d268a17800 2024-09-10T22:17:43.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.089+0000 7efffdffb640 1 -- 172.21.15.5:0/1231644429 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c004c80 con 0x55d268a17800 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 -- 172.21.15.5:0/1231644429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 msgr2=0x55d268a1dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a1dbc0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f000c02a930 tx=0x7f000c005c00 comp rx=0 tx=0).stop 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 -- 172.21.15.5:0/1231644429 shutdown_connections 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a1e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a1dbc0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 --2- 172.21.15.5:0/1231644429 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.096 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 -- 172.21.15.5:0/1231644429 >> 172.21.15.5:0/1231644429 conn(0x55d268a14d10 msgr2=0x55d268a15bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 -- 172.21.15.5:0/1231644429 shutdown_connections 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.090+0000 7f0020a47740 1 -- 172.21.15.5:0/1231644429 wait complete. 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.091+0000 7f0020a47740 1 -- start start 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.091+0000 7f0020a47740 1 Processor -- start 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.091+0000 7f0020a47740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a2be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.091+0000 7f0020a47740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a13750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f0020a47740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a13c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f0020a47740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f00181aec20 con 0x55d268a17800 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f0020a47740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f00181b0090 con 0x55d268a16ee0 2024-09-10T22:17:43.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f0020a47740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f00181af2f0 con 0x55d268a23790 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f0020a47740 10 client.0 _ll_register_callbacks cb 0x7f0010009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a13750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a13750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59142/0 (socket says 172.21.15.5:59142) 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 -- 172.21.15.5:0/1774328552 learned_addr learned my addr 172.21.15.5:0/1774328552 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a2be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a13c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 -- 172.21.15.5:0/1774328552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 msgr2=0x55d268a13c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a13c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 -- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 msgr2=0x55d268a2be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a2be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 -- 172.21.15.5:0/1774328552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d268a144c0 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f00177fe640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a13750 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f000c009850 tx=0x7f000c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e235fea10892f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7efff77fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7efff77fe640 1 -- 172.21.15.5:0/1774328552 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c035070 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7efff77fe640 1 -- 172.21.15.5:0/1774328552 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f000c0035f0 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.092+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f000c0054f0 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7efff77fe640 1 -- 172.21.15.5:0/1774328552 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f000c0037f0 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 10 client.15516 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d268aa9110 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7efff77fe640 1 -- 172.21.15.5:0/1774328552 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f000c0054f0 con 0x55d268a17800 2024-09-10T22:17:43.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7efff77fe640 1 -- 172.21.15.5:0/1774328552 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f000c0325b0 con 0x55d268a17800 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 10 client.15516 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 20 client.15516 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268aa98c0 0x55d268aabce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 4 client.15516 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.093+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d26898b860 con 0x55d268aa98c0 2024-09-10T22:17:43.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.094+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268aa98c0 0x55d268aabce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.094+0000 7efff77fe640 10 client.15516 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.094+0000 7f001cc0f640 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268aa98c0 0x55d268aabce0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc17e6be9a01cee server_cookie=71025f01e14f38be in_seq=0 out_seq=0 2024-09-10T22:17:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.096+0000 7efff77fe640 1 -- 172.21.15.5:0/1774328552 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d26898b860 con 0x55d268aa98c0 2024-09-10T22:17:43.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.096+0000 7efff77fe640 10 client.15516 handle_command_reply: tid=0 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.096+0000 7f0020a47740 1 client.15516 shutdown 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.096+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 msgr2=0x55d268a13750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.096+0000 7f0020a47740 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a13750 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f000c009850 tx=0x7f000c009520 comp rx=0 tx=0).stop 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 shutdown_connections 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55d268aa98c0 0x55d268aabce0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55d268a23790 0x55d268a13c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55d268a17800 0x55d268a13750 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 --2- 172.21.15.5:0/1774328552 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55d268a16ee0 0x55d268a2be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 >> 172.21.15.5:0/1774328552 conn(0x55d268a14d10 msgr2=0x55d268a1dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7efff77fe640 0 client.15516 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 shutdown_connections 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 1 -- 172.21.15.5:0/1774328552 wait complete. 2024-09-10T22:17:43.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.097+0000 7f0020a47740 20 client.15516 trim_cache size 0 max 16384 2024-09-10T22:17:43.103 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:17:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-09-10T22:17:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "c3f491a8-f960-4d70-807d-4784191d67d0", 2024-09-10T22:17:43.103 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-09-10T22:17:43.103 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00000b52e0 msgr2=0x7f00000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00000b52e0 0x7f00000b77a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f00080a8780 tx=0x7f000809fdc0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 msgr2=0x7f001819b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 0x7f001819b4d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f000800d950 tx=0x7f000800de10 comp rx=0 tx=0).stop 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 shutdown_connections 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f00000b52e0 0x7f00000b77a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f001810b370 0x7f00181a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f001810a9f0 0x7f001819ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 --2- 172.21.15.5:0/4181988677 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f0018104fe0 0x7f001819b4d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 >> 172.21.15.5:0/4181988677 conn(0x7f0018100a10 msgr2=0x7f0018102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:43.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 shutdown_connections 2024-09-10T22:17:43.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:43.098+0000 7f001e672640 1 -- 172.21.15.5:0/4181988677 wait complete. 2024-09-10T22:17:43.306 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:43 smithi005 ceph-mon[31115]: pgmap v372: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T22:17:43.306 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:43 smithi005 ceph-mon[31115]: scrub queued for path: / 2024-09-10T22:17:43.306 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:43 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:43.306 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:43 smithi005 ceph-mon[31115]: scrub summary: active paths [/] 2024-09-10T22:17:43.306 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:43 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:43.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:43 smithi189 ceph-mon[35784]: pgmap v372: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T22:17:43.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:43 smithi189 ceph-mon[35784]: scrub queued for path: / 2024-09-10T22:17:43.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:43 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:43 smithi189 ceph-mon[35784]: scrub summary: active paths [/] 2024-09-10T22:17:43.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:43 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:43.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:43 smithi052 ceph-mon[34997]: pgmap v372: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-10T22:17:43.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:43 smithi052 ceph-mon[34997]: scrub queued for path: / 2024-09-10T22:17:43.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:43 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:43.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:43 smithi052 ceph-mon[34997]: scrub summary: active paths [/] 2024-09-10T22:17:43.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:43 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:17:43.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:17:44.138 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:17:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 -- 172.21.15.5:0/2103337654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 msgr2=0x7fdeec102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 --2- 172.21.15.5:0/2103337654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec102070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009900 tx=0x7fdedc02a410 comp rx=0 tx=0).stop 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 -- 172.21.15.5:0/2103337654 shutdown_connections 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 --2- 172.21.15.5:0/2103337654 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 0x7fdeec10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 --2- 172.21.15.5:0/2103337654 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeec1076a0 0x7fdeec107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 --2- 172.21.15.5:0/2103337654 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec102070 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 -- 172.21.15.5:0/2103337654 >> 172.21.15.5:0/2103337654 conn(0x7fdeec0fd700 msgr2=0x7fdeec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 -- 172.21.15.5:0/2103337654 shutdown_connections 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.626+0000 7fdef163c640 1 -- 172.21.15.5:0/2103337654 wait complete. 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.627+0000 7fdef163c640 1 Processor -- start 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.628+0000 7fdef163c640 1 -- start start 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.628+0000 7fdef163c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.628+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.628+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59170/0 (socket says 172.21.15.5:59170) 2024-09-10T22:17:44.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.628+0000 7fdeeaffd640 1 -- 172.21.15.5:0/1006738956 learned_addr learned my addr 172.21.15.5:0/1006738956 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.628+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeec1076a0 0x7fdeec1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 0x7fdeec19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec111ce0 con 0x7fdeec101c90 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec111b60 con 0x7fdeec1076a0 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec111e60 con 0x7fdeec108020 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeec1076a0 0x7fdeec1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 0x7fdeec19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeb7fe640 1 -- 172.21.15.5:0/1006738956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeec1076a0 msgr2=0x7fdeec1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeec1076a0 0x7fdeec1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeb7fe640 1 -- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 msgr2=0x7fdeec1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeb7fe640 1 -- 172.21.15.5:0/1006738956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec19f360 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.629+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.630+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 0x7fdeec19eb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009fd0 tx=0x7fdee400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.630+0000 7fded3fff640 1 -- 172.21.15.5:0/1006738956 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee400ce20 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.630+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec19f650 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.630+0000 7fded3fff640 1 -- 172.21.15.5:0/1006738956 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee4005020 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.630+0000 7fded3fff640 1 -- 172.21.15.5:0/1006738956 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee4010690 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.630+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec1a5ee0 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.633+0000 7fdef3a11740 1 Processor -- start 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fded3fff640 1 -- 172.21.15.5:0/1006738956 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fdee40054d0 con 0x7fdeec108020 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 -- start start 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f40860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40da0 0x558975f4c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f4f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558975eb6e50 con 0x558975f40da0 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558975ea6280 con 0x558975f4cd30 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.634+0000 7fdef3a11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558975eaa090 con 0x558975f40480 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f40860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f40860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:46178/0 (socket says 172.21.15.5:46178) 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeea7fc640 1 -- 172.21.15.5:0/1001681511 learned_addr learned my addr 172.21.15.5:0/1001681511 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40da0 0x558975f4c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fded3fff640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fded40b52e0 0x7fded40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeeaffd640 1 -- 172.21.15.5:0/1001681511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 msgr2=0x558975f40860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f40860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeeaffd640 1 -- 172.21.15.5:0/1001681511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 msgr2=0x558975f4f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f4f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.635+0000 7fdeeaffd640 1 -- 172.21.15.5:0/1001681511 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558975c04650 con 0x558975f40da0 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.636+0000 7fded3fff640 1 -- 172.21.15.5:0/1006738956 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fdee40e62c0 con 0x7fdeec108020 2024-09-10T22:17:44.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.636+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40da0 0x558975f4c7f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdedc004770 tx=0x7fdedc005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939175489712635e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.636+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fded40b52e0 0x7fded40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.636+0000 7fded17fa640 1 -- 172.21.15.5:0/1001681511 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc035040 con 0x558975f40da0 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.636+0000 7fded17fa640 1 -- 172.21.15.5:0/1001681511 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc031820 con 0x558975f40da0 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.636+0000 7fded17fa640 1 -- 172.21.15.5:0/1001681511 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc004a00 con 0x558975f40da0 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 -- 172.21.15.5:0/1001681511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40da0 msgr2=0x558975f4c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdeeb7fe640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fded40b52e0 0x7fded40b77a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdee40ac9e0 tx=0x7fdee4005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40da0 0x558975f4c7f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdedc004770 tx=0x7fdedc005be0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 -- 172.21.15.5:0/1001681511 shutdown_connections 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f4f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40da0 0x558975f4c7f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 --2- 172.21.15.5:0/1001681511 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f40860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 -- 172.21.15.5:0/1001681511 >> 172.21.15.5:0/1001681511 conn(0x558975f3e2b0 msgr2=0x558975f3f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 -- 172.21.15.5:0/1001681511 shutdown_connections 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.637+0000 7fdef3a11740 1 -- 172.21.15.5:0/1001681511 wait complete. 2024-09-10T22:17:44.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 -- start start 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 Processor -- start 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f49cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f4a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f5d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558975d07700 con 0x558975f4cd30 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558975e41110 con 0x558975f4a750 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558975f53e00 con 0x558975f40480 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdef3a11740 10 client.0 _ll_register_callbacks cb 0x558975e5a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f4a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f49cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f4a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59178/0 (socket says 172.21.15.5:59178) 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdeeaffd640 1 -- 172.21.15.5:0/3316367973 learned_addr learned my addr 172.21.15.5:0/3316367973 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:44.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.638+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f5d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeeaffd640 1 -- 172.21.15.5:0/3316367973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 msgr2=0x558975f49cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f49cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeeaffd640 1 -- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 msgr2=0x558975f5d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f5d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeeaffd640 1 -- 172.21.15.5:0/3316367973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558975e6ec40 con 0x558975f4cd30 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f4a210 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x558975f3f190 tx=0x7fdedc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979e140fb7f863b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeceff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeceff5640 1 -- 172.21.15.5:0/3316367973 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc04e020 con 0x558975f4cd30 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc031820 con 0x558975f4cd30 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.639+0000 7fdeceff5640 1 -- 172.21.15.5:0/3316367973 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fdedc004040 con 0x558975f4cd30 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.640+0000 7fdeceff5640 1 -- 172.21.15.5:0/3316367973 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdedc035040 con 0x558975f4cd30 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.640+0000 7fdef3a11740 10 client.15528 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.640+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558975f5fda0 con 0x558975f4cd30 2024-09-10T22:17:44.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.640+0000 7fdeceff5640 1 -- 172.21.15.5:0/3316367973 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdedc031820 con 0x558975f4cd30 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdeceff5640 1 -- 172.21.15.5:0/3316367973 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdedc0035f0 con 0x558975f4cd30 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdef3a11740 10 client.15528 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdef3a11740 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdef3a11740 20 client.15528 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975f612a0 0x558975f636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdef3a11740 4 client.15528 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.641+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558975eb8da0 con 0x558975f612a0 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.642+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975f612a0 0x558975f636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.642+0000 7fdeceff5640 10 client.15528 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.642+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975f612a0 0x558975f636c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74591625b8179893 server_cookie=d475020c49e26788 in_seq=0 out_seq=0 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdeceff5640 1 -- 172.21.15.5:0/3316367973 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558975eb8da0 con 0x558975f612a0 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdeceff5640 10 client.15528 handle_command_reply: tid=0 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 client.15528 shutdown 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 msgr2=0x558975f4a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f4a210 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x558975f3f190 tx=0x7fdedc009260 comp rx=0 tx=0).stop 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 shutdown_connections 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975f612a0 0x558975f636c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f5d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f4a210 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3316367973 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f49cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 >> 172.21.15.5:0/3316367973 conn(0x558975f3e2b0 msgr2=0x558975f43e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdeceff5640 0 client.15528 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 shutdown_connections 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.643+0000 7fdef3a11740 1 -- 172.21.15.5:0/3316367973 wait complete. 2024-09-10T22:17:44.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.644+0000 7fdef3a11740 20 client.15528 trim_cache size 0 max 16384 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.677+0000 7fdef3a11740 1 Processor -- start 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.677+0000 7fdef3a11740 1 -- start start 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.677+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f43c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f5d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdef3a11740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1ae6d0 con 0x558975f4cd30 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdef3a11740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1abfa0 con 0x558975f4a750 2024-09-10T22:17:44.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdef3a11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1a9ea0 con 0x558975f40480 2024-09-10T22:17:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f5d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f5d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59182/0 (socket says 172.21.15.5:59182) 2024-09-10T22:17:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 -- 172.21.15.5:0/2576767855 learned_addr learned my addr 172.21.15.5:0/2576767855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:44.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 -- 172.21.15.5:0/2576767855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 msgr2=0x558975f43c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f43c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 -- 172.21.15.5:0/2576767855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 msgr2=0x558975f441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.678+0000 7fdeea7fc640 1 -- 172.21.15.5:0/2576767855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558975f49a80 con 0x558975f4cd30 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.679+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.679+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f5d060 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdee00058a0 tx=0x7fdee000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee484873ddfb4f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.679+0000 7fded0ff9640 1 -- 172.21.15.5:0/2576767855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0012d30 con 0x558975f4cd30 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.679+0000 7fded0ff9640 1 -- 172.21.15.5:0/2576767855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee00054d0 con 0x558975f4cd30 2024-09-10T22:17:44.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.679+0000 7fded0ff9640 1 -- 172.21.15.5:0/2576767855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee0004b20 con 0x558975f4cd30 2024-09-10T22:17:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 -- 172.21.15.5:0/2576767855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 msgr2=0x558975f5d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f5d060 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fdee00058a0 tx=0x7fdee000b390 comp rx=0 tx=0).stop 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 -- 172.21.15.5:0/2576767855 shutdown_connections 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f4cd30 0x558975f5d060 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4a750 0x558975f441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 --2- 172.21.15.5:0/2576767855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f40480 0x558975f43c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 -- 172.21.15.5:0/2576767855 >> 172.21.15.5:0/2576767855 conn(0x558975f3e2b0 msgr2=0x558975f43570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 -- 172.21.15.5:0/2576767855 shutdown_connections 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.680+0000 7fdef3a11740 1 -- 172.21.15.5:0/2576767855 wait complete. 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 -- start start 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 Processor -- start 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 0x558975f59770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f4a750 0x558975f46a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f46fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1aa460 con 0x558975f40480 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1ab8d0 con 0x558975f4cd30 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec1aab30 con 0x558975f4a750 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdef3a11740 10 client.0 _ll_register_callbacks cb 0x7fdedc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 0x558975f59770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdeea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 0x558975f59770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:59184/0 (socket says 172.21.15.5:59184) 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdeea7fc640 1 -- 172.21.15.5:0/3743120785 learned_addr learned my addr 172.21.15.5:0/3743120785 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:44.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.681+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f46fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f4a750 0x558975f46a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeea7fc640 1 -- 172.21.15.5:0/3743120785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f4a750 msgr2=0x558975f46a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f4a750 0x558975f46a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeea7fc640 1 -- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 msgr2=0x558975f46fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f46fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeea7fc640 1 -- 172.21.15.5:0/3743120785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558975f47710 con 0x558975f40480 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeea7fc640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 0x558975f59770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005940 tx=0x7fdee00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd2b600fe0cd622 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeceff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeceff5640 1 -- 172.21.15.5:0/3743120785 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee002e020 con 0x558975f40480 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdeceff5640 1 -- 172.21.15.5:0/3743120785 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fdee0003670 con 0x558975f40480 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.682+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdee00054d0 con 0x558975f40480 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdeceff5640 1 -- 172.21.15.5:0/3743120785 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdee0017030 con 0x558975f40480 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 10 client.15534 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:44.687 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558975fce1d0 con 0x558975f40480 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdeceff5640 1 -- 172.21.15.5:0/3743120785 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdee0003d20 con 0x558975f40480 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdeceff5640 1 -- 172.21.15.5:0/3743120785 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdee0020be0 con 0x558975f40480 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 10 client.15534 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 20 client.15534 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975fce6e0 0x558975fd0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 4 client.15534 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fdee00054d0 con 0x558975fce6e0 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.683+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975fce6e0 0x558975fd0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.684+0000 7fdeceff5640 10 client.15534 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:44.688 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.684+0000 7fdeeaffd640 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975fce6e0 0x558975fd0ad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96fcbe507a749b30 server_cookie=df9da28b4dc1d4b0 in_seq=0 out_seq=0 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdeceff5640 1 -- 172.21.15.5:0/3743120785 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x7fdee00054d0 con 0x558975fce6e0 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdeceff5640 10 client.15534 handle_command_reply: tid=0 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 client.15534 shutdown 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 msgr2=0x558975f59770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 0x558975f59770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005940 tx=0x7fdee00058d0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 shutdown_connections 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558975fce6e0 0x558975fd0ad0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdeceff5640 0 client.15534 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558975f4cd30 0x558975f46fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558975f4a750 0x558975f46a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 --2- 172.21.15.5:0/3743120785 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558975f40480 0x558975f59770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.690 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 >> 172.21.15.5:0/3743120785 conn(0x558975f3e2b0 msgr2=0x558975f43d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 shutdown_connections 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.685+0000 7fdef3a11740 1 -- 172.21.15.5:0/3743120785 wait complete. 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef3a11740 20 client.15534 trim_cache size 0 max 16384 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stdout: "c3f491a8-f960-4d70-807d-4784191d67d0": { 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:17:44.691 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "c3f491a8-f960-4d70-807d-4784191d67d0", 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "c3f491a8-f960-4d70-807d-4784191d67d0": { 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:43.094860+0000", 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:17:44.692 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:17:44.693 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fded40b52e0 msgr2=0x7fded40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fded40b52e0 0x7fded40b77a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdee40ac9e0 tx=0x7fdee4005f70 comp rx=0 tx=0).stop 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 msgr2=0x7fdeec19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 0x7fdeec19eb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009fd0 tx=0x7fdee400ef10 comp rx=0 tx=0).stop 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 shutdown_connections 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fded40b52e0 0x7fded40b77a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fdeec108020 0x7fdeec19eb90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fdeec1076a0 0x7fdeec1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.695 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 --2- 172.21.15.5:0/1006738956 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fdeec101c90 0x7fdeec1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.686+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 >> 172.21.15.5:0/1006738956 conn(0x7fdeec0fd700 msgr2=0x7fdeec06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.687+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 shutdown_connections 2024-09-10T22:17:44.696 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:17:44.687+0000 7fdef163c640 1 -- 172.21.15.5:0/1006738956 wait complete. 2024-09-10T22:17:45.513 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:45 smithi005 ceph-mon[31115]: pgmap v373: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T22:17:45.551 INFO:tasks.cephfs.filesystem:scrub status for tag:c3f491a8-f960-4d70-807d-4784191d67d0 - {'path': '/', 'tag': 'c3f491a8-f960-4d70-807d-4784191d67d0', 'options': 'recursive,force'} 2024-09-10T22:17:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:45 smithi189 ceph-mon[35784]: pgmap v373: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T22:17:45.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:45 smithi052 ceph-mon[34997]: pgmap v373: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-10T22:17:47.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:47 smithi005 ceph-mon[31115]: pgmap v374: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T22:17:47.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:47 smithi005 ceph-mon[31115]: scrub summary: idle 2024-09-10T22:17:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:47 smithi189 ceph-mon[35784]: pgmap v374: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T22:17:47.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:47 smithi189 ceph-mon[35784]: scrub summary: idle 2024-09-10T22:17:47.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:47 smithi052 ceph-mon[34997]: pgmap v374: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-09-10T22:17:47.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:47 smithi052 ceph-mon[34997]: scrub summary: idle 2024-09-10T22:17:49.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:49 smithi005 ceph-mon[31115]: pgmap v375: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:17:49.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:49 smithi189 ceph-mon[35784]: pgmap v375: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:17:49.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:49 smithi052 ceph-mon[34997]: pgmap v375: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:17:51.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:51 smithi005 ceph-mon[31115]: pgmap v376: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:17:51.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:51 smithi189 ceph-mon[35784]: pgmap v376: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:17:51.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:51 smithi052 ceph-mon[34997]: pgmap v376: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-10T22:17:52.776 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 97% (11781/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T22:17:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 -- 172.21.15.5:0/946828330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808103390 msgr2=0x7f9808109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 --2- 172.21.15.5:0/946828330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808103390 0x7f9808109d10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9800009cd0 tx=0x7f980002a8e0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 -- 172.21.15.5:0/946828330 shutdown_connections 2024-09-10T22:17:52.867 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 --2- 172.21.15.5:0/946828330 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808103390 0x7f9808109d10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 --2- 172.21.15.5:0/946828330 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f98081029d0 0x7f9808102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 --2- 172.21.15.5:0/946828330 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9808101880 0x7f9808101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 -- 172.21.15.5:0/946828330 >> 172.21.15.5:0/946828330 conn(0x7f98080fd140 msgr2=0x7f98080ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 -- 172.21.15.5:0/946828330 shutdown_connections 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 -- 172.21.15.5:0/946828330 wait complete. 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 Processor -- start 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.863+0000 7f9810173640 1 -- start start 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 0x7f9808198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98081029d0 0x7f98081992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9808103390 0x7f9808199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f980810d4f0 con 0x7f9808101880 2024-09-10T22:17:52.868 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f980810d370 con 0x7f9808103390 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f980810d670 con 0x7f98081029d0 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 0x7f9808198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 0x7f9808198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52202/0 (socket says 172.21.15.5:52202) 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 -- 172.21.15.5:0/1711505872 learned_addr learned my addr 172.21.15.5:0/1711505872 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980d70e640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98081029d0 0x7f98081992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980e710640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9808103390 0x7f9808199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 -- 172.21.15.5:0/1711505872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98081029d0 msgr2=0x7f98081992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98081029d0 0x7f98081992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 -- 172.21.15.5:0/1711505872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9808103390 msgr2=0x7f9808199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9808103390 0x7f9808199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.869 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 -- 172.21.15.5:0/1711505872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980819a7d0 con 0x7f9808101880 2024-09-10T22:17:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f980df0f640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 0x7f9808198c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f980400d770 tx=0x7f980400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f97feffd640 1 -- 172.21.15.5:0/1711505872 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804017070 con 0x7f9808101880 2024-09-10T22:17:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f97feffd640 1 -- 172.21.15.5:0/1711505872 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9804009820 con 0x7f9808101880 2024-09-10T22:17:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f980819aac0 con 0x7f9808101880 2024-09-10T22:17:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.864+0000 7f97feffd640 1 -- 172.21.15.5:0/1711505872 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804004bc0 con 0x7f9808101880 2024-09-10T22:17:52.870 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.865+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98081a1190 con 0x7f9808101880 2024-09-10T22:17:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.867+0000 7f981301d740 1 Processor -- start 2024-09-10T22:17:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.867+0000 7f981301d740 1 -- start start 2024-09-10T22:17:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.867+0000 7f97feffd640 1 -- 172.21.15.5:0/1711505872 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9804005220 con 0x7f9808101880 2024-09-10T22:17:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.867+0000 7f981301d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8a860 0x557e67c8cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.876 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f981301d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c8f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f981301d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 0x557e67c92090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f981301d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557e67bfc6f0 con 0x557e67c8fbd0 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f981301d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557e67bebb20 con 0x557e67c8a860 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f981301d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557e67bef930 con 0x557e67c8d190 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 0x557e67c92090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 0x557e67c92090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52214/0 (socket says 172.21.15.5:52214) 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 -- 172.21.15.5:0/3047424361 learned_addr learned my addr 172.21.15.5:0/3047424361 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980df0f640 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c8f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980e710640 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8a860 0x557e67c8cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 -- 172.21.15.5:0/3047424361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 msgr2=0x557e67c8f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c8f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 -- 172.21.15.5:0/3047424361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8a860 msgr2=0x557e67c8cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.877 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8a860 0x557e67c8cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 -- 172.21.15.5:0/3047424361 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e67bb1530 con 0x557e67c8fbd0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980e710640 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8a860 0x557e67c8cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f97feffd640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97f40b52e0 0x7f97f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980d70e640 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 0x557e67c92090 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f97f800ad00 tx=0x7f97f800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdb758ba29817ce server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f980e710640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97f40b52e0 0x7f97f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f97f3fff640 1 -- 172.21.15.5:0/3047424361 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f801d070 con 0x557e67c8fbd0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.868+0000 7f97feffd640 1 -- 172.21.15.5:0/1711505872 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f98040e5600 con 0x7f9808101880 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f97f3fff640 1 -- 172.21.15.5:0/3047424361 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f8018af0 con 0x557e67c8fbd0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f97f3fff640 1 -- 172.21.15.5:0/3047424361 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8010b40 con 0x557e67c8fbd0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 -- 172.21.15.5:0/3047424361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 msgr2=0x557e67c92090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 0x557e67c92090 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f97f800ad00 tx=0x7f97f800f790 comp rx=0 tx=0).stop 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f980e710640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97f40b52e0 0x7f97f40b77a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9808199a10 tx=0x7f980003d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 -- 172.21.15.5:0/3047424361 shutdown_connections 2024-09-10T22:17:52.878 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8fbd0 0x557e67c92090 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c8f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 --2- 172.21.15.5:0/3047424361 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8a860 0x557e67c8cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.869+0000 7f981301d740 1 -- 172.21.15.5:0/3047424361 >> 172.21.15.5:0/3047424361 conn(0x557e67c859b0 msgr2=0x557e67c86740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 -- 172.21.15.5:0/3047424361 shutdown_connections 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 -- 172.21.15.5:0/3047424361 wait complete. 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 -- start start 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 Processor -- start 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8a860 0x557e67c93ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 0x557e67c94570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67c95140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557e67b23ab0 con 0x557e67c8d190 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557e67b91730 con 0x557e67c8fbd0 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557e67c92bb0 con 0x557e67c8a860 2024-09-10T22:17:52.879 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f981301d740 10 client.0 _ll_register_callbacks cb 0x557e67be56b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f980d70e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 0x557e67c94570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f980d70e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 0x557e67c94570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52222/0 (socket says 172.21.15.5:52222) 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.870+0000 7f980d70e640 1 -- 172.21.15.5:0/195709612 learned_addr learned my addr 172.21.15.5:0/195709612 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980df0f640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8a860 0x557e67c93ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980e710640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67c95140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980d70e640 1 -- 172.21.15.5:0/195709612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8a860 msgr2=0x557e67c93ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980d70e640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8a860 0x557e67c93ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980d70e640 1 -- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 msgr2=0x557e67c95140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980d70e640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67c95140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980d70e640 1 -- 172.21.15.5:0/195709612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e6794d790 con 0x557e67c8d190 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f980d70e640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 0x557e67c94570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97f80186a0 tx=0x7f97f80186d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad63b3ae23cad3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f97f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:52.880 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f97f17fa640 1 -- 172.21.15.5:0/195709612 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f8026020 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f97f17fa640 1 -- 172.21.15.5:0/195709612 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f97f8010880 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f8018af0 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f97f17fa640 1 -- 172.21.15.5:0/195709612 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f97f801d040 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f981301d740 10 client.15546 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e679c6620 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.871+0000 7f97f17fa640 1 -- 172.21.15.5:0/195709612 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f8018af0 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f97f17fa640 1 -- 172.21.15.5:0/195709612 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f97f80046c0 con 0x557e67c8d190 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f981301d740 10 client.15546 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f981301d740 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f981301d740 20 client.15546 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f981301d740 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67c9f5e0 0x557e67ca1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f981301d740 4 client.15546 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e67bfe640 con 0x557e67c9f5e0 2024-09-10T22:17:52.881 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f980df0f640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67c9f5e0 0x557e67ca1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f980df0f640 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67c9f5e0 0x557e67ca1a40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c32687072062dc8 server_cookie=41a7dbf3e015c12 in_seq=0 out_seq=0 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.872+0000 7f97f17fa640 10 client.15546 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f97f17fa640 1 -- 172.21.15.5:0/195709612 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e67bfe640 con 0x557e67c9f5e0 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f97f17fa640 10 client.15546 handle_command_reply: tid=0 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 client.15546 shutdown 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 msgr2=0x557e67c94570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 0x557e67c94570 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f97f80186a0 tx=0x7f97f80186d0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 shutdown_connections 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67c9f5e0 0x557e67ca1a40 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67c95140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f97f17fa640 0 client.15546 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8d190 0x557e67c94570 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.882 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 --2- 172.21.15.5:0/195709612 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8a860 0x557e67c93ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 >> 172.21.15.5:0/195709612 conn(0x557e67c859b0 msgr2=0x557e67c84bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 shutdown_connections 2024-09-10T22:17:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 1 -- 172.21.15.5:0/195709612 wait complete. 2024-09-10T22:17:52.883 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.873+0000 7f981301d740 20 client.15546 trim_cache size 0 max 16384 2024-09-10T22:17:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 Processor -- start 2024-09-10T22:17:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 -- start start 2024-09-10T22:17:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c86210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8d190 0x557e67c86750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8fbd0 0x557e67c93ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.895 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f98081ac5a0 con 0x557e67c8a860 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f98081a9e70 con 0x557e67c8d190 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f981301d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98081a7cc0 con 0x557e67c8fbd0 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f980df0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c86210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f980df0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c86210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52230/0 (socket says 172.21.15.5:52230) 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.888+0000 7f980df0f640 1 -- 172.21.15.5:0/3980254506 learned_addr learned my addr 172.21.15.5:0/3980254506 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980e710640 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8fbd0 0x557e67c93ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980d70e640 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8d190 0x557e67c86750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980df0f640 1 -- 172.21.15.5:0/3980254506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8fbd0 msgr2=0x557e67c93ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980df0f640 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8fbd0 0x557e67c93ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980df0f640 1 -- 172.21.15.5:0/3980254506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8d190 msgr2=0x557e67c86750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980df0f640 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8d190 0x557e67c86750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980df0f640 1 -- 172.21.15.5:0/3980254506 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e67c810b0 con 0x557e67c8a860 2024-09-10T22:17:52.896 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f980df0f640 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c86210 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98040abaf0 tx=0x7f9804093040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117d13a68f363538 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f97f37fe640 1 -- 172.21.15.5:0/3980254506 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98040af030 con 0x557e67c8a860 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f97f37fe640 1 -- 172.21.15.5:0/3980254506 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98040b08d0 con 0x557e67c8a860 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.889+0000 7f97f37fe640 1 -- 172.21.15.5:0/3980254506 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804020040 con 0x557e67c8a860 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 -- 172.21.15.5:0/3980254506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 msgr2=0x557e67c86210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c86210 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f98040abaf0 tx=0x7f9804093040 comp rx=0 tx=0).stop 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 -- 172.21.15.5:0/3980254506 shutdown_connections 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8fbd0 0x557e67c93ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8d190 0x557e67c86750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 --2- 172.21.15.5:0/3980254506 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c86210 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 -- 172.21.15.5:0/3980254506 >> 172.21.15.5:0/3980254506 conn(0x557e67c859b0 msgr2=0x557e67c89cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 -- 172.21.15.5:0/3980254506 shutdown_connections 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 -- 172.21.15.5:0/3980254506 wait complete. 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 -- start start 2024-09-10T22:17:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.890+0000 7f981301d740 1 Processor -- start 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c9b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c9b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67d0a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f98081a8330 con 0x557e67c8a860 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f98081a97a0 con 0x557e67c8fbd0 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f98081a8a00 con 0x557e67c8d190 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 10 client.0 _ll_register_callbacks cb 0x7f97f801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c9b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c9b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:52244/0 (socket says 172.21.15.5:52244) 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 -- 172.21.15.5:0/718714811 learned_addr learned my addr 172.21.15.5:0/718714811 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:17:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980d70e640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c9b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980e710640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67d0a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 -- 172.21.15.5:0/718714811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 msgr2=0x557e67c9b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c9b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 -- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 msgr2=0x557e67d0a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67d0a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 -- 172.21.15.5:0/718714811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e67d0abf0 con 0x557e67c8a860 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f980df0f640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c9b410 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98040e3180 tx=0x7f98040b5380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea31dc7eb6423a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f97f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f97f17fa640 1 -- 172.21.15.5:0/718714811 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98040af070 con 0x557e67c8a860 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f97f17fa640 1 -- 172.21.15.5:0/718714811 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f98040930b0 con 0x557e67c8a860 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.891+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98040b08d0 con 0x557e67c8a860 2024-09-10T22:17:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f97f17fa640 1 -- 172.21.15.5:0/718714811 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9804020040 con 0x557e67c8a860 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 10 client.15552 fetch_fsmap learned FSMap version 25 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557e67d0bf50 con 0x557e67c8a860 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f97f17fa640 1 -- 172.21.15.5:0/718714811 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98040b08d0 con 0x557e67c8a860 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f97f17fa640 1 -- 172.21.15.5:0/718714811 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f98040e7b10 con 0x557e67c8a860 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 10 client.15552 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 20 client.15552 populate_metadata read hostname 'smithi005' 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67d0c900 0x557e67d0ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 4 client.15552 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e67bfa0f0 con 0x557e67d0c900 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.892+0000 7f980d70e640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67d0c900 0x557e67d0ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.893+0000 7f97f17fa640 10 client.15552 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.893+0000 7f980d70e640 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67d0c900 0x557e67d0ed20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=341551b1f6f86c2d server_cookie=da093e0f41714f1f in_seq=0 out_seq=0 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f97f17fa640 1 -- 172.21.15.5:0/718714811 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e67bfa0f0 con 0x557e67d0c900 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f97f17fa640 10 client.15552 handle_command_reply: tid=0 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 client.15552 shutdown 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 msgr2=0x557e67c9b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c9b410 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f98040e3180 tx=0x7f98040b5380 comp rx=0 tx=0).stop 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 shutdown_connections 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x557e67d0c900 0x557e67d0ed20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557e67c8fbd0 0x557e67d0a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557e67c8d190 0x557e67c9b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 --2- 172.21.15.5:0/718714811 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557e67c8a860 0x557e67c9b410 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f97f17fa640 0 client.15552 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:17:52.902 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 >> 172.21.15.5:0/718714811 conn(0x557e67c859b0 msgr2=0x557e67c93eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 shutdown_connections 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.896+0000 7f981301d740 1 -- 172.21.15.5:0/718714811 wait complete. 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f981301d740 20 client.15552 trim_cache size 0 max 16384 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:17:52.903 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97f40b52e0 msgr2=0x7f97f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97f40b52e0 0x7f97f40b77a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9808199a10 tx=0x7f980003d040 comp rx=0 tx=0).stop 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 msgr2=0x7f9808198c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 0x7f9808198c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f980400d770 tx=0x7f980400db70 comp rx=0 tx=0).stop 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 shutdown_connections 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f97f40b52e0 0x7f97f40b77a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.904 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9808103390 0x7f9808199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f98081029d0 0x7f98081992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 --2- 172.21.15.5:0/1711505872 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9808101880 0x7f9808198c90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:17:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 >> 172.21.15.5:0/1711505872 conn(0x7f98080fd140 msgr2=0x7f98080ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:17:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 shutdown_connections 2024-09-10T22:17:52.905 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:17:52.897+0000 7f9810173640 1 -- 172.21.15.5:0/1711505872 wait complete. 2024-09-10T22:17:53.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:53 smithi005 ceph-mon[31115]: pgmap v377: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-10T22:17:53.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:53 smithi189 ceph-mon[35784]: pgmap v377: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-10T22:17:53.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:53 smithi052 ceph-mon[34997]: pgmap v377: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T22:17:53.826 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:53.827 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-10T22:17:53.831 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T22:17:53.857 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T22:17:53.859 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T22:17:53.860 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T22:17:54.567 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T22:17:54.650 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T22:17:54.693 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T22:17:54.695 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T22:17:54.695 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T22:17:54.735 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T22:17:54.738 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:17:54.738 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T22:17:54.794 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2024-09-10T22:17:54.796 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2024-09-10T22:17:54.796 DEBUG:teuthology.orchestra.run.smithi005:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-10T22:17:54.857 INFO:tasks.workunit.client.0.smithi005.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2024-09-10T22:17:54.913 INFO:tasks.workunit.client.0.smithi005.stderr:--2024-09-10 22:17:54-- http://download.ceph.com/qa/fsync-tester.c 2024-09-10T22:17:54.923 INFO:tasks.workunit.client.0.smithi005.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-09-10T22:17:54.944 INFO:tasks.workunit.client.0.smithi005.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-09-10T22:17:54.965 INFO:tasks.workunit.client.0.smithi005.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-10T22:17:54.965 INFO:tasks.workunit.client.0.smithi005.stderr:Length: 3024 (3.0K) [application/octet-stream] 2024-09-10T22:17:54.966 INFO:tasks.workunit.client.0.smithi005.stderr:Saving to: ‘fsync-tester.c’ 2024-09-10T22:17:54.969 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:54.969 INFO:tasks.workunit.client.0.smithi005.stderr: 0K .. 100% 561M=0s 2024-09-10T22:17:54.969 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:54.969 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-10 22:17:54 (561 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2024-09-10T22:17:54.969 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-10T22:17:54.970 INFO:tasks.workunit.client.0.smithi005.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2024-09-10T22:17:55.041 INFO:tasks.workunit.client.0.smithi005.stderr:+ ./fsync-tester 2024-09-10T22:17:55.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:55 smithi005 ceph-mon[31115]: pgmap v378: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T22:17:55.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:55 smithi189 ceph-mon[35784]: pgmap v378: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T22:17:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:55 smithi052 ceph-mon[34997]: pgmap v378: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-10T22:17:57.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:57 smithi005 ceph-mon[31115]: pgmap v379: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-10T22:17:57.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:57 smithi189 ceph-mon[35784]: pgmap v379: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-10T22:17:57.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:57 smithi052 ceph-mon[34997]: pgmap v379: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-10T22:17:59.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:17:59 smithi005 ceph-mon[31115]: pgmap v380: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T22:17:59.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:17:59 smithi189 ceph-mon[35784]: pgmap v380: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T22:17:59.753 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:17:59 smithi052 ceph-mon[34997]: pgmap v380: 97 pgs: 97 active+clean; 665 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-10T22:18:01.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:01 smithi005 ceph-mon[31115]: pgmap v381: 97 pgs: 97 active+clean; 1.6 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 256 KiB/s wr, 6 op/s 2024-09-10T22:18:01.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:01 smithi189 ceph-mon[35784]: pgmap v381: 97 pgs: 97 active+clean; 1.6 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 256 KiB/s wr, 6 op/s 2024-09-10T22:18:01.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:01 smithi052 ceph-mon[34997]: pgmap v381: 97 pgs: 97 active+clean; 1.6 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 256 KiB/s wr, 6 op/s 2024-09-10T22:18:03.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:03 smithi005 ceph-mon[31115]: pgmap v382: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 263 KiB/s wr, 9 op/s 2024-09-10T22:18:03.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:03 smithi189 ceph-mon[35784]: pgmap v382: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 263 KiB/s wr, 9 op/s 2024-09-10T22:18:03.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:03 smithi052 ceph-mon[34997]: pgmap v382: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 263 KiB/s wr, 9 op/s 2024-09-10T22:18:05.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:05 smithi005 ceph-mon[31115]: pgmap v383: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 689 KiB/s wr, 8 op/s 2024-09-10T22:18:05.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:05 smithi189 ceph-mon[35784]: pgmap v383: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 689 KiB/s wr, 8 op/s 2024-09-10T22:18:05.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:05 smithi052 ceph-mon[34997]: pgmap v383: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 689 KiB/s wr, 8 op/s 2024-09-10T22:18:05.993 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 -- 172.21.15.5:0/1905915289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c101880 msgr2=0x7fc18c101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1905915289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c101880 0x7fc18c101c80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009930 tx=0x7fc17c02a420 comp rx=0 tx=0).stop 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 -- 172.21.15.5:0/1905915289 shutdown_connections 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1905915289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c103390 0x7fc18c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1905915289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc18c1029d0 0x7fc18c102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1905915289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c101880 0x7fc18c101c80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 -- 172.21.15.5:0/1905915289 >> 172.21.15.5:0/1905915289 conn(0x7fc18c0fd140 msgr2=0x7fc18c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 -- 172.21.15.5:0/1905915289 shutdown_connections 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.992+0000 7fc191e6b640 1 -- 172.21.15.5:0/1905915289 wait complete. 2024-09-10T22:18:05.994 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 Processor -- start 2024-09-10T22:18:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 -- start start 2024-09-10T22:18:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c101880 0x7fc18c105710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 0x7fc18c103f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc18c103390 0x7fc18c1044b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c10d4f0 con 0x7fc18c1029d0 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c10d370 con 0x7fc18c103390 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc191e6b640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c10d670 con 0x7fc18c101880 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 0x7fc18c103f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 0x7fc18c103f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37480/0 (socket says 172.21.15.5:37480) 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 -- 172.21.15.5:0/1523910927 learned_addr learned my addr 172.21.15.5:0/1523910927 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18bfff640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc18c103390 0x7fc18c1044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c101880 0x7fc18c105710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 -- 172.21.15.5:0/1523910927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c101880 msgr2=0x7fc18c105710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c101880 0x7fc18c105710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 -- 172.21.15.5:0/1523910927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc18c103390 msgr2=0x7fc18c1044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:05.997 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc18c103390 0x7fc18c1044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18affd640 1 -- 172.21.15.5:0/1523910927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c104d20 con 0x7fc18c1029d0 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.993+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c101880 0x7fc18c105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.994+0000 7fc18affd640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 0x7fc18c103f70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c920 tx=0x7fc18000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.994+0000 7fc188ff9640 1 -- 172.21.15.5:0/1523910927 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180007c70 con 0x7fc18c1029d0 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.994+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c1a2e20 con 0x7fc18c1029d0 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.994+0000 7fc188ff9640 1 -- 172.21.15.5:0/1523910927 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc180007e10 con 0x7fc18c1029d0 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.994+0000 7fc188ff9640 1 -- 172.21.15.5:0/1523910927 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc180018820 con 0x7fc18c1029d0 2024-09-10T22:18:05.998 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.994+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c1a3330 con 0x7fc18c1029d0 2024-09-10T22:18:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.996+0000 7fc188ff9640 1 -- 172.21.15.5:0/1523910927 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc18000f450 con 0x7fc18c1029d0 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.997+0000 7fc188ff9640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc1740b52e0 0x7fc1740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc188ff9640 1 -- 172.21.15.5:0/1523910927 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc1800e5cb0 con 0x7fc18c1029d0 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc1740b52e0 0x7fc1740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 Processor -- start 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 -- start start 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc1740b52e0 0x7fc1740b77a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000c00 tx=0x7fc17c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2ab860 0x55ff3f2adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ff3f21d6f0 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff3f20cb20 con 0x55ff3f2ae190 2024-09-10T22:18:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc194c30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ff3f210930 con 0x55ff3f2ab860 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc18bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc18bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37496/0 (socket says 172.21.15.5:37496) 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.998+0000 7fc18bfff640 1 -- 172.21.15.5:0/4108603411 learned_addr learned my addr 172.21.15.5:0/4108603411 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2ab860 0x55ff3f2adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18affd640 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18bfff640 1 -- 172.21.15.5:0/4108603411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2ab860 msgr2=0x55ff3f2adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18bfff640 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2ab860 0x55ff3f2adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18bfff640 1 -- 172.21.15.5:0/4108603411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 msgr2=0x55ff3f2b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18bfff640 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18bfff640 1 -- 172.21.15.5:0/4108603411 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff3f1d2530 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc18bfff640 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b3090 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc184010370 tx=0x7fc184010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e645080463121b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc171ffb640 1 -- 172.21.15.5:0/4108603411 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184016070 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc171ffb640 1 -- 172.21.15.5:0/4108603411 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc184004d20 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:05.999+0000 7fc171ffb640 1 -- 172.21.15.5:0/4108603411 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc184005420 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 -- 172.21.15.5:0/4108603411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 msgr2=0x55ff3f2b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b3090 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc184010370 tx=0x7fc184010830 comp rx=0 tx=0).stop 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 -- 172.21.15.5:0/4108603411 shutdown_connections 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b3090 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 --2- 172.21.15.5:0/4108603411 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2ab860 0x55ff3f2adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 -- 172.21.15.5:0/4108603411 >> 172.21.15.5:0/4108603411 conn(0x55ff3f2a69b0 msgr2=0x55ff3f2a7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 -- 172.21.15.5:0/4108603411 shutdown_connections 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 -- 172.21.15.5:0/4108603411 wait complete. 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.000+0000 7fc194c30740 1 -- start start 2024-09-10T22:18:06.007 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 Processor -- start 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ff3f144ab0 con 0x55ff3f2ab860 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ff3f1b2730 con 0x55ff3f2ae190 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ff3f2b3bb0 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc194c30740 10 client.0 _ll_register_callbacks cb 0x55ff3f2066b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37500/0 (socket says 172.21.15.5:37500) 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 -- 172.21.15.5:0/4023206591 learned_addr learned my addr 172.21.15.5:0/4023206591 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18affd640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.008 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18bfff640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 -- 172.21.15.5:0/4023206591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 msgr2=0x55ff3f2b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 -- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 msgr2=0x55ff3f2b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18b7fe640 1 -- 172.21.15.5:0/4023206591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff3ef6e790 con 0x55ff3f2ab860 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.001+0000 7fc18affd640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b4f50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009930 tx=0x7fc17c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a09ea06399f6627 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc16affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc16affd640 1 -- 172.21.15.5:0/4023206591 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c04d070 con 0x55ff3f2ab860 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc184004d20 con 0x55ff3f2ab860 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc16affd640 1 -- 172.21.15.5:0/4023206591 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc17c005240 con 0x55ff3f2ab860 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc16affd640 1 -- 172.21.15.5:0/4023206591 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc17c059050 con 0x55ff3f2ab860 2024-09-10T22:18:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc194c30740 10 client.15564 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff3efe7620 con 0x55ff3f2ab860 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc16affd640 1 -- 172.21.15.5:0/4023206591 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc184004d20 con 0x55ff3f2ab860 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc16affd640 1 -- 172.21.15.5:0/4023206591 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc17c0035f0 con 0x55ff3f2ab860 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc194c30740 10 client.15564 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc194c30740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.002+0000 7fc194c30740 20 client.15564 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.003+0000 7fc194c30740 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f2c0860 0x55ff3f2c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.003+0000 7fc194c30740 4 client.15564 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.003+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff3f21f640 con 0x55ff3f2c0860 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.003+0000 7fc18affd640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f2c0860 0x55ff3f2c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.003+0000 7fc18affd640 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f2c0860 0x55ff3f2c2ce0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b09c23f1f389fc4d server_cookie=bcf2b390500da846 in_seq=0 out_seq=0 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.003+0000 7fc16affd640 10 client.15564 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc16affd640 1 -- 172.21.15.5:0/4023206591 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff3f21f640 con 0x55ff3f2c0860 2024-09-10T22:18:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc16affd640 10 client.15564 handle_command_reply: tid=0 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 client.15564 shutdown 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 msgr2=0x55ff3f2b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b4f50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009930 tx=0x7fc17c009260 comp rx=0 tx=0).stop 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 shutdown_connections 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f2c0860 0x55ff3f2c2ce0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 --2- 172.21.15.5:0/4023206591 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b4f50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc16affd640 0 client.15564 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 >> 172.21.15.5:0/4023206591 conn(0x55ff3f2a69b0 msgr2=0x55ff3f2a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.004+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 shutdown_connections 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.005+0000 7fc194c30740 1 -- 172.21.15.5:0/4023206591 wait complete. 2024-09-10T22:18:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.005+0000 7fc194c30740 20 client.15564 trim_cache size 0 max 16384 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.019+0000 7fc194c30740 1 Processor -- start 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.019+0000 7fc194c30740 1 -- start start 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc194c30740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc194c30740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc194c30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2a7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc194c30740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1ae890 con 0x55ff3f2ab860 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc194c30740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1ac160 con 0x55ff3f2ae190 2024-09-10T22:18:06.022 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc194c30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1a9fb0 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37510/0 (socket says 172.21.15.5:37510) 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 -- 172.21.15.5:0/2492152660 learned_addr learned my addr 172.21.15.5:0/2492152660 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18affd640 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18bfff640 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 -- 172.21.15.5:0/2492152660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 msgr2=0x55ff3f2a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2a7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 -- 172.21.15.5:0/2492152660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 msgr2=0x55ff3f2b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 -- 172.21.15.5:0/2492152660 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff3f2adfc0 con 0x55ff3f2ab860 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18bfff640 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2a7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b0fb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009230 tx=0x7fc17c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26736f4a2f8687c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.020+0000 7fc1717fa640 1 -- 172.21.15.5:0/2492152660 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c062070 con 0x55ff3f2ab860 2024-09-10T22:18:06.023 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc1717fa640 1 -- 172.21.15.5:0/2492152660 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc17c003e00 con 0x55ff3f2ab860 2024-09-10T22:18:06.024 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc1717fa640 1 -- 172.21.15.5:0/2492152660 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c04d040 con 0x55ff3f2ab860 2024-09-10T22:18:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 -- 172.21.15.5:0/2492152660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 msgr2=0x55ff3f2b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b0fb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc17c009230 tx=0x7fc17c0038a0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 -- 172.21.15.5:0/2492152660 shutdown_connections 2024-09-10T22:18:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2a7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ae190 0x55ff3f2b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 --2- 172.21.15.5:0/2492152660 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ab860 0x55ff3f2b0fb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 -- 172.21.15.5:0/2492152660 >> 172.21.15.5:0/2492152660 conn(0x55ff3f2a69b0 msgr2=0x55ff3f2aad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 -- 172.21.15.5:0/2492152660 shutdown_connections 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.021+0000 7fc194c30740 1 -- 172.21.15.5:0/2492152660 wait complete. 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 -- start start 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 Processor -- start 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ab860 0x55ff3f2bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 0x55ff3f2bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2bba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1aa620 con 0x55ff3f2ae190 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1aba90 con 0x55ff3f2ab860 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c1aacf0 con 0x55ff3f2b0bd0 2024-09-10T22:18:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc194c30740 10 client.0 _ll_register_callbacks cb 0x7fc17c03f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc18affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 0x55ff3f2bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc18affd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 0x55ff3f2bb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:37518/0 (socket says 172.21.15.5:37518) 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc18affd640 1 -- 172.21.15.5:0/2281606625 learned_addr learned my addr 172.21.15.5:0/2281606625 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.022+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ab860 0x55ff3f2bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18bfff640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2bba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18affd640 1 -- 172.21.15.5:0/2281606625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 msgr2=0x55ff3f2bba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18affd640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2bba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18affd640 1 -- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ab860 msgr2=0x55ff3f2bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18affd640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ab860 0x55ff3f2bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18affd640 1 -- 172.21.15.5:0/2281606625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff3f2bc130 con 0x55ff3f2ae190 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc18affd640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 0x55ff3f2bb550 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc18000cfd0 tx=0x7fc180000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ee5d33d29996a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc16affd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc16affd640 1 -- 172.21.15.5:0/2281606625 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1800ac4a0 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc16affd640 1 -- 172.21.15.5:0/2281606625 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc1800d31e0 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc17c003e00 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc16affd640 1 -- 172.21.15.5:0/2281606625 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc1800c6020 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc194c30740 10 client.15570 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ff3f32d7b0 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.023+0000 7fc16affd640 1 -- 172.21.15.5:0/2281606625 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc17c003e00 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc16affd640 1 -- 172.21.15.5:0/2281606625 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc1800b55a0 con 0x55ff3f2ae190 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc194c30740 10 client.15570 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc194c30740 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc194c30740 20 client.15570 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc194c30740 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f32e180 0x55ff3f330570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc194c30740 4 client.15570 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff3f21b0f0 con 0x55ff3f32e180 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f32e180 0x55ff3f330570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc18b7fe640 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f32e180 0x55ff3f330570 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=875e4265dd3b783c server_cookie=984ea7af468daf01 in_seq=0 out_seq=0 2024-09-10T22:18:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.024+0000 7fc16affd640 10 client.15570 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc16affd640 1 -- 172.21.15.5:0/2281606625 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff3f21b0f0 con 0x55ff3f32e180 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc16affd640 10 client.15570 handle_command_reply: tid=0 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 client.15570 shutdown 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 msgr2=0x55ff3f2bb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 0x55ff3f2bb550 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc18000cfd0 tx=0x7fc180000bc0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 shutdown_connections 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ff3f32e180 0x55ff3f330570 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ff3f2b0bd0 0x55ff3f2bba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ff3f2ae190 0x55ff3f2bb550 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc16affd640 0 client.15570 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:06.037 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 --2- 172.21.15.5:0/2281606625 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ff3f2ab860 0x55ff3f2bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 >> 172.21.15.5:0/2281606625 conn(0x55ff3f2a69b0 msgr2=0x55ff3f2b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 shutdown_connections 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 1 -- 172.21.15.5:0/2281606625 wait complete. 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.035+0000 7fc194c30740 20 client.15570 trim_cache size 0 max 16384 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:18:06.038 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc1740b52e0 msgr2=0x7fc1740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc1740b52e0 0x7fc1740b77a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc17c000c00 tx=0x7fc17c0314a0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 msgr2=0x7fc18c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 0x7fc18c103f70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc18000c920 tx=0x7fc18000cde0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 shutdown_connections 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc1740b52e0 0x7fc1740b77a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.039 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc18c103390 0x7fc18c1044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc18c1029d0 0x7fc18c103f70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 --2- 172.21.15.5:0/1523910927 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc18c101880 0x7fc18c105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 >> 172.21.15.5:0/1523910927 conn(0x7fc18c0fd140 msgr2=0x7fc18c06a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 shutdown_connections 2024-09-10T22:18:06.040 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:06.036+0000 7fc191e6b640 1 -- 172.21.15.5:0/1523910927 wait complete. 2024-09-10T22:18:07.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:07 smithi189 ceph-mon[35784]: pgmap v384: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 692 KiB/s wr, 10 op/s 2024-09-10T22:18:07.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:07 smithi052 ceph-mon[34997]: pgmap v384: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 692 KiB/s wr, 10 op/s 2024-09-10T22:18:07.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:07 smithi005 ceph-mon[31115]: pgmap v384: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 692 KiB/s wr, 10 op/s 2024-09-10T22:18:09.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:09 smithi189 ceph-mon[35784]: pgmap v385: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 692 KiB/s wr, 9 op/s 2024-09-10T22:18:09.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:09 smithi052 ceph-mon[34997]: pgmap v385: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 692 KiB/s wr, 9 op/s 2024-09-10T22:18:09.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:09 smithi005 ceph-mon[31115]: pgmap v385: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 692 KiB/s wr, 9 op/s 2024-09-10T22:18:11.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:11 smithi005 ceph-mon[31115]: pgmap v386: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-10T22:18:11.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:11 smithi189 ceph-mon[35784]: pgmap v386: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-10T22:18:11.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:11 smithi052 ceph-mon[34997]: pgmap v386: 97 pgs: 97 active+clean; 1.7 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.1 MiB/s wr, 11 op/s 2024-09-10T22:18:13.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:13 smithi189 ceph-mon[35784]: pgmap v387: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 867 KiB/s wr, 14 op/s 2024-09-10T22:18:13.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:13 smithi052 ceph-mon[34997]: pgmap v387: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 867 KiB/s wr, 14 op/s 2024-09-10T22:18:13.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:13 smithi005 ceph-mon[31115]: pgmap v387: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 867 KiB/s wr, 14 op/s 2024-09-10T22:18:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:14.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:14.694 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:14.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:18:14.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:18:14.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:18:15.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:18:15.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:15 smithi189 ceph-mon[35784]: pgmap v388: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:15.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:15 smithi052 ceph-mon[34997]: pgmap v388: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:15.826 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:15.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:15 smithi005 ceph-mon[31115]: pgmap v388: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1634920127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24102150 msgr2=0x7f6a2410eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1634920127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24102150 0x7f6a2410eea0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009900 tx=0x7f6a1402a480 comp rx=0 tx=0).stop 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1634920127 shutdown_connections 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1634920127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 0x7f6a241117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1634920127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24102150 0x7f6a2410eea0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1634920127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24101830 0x7f6a24101c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1634920127 >> 172.21.15.5:0/1634920127 conn(0x7f6a240fd700 msgr2=0x7f6a240ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.900 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1634920127 shutdown_connections 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.713+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1634920127 wait complete. 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 Processor -- start 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 -- start start 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 0x7f6a2419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24102150 0x7f6a2419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 0x7f6a241a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24114f20 con 0x7f6a24101830 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a24114da0 con 0x7f6a24102150 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a2ba54640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241150a0 con 0x7f6a2410f3e0 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 0x7f6a2419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 0x7f6a2419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53080/0 (socket says 172.21.15.5:53080) 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 -- 172.21.15.5:0/1603107568 learned_addr learned my addr 172.21.15.5:0/1603107568 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24102150 0x7f6a2419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.901 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 0x7f6a241a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 -- 172.21.15.5:0/1603107568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 msgr2=0x7f6a241a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 0x7f6a241a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 -- 172.21.15.5:0/1603107568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24102150 msgr2=0x7f6a2419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24102150 0x7f6a2419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a297f0640 1 -- 172.21.15.5:0/1603107568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a241a15f0 con 0x7f6a24101830 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.714+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 0x7f6a241a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.715+0000 7f6a297f0640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 0x7f6a2419b540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e9f0 tx=0x7f6a2000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.715+0000 7f6a1a7fc640 1 -- 172.21.15.5:0/1603107568 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000cd80 con 0x7f6a24101830 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.715+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a241a18e0 con 0x7f6a24101830 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.715+0000 7f6a1a7fc640 1 -- 172.21.15.5:0/1603107568 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a200108e0 con 0x7f6a24101830 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.715+0000 7f6a1a7fc640 1 -- 172.21.15.5:0/1603107568 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a20018980 con 0x7f6a24101830 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.715+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a241a7fa0 con 0x7f6a24101830 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 Processor -- start 2024-09-10T22:18:16.902 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 -- start start 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 0x563fb810b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a1a7fc640 1 -- 172.21.15.5:0/1603107568 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6a20010430 con 0x7f6a24101830 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb81177f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb8117d30 0x563fb811a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563fb8081e50 con 0x563fb810b480 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563fb8071280 con 0x563fb810bda0 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a2de29740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fb8075090 con 0x563fb8117d30 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a29ff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 0x563fb810b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a29ff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 0x563fb810b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53084/0 (socket says 172.21.15.5:53084) 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a29ff1640 1 -- 172.21.15.5:0/511623967 learned_addr learned my addr 172.21.15.5:0/511623967 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.718+0000 7f6a297f0640 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb81177f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a28fef640 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb8117d30 0x563fb811a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.903 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a29ff1640 1 -- 172.21.15.5:0/511623967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb8117d30 msgr2=0x563fb811a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb8117d30 0x563fb811a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a29ff1640 1 -- 172.21.15.5:0/511623967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 msgr2=0x563fb81177f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb81177f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a29ff1640 1 -- 172.21.15.5:0/511623967 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb7dcf650 con 0x563fb810b480 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 0x563fb810b860 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c005f40 tx=0x7f6a1c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927e60c5840f6b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a0f7fe640 1 -- 172.21.15.5:0/511623967 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c011700 con 0x563fb810b480 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a0f7fe640 1 -- 172.21.15.5:0/511623967 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c011d50 con 0x563fb810b480 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a0f7fe640 1 -- 172.21.15.5:0/511623967 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c00e3c0 con 0x563fb810b480 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a1a7fc640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6a100b52e0 0x7f6a100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.719+0000 7f6a297f0640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6a100b52e0 0x7f6a100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.904 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a1a7fc640 1 -- 172.21.15.5:0/1603107568 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6a200e5fa0 con 0x7f6a24101830 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "c3f491a8-f960-4d70-807d-4784191d67d0": { 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:43.094860+0000", 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:16.905 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 -- 172.21.15.5:0/511623967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 msgr2=0x563fb810b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 0x563fb810b860 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c005f40 tx=0x7f6a1c010860 comp rx=0 tx=0).stop 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a297f0640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6a100b52e0 0x7f6a100b77a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a200e3e40 tx=0x7f6a20018420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 -- 172.21.15.5:0/511623967 shutdown_connections 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb8117d30 0x563fb811a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb81177f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 --2- 172.21.15.5:0/511623967 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810b480 0x563fb810b860 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 -- 172.21.15.5:0/511623967 >> 172.21.15.5:0/511623967 conn(0x563fb81092b0 msgr2=0x563fb810a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 -- 172.21.15.5:0/511623967 shutdown_connections 2024-09-10T22:18:16.907 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 -- 172.21.15.5:0/511623967 wait complete. 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.720+0000 7f6a2de29740 1 -- start start 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 Processor -- start 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb8117640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb8114a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb81150c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563fb7ed2700 con 0x563fb8117d30 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563fb800c110 con 0x563fb810bda0 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563fb811a9b0 con 0x563fb810b480 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a2de29740 10 client.0 _ll_register_callbacks cb 0x563fb8025990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a29ff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb81150c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a29ff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb81150c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53100/0 (socket says 172.21.15.5:53100) 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a29ff1640 1 -- 172.21.15.5:0/353846170 learned_addr learned my addr 172.21.15.5:0/353846170 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb8117640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.908 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.721+0000 7f6a28fef640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb8114a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a29ff1640 1 -- 172.21.15.5:0/353846170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 msgr2=0x563fb8117640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb8117640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a29ff1640 1 -- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 msgr2=0x563fb8114a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb8114a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a29ff1640 1 -- 172.21.15.5:0/353846170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb8039c40 con 0x563fb8117d30 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb81150c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c01cfb0 tx=0x7f6a1c013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f50cc1685cfd39 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a0cff9640 1 -- 172.21.15.5:0/353846170 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0117d0 con 0x563fb8117d30 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a0cff9640 1 -- 172.21.15.5:0/353846170 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6a1c011970 con 0x563fb8117d30 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a1c011d50 con 0x563fb8117d30 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a0cff9640 1 -- 172.21.15.5:0/353846170 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6a1c011b70 con 0x563fb8117d30 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a2de29740 10 client.15582 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.722+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563fb8126340 con 0x563fb8117d30 2024-09-10T22:18:16.909 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a0cff9640 1 -- 172.21.15.5:0/353846170 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a1c011d50 con 0x563fb8117d30 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a0cff9640 1 -- 172.21.15.5:0/353846170 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6a1c029040 con 0x563fb8117d30 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a2de29740 10 client.15582 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a2de29740 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a2de29740 20 client.15582 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a2de29740 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8127690 0x563fb8129a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a2de29740 4 client.15582 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fb8083da0 con 0x563fb8127690 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.723+0000 7f6a28fef640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8127690 0x563fb8129a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.724+0000 7f6a0cff9640 10 client.15582 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.724+0000 7f6a28fef640 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8127690 0x563fb8129a80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c480519f76df90a8 server_cookie=e762f69a86d017a4 in_seq=0 out_seq=0 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.724+0000 7f6a0cff9640 1 -- 172.21.15.5:0/353846170 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fb8083da0 con 0x563fb8127690 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.724+0000 7f6a0cff9640 10 client.15582 handle_command_reply: tid=0 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.724+0000 7f6a2de29740 1 client.15582 shutdown 2024-09-10T22:18:16.910 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 msgr2=0x563fb81150c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb81150c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c01cfb0 tx=0x7f6a1c013040 comp rx=0 tx=0).stop 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 shutdown_connections 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8127690 0x563fb8129a80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb81150c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810bda0 0x563fb8114a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 --2- 172.21.15.5:0/353846170 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb8117640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 >> 172.21.15.5:0/353846170 conn(0x563fb81092b0 msgr2=0x563fb810ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a0cff9640 0 client.15582 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 shutdown_connections 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 1 -- 172.21.15.5:0/353846170 wait complete. 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.725+0000 7f6a2de29740 20 client.15582 trim_cache size 0 max 16384 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 Processor -- start 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 -- start start 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb810aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.911 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 0x563fb8108bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb8117d30 0x563fb8123c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241b2ef0 con 0x563fb810bda0 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241b07c0 con 0x563fb8117d30 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a2de29740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241ae610 con 0x563fb810b480 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a28fef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 0x563fb8108bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a28fef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 0x563fb8108bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53102/0 (socket says 172.21.15.5:53102) 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a28fef640 1 -- 172.21.15.5:0/1528694803 learned_addr learned my addr 172.21.15.5:0/1528694803 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb810aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.743+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb8117d30 0x563fb8123c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a28fef640 1 -- 172.21.15.5:0/1528694803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 msgr2=0x563fb810aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb810aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a28fef640 1 -- 172.21.15.5:0/1528694803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb8117d30 msgr2=0x563fb8123c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb8117d30 0x563fb8123c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.912 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a28fef640 1 -- 172.21.15.5:0/1528694803 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fb8112f90 con 0x563fb810bda0 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb8117d30 0x563fb8123c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 0x563fb8108bc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009900 tx=0x7f6a14005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c3764efa10ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a0effd640 1 -- 172.21.15.5:0/1528694803 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14035040 con 0x563fb810bda0 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a0effd640 1 -- 172.21.15.5:0/1528694803 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a140054f0 con 0x563fb810bda0 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.744+0000 7f6a0effd640 1 -- 172.21.15.5:0/1528694803 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14004df0 con 0x563fb810bda0 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 -- 172.21.15.5:0/1528694803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 msgr2=0x563fb8108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 0x563fb8108bc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009900 tx=0x7f6a14005b90 comp rx=0 tx=0).stop 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 -- 172.21.15.5:0/1528694803 shutdown_connections 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb8117d30 0x563fb8123c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb810bda0 0x563fb8108bc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1528694803 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810b480 0x563fb810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 -- 172.21.15.5:0/1528694803 >> 172.21.15.5:0/1528694803 conn(0x563fb81092b0 msgr2=0x563fb810a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 -- 172.21.15.5:0/1528694803 shutdown_connections 2024-09-10T22:18:16.913 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 -- 172.21.15.5:0/1528694803 wait complete. 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 -- start start 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.745+0000 7f6a2de29740 1 Processor -- start 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810b480 0x563fb8120470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810bda0 0x563fb812edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb812f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241aec80 con 0x563fb8117d30 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241b00f0 con 0x563fb810b480 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6a241af350 con 0x563fb810bda0 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a2de29740 10 client.0 _ll_register_callbacks cb 0x7f6a1c009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a29ff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb812f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a29ff1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb812f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53108/0 (socket says 172.21.15.5:53108) 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a29ff1640 1 -- 172.21.15.5:0/1090670480 learned_addr learned my addr 172.21.15.5:0/1090670480 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810bda0 0x563fb812edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.914 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810b480 0x563fb8120470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a28fef640 1 -- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810b480 msgr2=0x563fb8120470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810b480 0x563fb8120470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a28fef640 1 -- 172.21.15.5:0/1090670480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 msgr2=0x563fb812f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb812f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.746+0000 7f6a28fef640 1 -- 172.21.15.5:0/1090670480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fb812fb20 con 0x563fb810bda0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a28fef640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810bda0 0x563fb812edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x563fb811a9d0 tx=0x7f6a14000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a771b136148e948e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a0cff9640 1 -- 172.21.15.5:0/1090670480 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14052030 con 0x563fb810bda0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a140054f0 con 0x563fb810bda0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a0cff9640 1 -- 172.21.15.5:0/1090670480 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6a14004100 con 0x563fb810bda0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a0cff9640 1 -- 172.21.15.5:0/1090670480 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6a14035040 con 0x563fb810bda0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a2de29740 10 client.25186 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563fb81943c0 con 0x563fb810bda0 2024-09-10T22:18:16.915 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a0cff9640 1 -- 172.21.15.5:0/1090670480 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6a140054f0 con 0x563fb810bda0 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.747+0000 7f6a0cff9640 1 -- 172.21.15.5:0/1090670480 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6a14003680 con 0x563fb810bda0 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a2de29740 10 client.25186 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a2de29740 10 client.25186 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a2de29740 20 client.25186 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8194a30 0x563fb8196e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a2de29740 4 client.25186 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563fb807f850 con 0x563fb8194a30 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8194a30 0x563fb8196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a0cff9640 10 client.25186 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.748+0000 7f6a29ff1640 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8194a30 0x563fb8196e50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3efcfa43a95f8d0 server_cookie=1bccce8a56e4f1b4 in_seq=0 out_seq=0 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a0cff9640 1 -- 172.21.15.5:0/1090670480 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x7f6a1c03c2a0 con 0x563fb8194a30 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a0cff9640 10 client.25186 handle_command_reply: tid=0 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 client.25186 shutdown 2024-09-10T22:18:16.916 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810bda0 msgr2=0x563fb812edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810bda0 0x563fb812edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x563fb811a9d0 tx=0x7f6a14000bc0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 shutdown_connections 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563fb8194a30 0x563fb8196e50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563fb8117d30 0x563fb812f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563fb810bda0 0x563fb812edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a0cff9640 0 client.25186 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 --2- 172.21.15.5:0/1090670480 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563fb810b480 0x563fb8120470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 >> 172.21.15.5:0/1090670480 conn(0x563fb81092b0 msgr2=0x563fb81160c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 shutdown_connections 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 1 -- 172.21.15.5:0/1090670480 wait complete. 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.749+0000 7f6a2de29740 20 client.25186 trim_cache size 0 max 16384 2024-09-10T22:18:16.917 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6a100b52e0 msgr2=0x7f6a100b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6a100b52e0 0x7f6a100b77a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6a200e3e40 tx=0x7f6a20018420 comp rx=0 tx=0).stop 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 msgr2=0x7f6a2419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 0x7f6a2419b540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f6a2000e9f0 tx=0x7f6a2000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 shutdown_connections 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6a100b52e0 0x7f6a100b77a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6a2410f3e0 0x7f6a241a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6a24102150 0x7f6a2419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 --2- 172.21.15.5:0/1603107568 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6a24101830 0x7f6a2419b540 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 >> 172.21.15.5:0/1603107568 conn(0x7f6a240fd700 msgr2=0x7f6a240ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 shutdown_connections 2024-09-10T22:18:16.918 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:16.750+0000 7f6a2ba54640 1 -- 172.21.15.5:0/1603107568 wait complete. 2024-09-10T22:18:17.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:17 smithi189 ceph-mon[35784]: pgmap v389: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 13 op/s 2024-09-10T22:18:17.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:17 smithi052 ceph-mon[34997]: pgmap v389: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 13 op/s 2024-09-10T22:18:17.756 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:17 smithi005 ceph-mon[31115]: pgmap v389: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 13 op/s 2024-09-10T22:18:17.799 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:18:17.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:18:18.075 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.551+0000 7ff14fa33640 1 -- 172.21.15.5:0/2755215638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1481087b0 msgr2=0x7ff148108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.551+0000 7ff14fa33640 1 --2- 172.21.15.5:0/2755215638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1481087b0 0x7ff148108bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff138009900 tx=0x7ff13802a410 comp rx=0 tx=0).stop 2024-09-10T22:18:18.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 -- 172.21.15.5:0/2755215638 shutdown_connections 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 --2- 172.21.15.5:0/2755215638 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff148109130 0x7ff14810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 --2- 172.21.15.5:0/2755215638 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff1481087b0 0x7ff148108bf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 --2- 172.21.15.5:0/2755215638 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff148102da0 0x7ff148103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 -- 172.21.15.5:0/2755215638 >> 172.21.15.5:0/2755215638 conn(0x7ff1480fe850 msgr2=0x7ff148100c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 -- 172.21.15.5:0/2755215638 shutdown_connections 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 -- 172.21.15.5:0/2755215638 wait complete. 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 Processor -- start 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.552+0000 7ff14fa33640 1 -- start start 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14fa33640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 0x7ff1480754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14fa33640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1481087b0 0x7ff1480759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14fa33640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff148109130 0x7ff148075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14fa33640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff148112df0 con 0x7ff148102da0 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14fa33640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff148112c70 con 0x7ff1481087b0 2024-09-10T22:18:18.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14fa33640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff148112f70 con 0x7ff148109130 2024-09-10T22:18:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 0x7ff1480754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 0x7ff1480754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53130/0 (socket says 172.21.15.5:53130) 2024-09-10T22:18:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 -- 172.21.15.5:0/3163943421 learned_addr learned my addr 172.21.15.5:0/3163943421 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14cfce640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1481087b0 0x7ff1480759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14dfd0640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff148109130 0x7ff148075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:18.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 -- 172.21.15.5:0/3163943421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff148109130 msgr2=0x7ff148075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:18.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff148109130 0x7ff148075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 -- 172.21.15.5:0/3163943421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1481087b0 msgr2=0x7ff1480759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:18.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1481087b0 0x7ff1480759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 -- 172.21.15.5:0/3163943421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1481a7660 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.553+0000 7ff14d7cf640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 0x7ff1480754a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d950 tx=0x7ff14400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.554+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144017070 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.554+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1481a7950 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.554+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff144009c30 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.554+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14400f620 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.554+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1481a7eb0 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.555+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff148103180 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.556+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff144010460 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.557+0000 7ff13e7fc640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1340b52e0 0x7ff1340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.557+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff1440e5790 con 0x7ff148102da0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.557+0000 7ff14cfce640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1340b52e0 0x7ff1340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.558+0000 7ff14cfce640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1340b52e0 0x7ff1340b77a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff138031440 tx=0x7ff138005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:18.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.565+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff144009de0 con 0x7ff148102da0 2024-09-10T22:18:18.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.790+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff14802e5c0 con 0x7ff148102da0 2024-09-10T22:18:18.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.791+0000 7ff13e7fc640 1 -- 172.21.15.5:0/3163943421 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7ff1440abfd0 con 0x7ff148102da0 2024-09-10T22:18:18.793 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:18:18.793 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:18:18.793 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:18:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1340b52e0 msgr2=0x7ff1340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1340b52e0 0x7ff1340b77a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff138031440 tx=0x7ff138005b50 comp rx=0 tx=0).stop 2024-09-10T22:18:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 msgr2=0x7ff1480754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 0x7ff1480754a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff14400d950 tx=0x7ff14400de10 comp rx=0 tx=0).stop 2024-09-10T22:18:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 shutdown_connections 2024-09-10T22:18:18.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff1340b52e0 0x7ff1340b77a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.793+0000 7ff14fa33640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff148109130 0x7ff148075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.794+0000 7ff14fa33640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff1481087b0 0x7ff1480759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.794+0000 7ff14fa33640 1 --2- 172.21.15.5:0/3163943421 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff148102da0 0x7ff1480754a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:18.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.794+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 >> 172.21.15.5:0/3163943421 conn(0x7ff1480fe850 msgr2=0x7ff148100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:18.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.794+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 shutdown_connections 2024-09-10T22:18:18.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:18.794+0000 7ff14fa33640 1 -- 172.21.15.5:0/3163943421 wait complete. 2024-09-10T22:18:19.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 -- 172.21.15.5:0/3400712651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9160105ae0 msgr2=0x7f9160107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 --2- 172.21.15.5:0/3400712651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9160105ae0 0x7f9160107f50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9150009900 tx=0x7f915002a410 comp rx=0 tx=0).stop 2024-09-10T22:18:19.134 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 -- 172.21.15.5:0/3400712651 shutdown_connections 2024-09-10T22:18:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 --2- 172.21.15.5:0/3400712651 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9160108690 0x7f916010ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 --2- 172.21.15.5:0/3400712651 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9160105ae0 0x7f9160107f50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 --2- 172.21.15.5:0/3400712651 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f916006b5e0 0x7f9160105550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 -- 172.21.15.5:0/3400712651 >> 172.21.15.5:0/3400712651 conn(0x7f91600fd140 msgr2=0x7f91600ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 -- 172.21.15.5:0/3400712651 shutdown_connections 2024-09-10T22:18:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 -- 172.21.15.5:0/3400712651 wait complete. 2024-09-10T22:18:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 Processor -- start 2024-09-10T22:18:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.131+0000 7f91686bd640 1 -- start start 2024-09-10T22:18:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f91686bd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 0x7f916019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f91686bd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9160105ae0 0x7f916019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f91686bd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9160108690 0x7f916019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f91686bd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f916010e5c0 con 0x7f916006b5e0 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f91686bd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f916010e440 con 0x7f9160108690 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f91686bd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f916010e740 con 0x7f9160105ae0 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 0x7f916019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 0x7f916019af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53156/0 (socket says 172.21.15.5:53156) 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 -- 172.21.15.5:0/610565514 learned_addr learned my addr 172.21.15.5:0/610565514 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9165c58640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9160105ae0 0x7f916019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166c5a640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9160108690 0x7f916019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 -- 172.21.15.5:0/610565514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9160105ae0 msgr2=0x7f916019b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9160105ae0 0x7f916019b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 -- 172.21.15.5:0/610565514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9160108690 msgr2=0x7f916019c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9160108690 0x7f916019c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 -- 172.21.15.5:0/610565514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916019cab0 con 0x7f916006b5e0 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.132+0000 7f9166459640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 0x7f916019af70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f915c00d950 tx=0x7f915c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.133+0000 7f91577fe640 1 -- 172.21.15.5:0/610565514 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c017030 con 0x7f916006b5e0 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.133+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916019cda0 con 0x7f916006b5e0 2024-09-10T22:18:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.133+0000 7f91577fe640 1 -- 172.21.15.5:0/610565514 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f915c004020 con 0x7f916006b5e0 2024-09-10T22:18:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.133+0000 7f91577fe640 1 -- 172.21.15.5:0/610565514 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c0047a0 con 0x7f916006b5e0 2024-09-10T22:18:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.133+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91601a3470 con 0x7f916006b5e0 2024-09-10T22:18:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.135+0000 7f916b492740 1 Processor -- start 2024-09-10T22:18:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.135+0000 7f916b492740 1 -- start start 2024-09-10T22:18:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.135+0000 7f916b492740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1df860 0x556ebd1e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.135+0000 7f916b492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f916b492740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd1e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f916b492740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556ebd1516f0 con 0x556ebd1e4bd0 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f916b492740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556ebd140b20 con 0x556ebd1df860 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f916b492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556ebd144930 con 0x556ebd1e2190 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9165c58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd1e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9165c58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd1e7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53158/0 (socket says 172.21.15.5:53158) 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9165c58640 1 -- 172.21.15.5:0/3142863267 learned_addr learned my addr 172.21.15.5:0/3142863267 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1df860 0x556ebd1e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f91577fe640 1 -- 172.21.15.5:0/610565514 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f915c009a30 con 0x7f916006b5e0 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 -- 172.21.15.5:0/3142863267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 msgr2=0x556ebd1e4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 -- 172.21.15.5:0/3142863267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 msgr2=0x556ebd1e7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd1e7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 -- 172.21.15.5:0/3142863267 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebd106530 con 0x556ebd1df860 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.136+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1df860 0x556ebd1e1c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9158005fd0 tx=0x7f9158010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f50e990b4e8ced54 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.137+0000 7f9154ff9640 1 -- 172.21.15.5:0/3142863267 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158016070 con 0x556ebd1df860 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.137+0000 7f9154ff9640 1 -- 172.21.15.5:0/3142863267 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9158004d20 con 0x556ebd1df860 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.137+0000 7f91577fe640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f914c0b52e0 0x7f914c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.137+0000 7f9154ff9640 1 -- 172.21.15.5:0/3142863267 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158012650 con 0x556ebd1df860 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.137+0000 7f9166459640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f914c0b52e0 0x7f914c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.137+0000 7f91577fe640 1 -- 172.21.15.5:0/610565514 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f915c0e55d0 con 0x7f916006b5e0 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- 172.21.15.5:0/3142863267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1df860 msgr2=0x556ebd1e1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f9166459640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f914c0b52e0 0x7f914c0b77a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f915c0abd50 tx=0x7f915c079290 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1df860 0x556ebd1e1c50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9158005fd0 tx=0x7f9158010740 comp rx=0 tx=0).stop 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- 172.21.15.5:0/3142863267 shutdown_connections 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd1e7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- 172.21.15.5:0/3142863267 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1df860 0x556ebd1e1c50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- 172.21.15.5:0/3142863267 >> 172.21.15.5:0/3142863267 conn(0x556ebd1da9b0 msgr2=0x556ebd1db740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- 172.21.15.5:0/3142863267 shutdown_connections 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- 172.21.15.5:0/3142863267 wait complete. 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- start start 2024-09-10T22:18:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 Processor -- start 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1e8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e4bd0 0x556ebd1ea160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556ebd078ab0 con 0x556ebd1df860 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556ebd0e6730 con 0x556ebd1e4bd0 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.138+0000 7f916b492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556ebd1e7bb0 con 0x556ebd1e2190 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f916b492740 10 client.0 _ll_register_callbacks cb 0x556ebd13a6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1e8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1e8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53162/0 (socket says 172.21.15.5:53162) 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 -- 172.21.15.5:0/4075913728 learned_addr learned my addr 172.21.15.5:0/4075913728 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e4bd0 0x556ebd1ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9165c58640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 -- 172.21.15.5:0/4075913728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 msgr2=0x556ebd1e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 -- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e4bd0 msgr2=0x556ebd1ea160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e4bd0 0x556ebd1ea160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 -- 172.21.15.5:0/4075913728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebcea2790 con 0x556ebd1df860 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9166c5a640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1e8ef0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9158005c10 tx=0x7f9158009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31fdd35656851115 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9149ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9149ffb640 1 -- 172.21.15.5:0/4075913728 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158016070 con 0x556ebd1df860 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9158004d20 con 0x556ebd1df860 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.139+0000 7f9149ffb640 1 -- 172.21.15.5:0/4075913728 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f9158003b70 con 0x556ebd1df860 2024-09-10T22:18:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f9149ffb640 1 -- 172.21.15.5:0/4075913728 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9158032050 con 0x556ebd1df860 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 10 client.15606 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ebcf1b620 con 0x556ebd1df860 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f9149ffb640 1 -- 172.21.15.5:0/4075913728 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9158004d20 con 0x556ebd1df860 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f9149ffb640 1 -- 172.21.15.5:0/4075913728 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f915800f040 con 0x556ebd1df860 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 10 client.15606 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 10 client.15606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 20 client.15606 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd1f4450 0x556ebd1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 4 client.15606 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ebd153640 con 0x556ebd1f4450 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.140+0000 7f9165c58640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd1f4450 0x556ebd1f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.141+0000 7f9149ffb640 10 client.15606 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.141+0000 7f9165c58640 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd1f4450 0x556ebd1f6840 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3612e8834ea6436 server_cookie=c5bef70ee1a33104 in_seq=0 out_seq=0 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.141+0000 7f9149ffb640 1 -- 172.21.15.5:0/4075913728 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ebd153640 con 0x556ebd1f4450 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f9149ffb640 10 client.15606 handle_command_reply: tid=0 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 client.15606 shutdown 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 msgr2=0x556ebd1e8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1e8ef0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9158005c10 tx=0x7f9158009ad0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 shutdown_connections 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd1f4450 0x556ebd1f6840 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e4bd0 0x556ebd1ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e2190 0x556ebd1e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f9149ffb640 0 client.15606 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 --2- 172.21.15.5:0/4075913728 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1e8ef0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 >> 172.21.15.5:0/4075913728 conn(0x556ebd1da9b0 msgr2=0x556ebd1d9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 shutdown_connections 2024-09-10T22:18:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 1 -- 172.21.15.5:0/4075913728 wait complete. 2024-09-10T22:18:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.142+0000 7f916b492740 20 client.15606 trim_cache size 0 max 16384 2024-09-10T22:18:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 Processor -- start 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 -- start start 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1db450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1db990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e4bd0 0x556ebd1decf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91601ae9c0 con 0x556ebd1df860 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91601ac290 con 0x556ebd1e2190 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f916b492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91601aa0e0 con 0x556ebd1e4bd0 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f9166c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f9166c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1db450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53168/0 (socket says 172.21.15.5:53168) 2024-09-10T22:18:19.164 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f9166c5a640 1 -- 172.21.15.5:0/1325717157 learned_addr learned my addr 172.21.15.5:0/1325717157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f9165c58640 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.157+0000 7f9166c5a640 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e4bd0 0x556ebd1decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9166c5a640 1 -- 172.21.15.5:0/1325717157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e4bd0 msgr2=0x556ebd1decf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9166c5a640 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e4bd0 0x556ebd1decf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9166c5a640 1 -- 172.21.15.5:0/1325717157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 msgr2=0x556ebd1db990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9166c5a640 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1db990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9166c5a640 1 -- 172.21.15.5:0/1325717157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ebd1e1fc0 con 0x556ebd1df860 2024-09-10T22:18:19.165 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9165c58640 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f9166c5a640 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1db450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9158009aa0 tx=0x7f9158005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7b424c3a91c036 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f914bfff640 1 -- 172.21.15.5:0/1325717157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158016040 con 0x556ebd1df860 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f914bfff640 1 -- 172.21.15.5:0/1325717157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9158025040 con 0x556ebd1df860 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.158+0000 7f914bfff640 1 -- 172.21.15.5:0/1325717157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915801a7d0 con 0x556ebd1df860 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 -- 172.21.15.5:0/1325717157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 msgr2=0x556ebd1db450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1db450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9158009aa0 tx=0x7f9158005c40 comp rx=0 tx=0).stop 2024-09-10T22:18:19.166 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 -- 172.21.15.5:0/1325717157 shutdown_connections 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1e4bd0 0x556ebd1decf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 --2- 172.21.15.5:0/1325717157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1df860 0x556ebd1db450 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 -- 172.21.15.5:0/1325717157 >> 172.21.15.5:0/1325717157 conn(0x556ebd1da9b0 msgr2=0x556ebd1e8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 -- 172.21.15.5:0/1325717157 shutdown_connections 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 -- 172.21.15.5:0/1325717157 wait complete. 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 -- start start 2024-09-10T22:18:19.167 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 Processor -- start 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1df860 0x556ebd1f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.159+0000 7f916b492740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f916b492740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd25f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f916b492740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f91601aa750 con 0x556ebd1e4bd0 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f916b492740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f91601abbc0 con 0x556ebd1e2190 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f916b492740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f91601aae20 con 0x556ebd1df860 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f916b492740 10 client.0 _ll_register_callbacks cb 0x7f9150005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd25f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd25f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53172/0 (socket says 172.21.15.5:53172) 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 -- 172.21.15.5:0/3863029157 learned_addr learned my addr 172.21.15.5:0/3863029157 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1df860 0x556ebd1f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.168 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9165c58640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 -- 172.21.15.5:0/3863029157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1df860 msgr2=0x556ebd1f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1df860 0x556ebd1f0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 -- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 msgr2=0x556ebd1f0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1f0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 -- 172.21.15.5:0/3863029157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ebd25f770 con 0x556ebd1e4bd0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9166c5a640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd25f230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9158005d70 tx=0x7f915802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3b8a29f4ec3e76 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9149ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9149ffb640 1 -- 172.21.15.5:0/3863029157 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915803b040 con 0x556ebd1e4bd0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f9149ffb640 1 -- 172.21.15.5:0/3863029157 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f915801a7d0 con 0x556ebd1e4bd0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.160+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9158025040 con 0x556ebd1e4bd0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f9149ffb640 1 -- 172.21.15.5:0/3863029157 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9158049050 con 0x556ebd1e4bd0 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 10 client.15612 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:19.169 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ebd260a80 con 0x556ebd1e4bd0 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f9149ffb640 1 -- 172.21.15.5:0/3863029157 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9158025040 con 0x556ebd1e4bd0 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f9149ffb640 1 -- 172.21.15.5:0/3863029157 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9158041070 con 0x556ebd1e4bd0 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 10 client.15612 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 20 client.15612 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd261340 0x556ebd263760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 4 client.15612 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556ebd1f6de0 con 0x556ebd261340 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.161+0000 7f9165c58640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd261340 0x556ebd263760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.162+0000 7f9149ffb640 10 client.15612 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:19.170 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.162+0000 7f9165c58640 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd261340 0x556ebd263760 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd630d246e5e4981 server_cookie=313c04e2f1da486b in_seq=0 out_seq=0 2024-09-10T22:18:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.170+0000 7f9149ffb640 1 -- 172.21.15.5:0/3863029157 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556ebd1f6de0 con 0x556ebd261340 2024-09-10T22:18:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.170+0000 7f9149ffb640 10 client.15612 handle_command_reply: tid=0 2024-09-10T22:18:19.172 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.170+0000 7f916b492740 1 client.15612 shutdown 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 msgr2=0x556ebd25f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd25f230 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9158005d70 tx=0x7f915802d040 comp rx=0 tx=0).stop 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 shutdown_connections 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x556ebd261340 0x556ebd263760 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556ebd1e4bd0 0x556ebd25f230 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556ebd1e2190 0x556ebd1f0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 --2- 172.21.15.5:0/3863029157 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556ebd1df860 0x556ebd1f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 >> 172.21.15.5:0/3863029157 conn(0x556ebd1da9b0 msgr2=0x556ebd1e8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f9149ffb640 0 client.15612 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 shutdown_connections 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 1 -- 172.21.15.5:0/3863029157 wait complete. 2024-09-10T22:18:19.173 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.171+0000 7f916b492740 20 client.15612 trim_cache size 0 max 16384 2024-09-10T22:18:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:18:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:18:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:18:19.174 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f914c0b52e0 msgr2=0x7f914c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f914c0b52e0 0x7f914c0b77a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f915c0abd50 tx=0x7f915c079290 comp rx=0 tx=0).stop 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 msgr2=0x7f916019af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 0x7f916019af70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f915c00d950 tx=0x7f915c00de10 comp rx=0 tx=0).stop 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 shutdown_connections 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f914c0b52e0 0x7f914c0b77a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9160108690 0x7f916019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9160105ae0 0x7f916019b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 --2- 172.21.15.5:0/610565514 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f916006b5e0 0x7f916019af70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 >> 172.21.15.5:0/610565514 conn(0x7f91600fd140 msgr2=0x7f91600ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 shutdown_connections 2024-09-10T22:18:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:19.172+0000 7f91686bd640 1 -- 172.21.15.5:0/610565514 wait complete. 2024-09-10T22:18:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:19 smithi005 ceph-mon[31115]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 861 KiB/s wr, 11 op/s 2024-09-10T22:18:19.474 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3163943421' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:18:19.507 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:18:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:19 smithi189 ceph-mon[35784]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 861 KiB/s wr, 11 op/s 2024-09-10T22:18:19.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3163943421' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:18:19.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:19 smithi052 ceph-mon[34997]: pgmap v390: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 861 KiB/s wr, 11 op/s 2024-09-10T22:18:19.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:19 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3163943421' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:18:19.780 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 -- 172.21.15.5:0/418788173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd810d100 msgr2=0x7f3fd810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.286 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/418788173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd810d100 0x7f3fd810f560 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009ca0 tx=0x7f3fd002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 -- 172.21.15.5:0/418788173 shutdown_connections 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/418788173 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd810d100 0x7f3fd810f560 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/418788173 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd81045c0 0x7f3fd810cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/418788173 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fd8103ca0 0x7f3fd8104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 -- 172.21.15.5:0/418788173 >> 172.21.15.5:0/418788173 conn(0x7f3fd80fd700 msgr2=0x7f3fd80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 -- 172.21.15.5:0/418788173 shutdown_connections 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.265+0000 7f3fdd60a640 1 -- 172.21.15.5:0/418788173 wait complete. 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 Processor -- start 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 -- start start 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fd8103ca0 0x7f3fd8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 0x7f3fd81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd810d100 0x7f3fd819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.287 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd8112dc0 con 0x7f3fd81045c0 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd8112c40 con 0x7f3fd8103ca0 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.266+0000 7f3fdd60a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd8112f40 con 0x7f3fd810d100 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 0x7f3fd81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 0x7f3fd81997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53190/0 (socket says 172.21.15.5:53190) 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 -- 172.21.15.5:0/1316638778 learned_addr learned my addr 172.21.15.5:0/1316638778 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fd8103ca0 0x7f3fd8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd810d100 0x7f3fd819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 -- 172.21.15.5:0/1316638778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd810d100 msgr2=0x7f3fd819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd810d100 0x7f3fd819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 -- 172.21.15.5:0/1316638778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fd8103ca0 msgr2=0x7f3fd8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fd8103ca0 0x7f3fd8199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 -- 172.21.15.5:0/1316638778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd819f320 con 0x7f3fd81045c0 2024-09-10T22:18:20.288 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 0x7f3fd81997b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00d6b0 tx=0x7f3fcc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fbffff640 1 -- 172.21.15.5:0/1316638778 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc017070 con 0x7f3fd81045c0 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fbffff640 1 -- 172.21.15.5:0/1316638778 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fcc010460 con 0x7f3fd81045c0 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fbffff640 1 -- 172.21.15.5:0/1316638778 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fcc00f620 con 0x7f3fd81045c0 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.267+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd819f610 con 0x7f3fd81045c0 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.268+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd81a5cd0 con 0x7f3fd81045c0 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 Processor -- start 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 -- start start 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 0x556cb0c1b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.289 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fbffff640 1 -- 172.21.15.5:0/1316638778 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3fcc00f7c0 con 0x7f3fd81045c0 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c1e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556cb0b85ea0 con 0x556cb0c0fdf0 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556cb0b752d0 con 0x556cb0c1bd80 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556cb0b790e0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 0x556cb0c1b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 0x556cb0c1b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53194/0 (socket says 172.21.15.5:53194) 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/2000195959 learned_addr learned my addr 172.21.15.5:0/2000195959 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c1e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.271+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/2000195959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 msgr2=0x556cb0c0f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/2000195959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 msgr2=0x556cb0c1e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c1e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.290 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/2000195959 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb08d3650 con 0x556cb0c0fdf0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 0x556cb0c1b840 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800bd10 tx=0x7f3fc80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edf71c483cf3417 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fbd7fa640 1 -- 172.21.15.5:0/2000195959 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8004030 con 0x556cb0c0fdf0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fbd7fa640 1 -- 172.21.15.5:0/2000195959 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc80035f0 con 0x556cb0c0fdf0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fbd7fa640 1 -- 172.21.15.5:0/2000195959 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8011750 con 0x556cb0c0fdf0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fbffff640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3fc00b5360 0x7f3fc00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3fc00b5360 0x7f3fc00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.272+0000 7f3fbffff640 1 -- 172.21.15.5:0/1316638778 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3fcc0e5740 con 0x7f3fd81045c0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 -- 172.21.15.5:0/2000195959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 msgr2=0x556cb0c1b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3fc00b5360 0x7f3fc00b7820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006010 tx=0x7f3fd0005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 0x556cb0c1b840 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800bd10 tx=0x7f3fc80107a0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 -- 172.21.15.5:0/2000195959 shutdown_connections 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c1e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.291 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0fdf0 0x556cb0c1b840 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/2000195959 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 -- 172.21.15.5:0/2000195959 >> 172.21.15.5:0/2000195959 conn(0x556cb0c0d300 msgr2=0x556cb0c0e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 -- 172.21.15.5:0/2000195959 shutdown_connections 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 -- 172.21.15.5:0/2000195959 wait complete. 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.273+0000 7f3fdf9df740 1 -- start start 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 Processor -- start 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c1b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c189e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c18f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556cb09d6700 con 0x556cb0c0f4d0 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556cb0b10160 con 0x556cb0c1bd80 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x556cb0c1ea00 con 0x556cb0c0fdf0 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c1b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.292 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c1b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53210/0 (socket says 172.21.15.5:53210) 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/3836656727 learned_addr learned my addr 172.21.15.5:0/3836656727 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fdf9df740 10 client.0 _ll_register_callbacks cb 0x556cb0b299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c189e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c18f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 msgr2=0x556cb0c189e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c189e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/3836656727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 msgr2=0x556cb0c18f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c18f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/3836656727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb0b3dc90 con 0x556cb0c0f4d0 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.274+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c18f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c1b590 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8005910 tx=0x7f3fc8003d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d8501dd5873f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:20.293 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fbaff5640 1 -- 172.21.15.5:0/3836656727 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8029060 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fbaff5640 1 -- 172.21.15.5:0/3836656727 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3fc80039b0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fc80035f0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fbaff5640 1 -- 172.21.15.5:0/3836656727 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3fc8004000 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fdf9df740 10 client.15624 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556cb0c2a290 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fbaff5640 1 -- 172.21.15.5:0/3836656727 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fc80035f0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fbaff5640 1 -- 172.21.15.5:0/3836656727 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3fc80046c0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fdf9df740 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fdf9df740 10 client.15624 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.275+0000 7f3fdf9df740 20 client.15624 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:20.294 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.276+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c2b690 0x556cb0c2da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.276+0000 7f3fdf9df740 4 client.15624 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.276+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cb0b87df0 con 0x556cb0c2b690 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.276+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c2b690 0x556cb0c2da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.276+0000 7f3fbaff5640 10 client.15624 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.276+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c2b690 0x556cb0c2da80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e2ef982c342897b server_cookie=68f8211c50ac9a02 in_seq=0 out_seq=0 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fbaff5640 1 -- 172.21.15.5:0/3836656727 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556cb0b87df0 con 0x556cb0c2b690 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fbaff5640 10 client.15624 handle_command_reply: tid=0 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 client.15624 shutdown 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 msgr2=0x556cb0c1b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c1b590 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8005910 tx=0x7f3fc8003d20 comp rx=0 tx=0).stop 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 shutdown_connections 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c2b690 0x556cb0c2da80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c18f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.295 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fbaff5640 0 client.15624 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/3836656727 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c1b590 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 >> 172.21.15.5:0/3836656727 conn(0x556cb0c0d300 msgr2=0x556cb0c12ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 shutdown_connections 2024-09-10T22:18:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 1 -- 172.21.15.5:0/3836656727 wait complete. 2024-09-10T22:18:20.296 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.277+0000 7f3fdf9df740 20 client.15624 trim_cache size 0 max 16384 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 Processor -- start 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 -- start start 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c0fdf0 0x556cb0c15c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 0x556cb0c16150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81b0c20 con 0x556cb0c1bd80 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81ae4f0 con 0x556cb0c0fdf0 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.291+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81ac340 con 0x556cb0c0f4d0 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 0x556cb0c16150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.301 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 0x556cb0c16150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53218/0 (socket says 172.21.15.5:53218) 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 -- 172.21.15.5:0/48311529 learned_addr learned my addr 172.21.15.5:0/48311529 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c0fdf0 0x556cb0c15c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 -- 172.21.15.5:0/48311529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 msgr2=0x556cb0c0c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 -- 172.21.15.5:0/48311529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c0fdf0 msgr2=0x556cb0c15c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c0fdf0 0x556cb0c15c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 -- 172.21.15.5:0/48311529 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cb0c1b900 con 0x556cb0c1bd80 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c0fdf0 0x556cb0c15c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 0x556cb0c16150 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0035000 tx=0x7f3fd0041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06a785a1a602de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fbcff9640 1 -- 172.21.15.5:0/48311529 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0003970 con 0x556cb0c1bd80 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fbcff9640 1 -- 172.21.15.5:0/48311529 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fd0036050 con 0x556cb0c1bd80 2024-09-10T22:18:20.302 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.292+0000 7f3fbcff9640 1 -- 172.21.15.5:0/48311529 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0004800 con 0x556cb0c1bd80 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 -- 172.21.15.5:0/48311529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 msgr2=0x556cb0c16150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 0x556cb0c16150 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0035000 tx=0x7f3fd0041000 comp rx=0 tx=0).stop 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 -- 172.21.15.5:0/48311529 shutdown_connections 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c1bd80 0x556cb0c16150 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c0fdf0 0x556cb0c15c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/48311529 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0f4d0 0x556cb0c0c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 -- 172.21.15.5:0/48311529 >> 172.21.15.5:0/48311529 conn(0x556cb0c0d300 msgr2=0x556cb0c0bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 -- 172.21.15.5:0/48311529 shutdown_connections 2024-09-10T22:18:20.303 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.293+0000 7f3fdf9df740 1 -- 172.21.15.5:0/48311529 wait complete. 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 -- start start 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 Processor -- start 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c24230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c20cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81ac9b0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81ade20 con 0x556cb0c1bd80 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd81ad080 con 0x556cb0c0fdf0 2024-09-10T22:18:20.304 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fdf9df740 10 client.0 _ll_register_callbacks cb 0x7f3fcc0eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fd6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c23cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53230/0 (socket says 172.21.15.5:53230) 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/4036681870 learned_addr learned my addr 172.21.15.5:0/4036681870 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c24230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.294+0000 7f3fd77fe640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c20cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 msgr2=0x556cb0c24230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c24230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/4036681870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 msgr2=0x556cb0c20cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c20cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fd6ffd640 1 -- 172.21.15.5:0/4036681870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cb0c24a60 con 0x556cb0c0f4d0 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fd6ffd640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c23cf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8011010 tx=0x7f3fc8011510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf16a4cf52e4a3ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:20.305 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fbaff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fbaff5640 1 -- 172.21.15.5:0/4036681870 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc8029070 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fbaff5640 1 -- 172.21.15.5:0/4036681870 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3fc80046e0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fd0036050 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fbaff5640 1 -- 172.21.15.5:0/4036681870 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3fc8034070 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fdf9df740 10 client.15630 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556cb0c98830 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fbaff5640 1 -- 172.21.15.5:0/4036681870 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3fd0036050 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.295+0000 7f3fbaff5640 1 -- 172.21.15.5:0/4036681870 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3fc80051b0 con 0x556cb0c0f4d0 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 10 client.15630 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 10 client.15630 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:18:20.306 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 20 client.15630 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c98f10 0x556cb0c9b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 4 client.15630 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556cb0b838a0 con 0x556cb0c98f10 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c98f10 0x556cb0c9b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fbaff5640 10 client.15630 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fd67fc640 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c98f10 0x556cb0c9b330 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6ddce151c95bdf5 server_cookie=dcb2ca29c9256103 in_seq=0 out_seq=0 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fbaff5640 1 -- 172.21.15.5:0/4036681870 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556cb0b838a0 con 0x556cb0c98f10 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fbaff5640 10 client.15630 handle_command_reply: tid=0 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.296+0000 7f3fdf9df740 1 client.15630 shutdown 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 msgr2=0x556cb0c23cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c23cf0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8011010 tx=0x7f3fc8011510 comp rx=0 tx=0).stop 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 shutdown_connections 2024-09-10T22:18:20.307 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x556cb0c98f10 0x556cb0c9b330 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x556cb0c1bd80 0x556cb0c20cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556cb0c0fdf0 0x556cb0c24230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fbaff5640 0 client.15630 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 --2- 172.21.15.5:0/4036681870 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556cb0c0f4d0 0x556cb0c23cf0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 >> 172.21.15.5:0/4036681870 conn(0x556cb0c0d300 msgr2=0x556cb0c0c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 shutdown_connections 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 1 -- 172.21.15.5:0/4036681870 wait complete. 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdf9df740 20 client.15630 trim_cache size 0 max 16384 2024-09-10T22:18:20.308 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:18:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3fc00b5360 msgr2=0x7f3fc00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.297+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3fc00b5360 0x7f3fc00b7820 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0006010 tx=0x7f3fd0005d80 comp rx=0 tx=0).stop 2024-09-10T22:18:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 msgr2=0x7f3fd81997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 0x7f3fd81997b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc00d6b0 tx=0x7f3fcc00db70 comp rx=0 tx=0).stop 2024-09-10T22:18:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 shutdown_connections 2024-09-10T22:18:20.309 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3fc00b5360 0x7f3fc00b7820 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3fd810d100 0x7f3fd819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3fd81045c0 0x7f3fd81997b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 --2- 172.21.15.5:0/1316638778 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3fd8103ca0 0x7f3fd8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 >> 172.21.15.5:0/1316638778 conn(0x7f3fd80fd700 msgr2=0x7f3fd810f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 shutdown_connections 2024-09-10T22:18:20.310 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:20.298+0000 7f3fdd60a640 1 -- 172.21.15.5:0/1316638778 wait complete. 2024-09-10T22:18:20.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:18:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:21.679 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:21 smithi005 ceph-mon[31115]: pgmap v391: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:21.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:21 smithi189 ceph-mon[35784]: pgmap v391: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:21.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:21 smithi052 ceph-mon[34997]: pgmap v391: 97 pgs: 97 active+clean; 1.8 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:21.788 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 -- 172.21.15.5:0/2463176077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc102d90 msgr2=0x7f2fdc103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 --2- 172.21.15.5:0/2463176077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc102d90 0x7f2fdc103170 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009900 tx=0x7f2fcc02a410 comp rx=0 tx=0).stop 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 -- 172.21.15.5:0/2463176077 shutdown_connections 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 --2- 172.21.15.5:0/2463176077 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fdc109120 0x7f2fdc10f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 --2- 172.21.15.5:0/2463176077 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc108be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 --2- 172.21.15.5:0/2463176077 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc102d90 0x7f2fdc103170 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.766+0000 7f2fe295a640 1 -- 172.21.15.5:0/2463176077 >> 172.21.15.5:0/2463176077 conn(0x7f2fdc0fe820 msgr2=0x7f2fdc100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 -- 172.21.15.5:0/2463176077 shutdown_connections 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 -- 172.21.15.5:0/2463176077 wait complete. 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 Processor -- start 2024-09-10T22:18:21.789 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 -- start start 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fdc102d90 0x7f2fdc1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fdc109120 0x7f2fdc19ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc112e30 con 0x7f2fdc1087a0 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc112cb0 con 0x7f2fdc109120 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.767+0000 7f2fe295a640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc112fb0 con 0x7f2fdc102d90 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53242/0 (socket says 172.21.15.5:53242) 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 -- 172.21.15.5:0/3664054780 learned_addr learned my addr 172.21.15.5:0/3664054780 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fdc109120 0x7f2fdc19ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fdc102d90 0x7f2fdc1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.790 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 -- 172.21.15.5:0/3664054780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fdc102d90 msgr2=0x7f2fdc1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fdc102d90 0x7f2fdc1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 -- 172.21.15.5:0/3664054780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fdc109120 msgr2=0x7f2fdc19ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fdc109120 0x7f2fdc19ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 -- 172.21.15.5:0/3664054780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc19f390 con 0x7f2fdc1087a0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc199820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400d770 tx=0x7f2fc400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.768+0000 7f2fd9ffb640 1 -- 172.21.15.5:0/3664054780 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4017070 con 0x7f2fdc1087a0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.769+0000 7f2fd9ffb640 1 -- 172.21.15.5:0/3664054780 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fc40054d0 con 0x7f2fdc1087a0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.769+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc19f680 con 0x7f2fdc1087a0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.769+0000 7f2fd9ffb640 1 -- 172.21.15.5:0/3664054780 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4004c30 con 0x7f2fdc1087a0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.769+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc1a5d40 con 0x7f2fdc1087a0 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 Processor -- start 2024-09-10T22:18:21.791 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 -- start start 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98efa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98efd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560b98e64ea0 con 0x560b98efad80 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b98e542d0 con 0x560b98eee4d0 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.771+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560b98e580e0 con 0x560b98eeedf0 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98efa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fe0ef7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98efa840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:37054/0 (socket says 172.21.15.5:37054) 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fe0ef7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eee8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:60322/0 (socket says 172.21.15.5:60322) 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 -- 172.21.15.5:0/3028676759 learned_addr learned my addr 172.21.15.5:0/3028676759 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:21.792 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 -- 172.21.15.5:0/3028676759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 msgr2=0x560b98eee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 -- 172.21.15.5:0/3028676759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 msgr2=0x560b98efd170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98efd170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 -- 172.21.15.5:0/3028676759 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b98bb2650 con 0x560b98eeedf0 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98efa840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc000c00 tx=0x7f2fcc004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16e77d6e941a2696 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.772+0000 7f2fd9ffb640 1 -- 172.21.15.5:0/3664054780 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f2fc4004e10 con 0x7f2fdc1087a0 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fd27fc640 1 -- 172.21.15.5:0/3028676759 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc035040 con 0x560b98eeedf0 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fd27fc640 1 -- 172.21.15.5:0/3028676759 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fcc0054f0 con 0x560b98eeedf0 2024-09-10T22:18:21.793 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fd27fc640 1 -- 172.21.15.5:0/3028676759 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc003850 con 0x560b98eeedf0 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/3028676759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 msgr2=0x560b98efa840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98efa840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc000c00 tx=0x7f2fcc004180 comp rx=0 tx=0).stop 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/3028676759 shutdown_connections 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98efd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98efa840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/3028676759 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.773+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/3028676759 >> 172.21.15.5:0/3028676759 conn(0x560b98eec300 msgr2=0x560b98eed4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/3028676759 shutdown_connections 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fd9ffb640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2fc80b5290 0x7f2fc80b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/3028676759 wait complete. 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2fc80b5290 0x7f2fc80b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fd9ffb640 1 -- 172.21.15.5:0/3664054780 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f2fc40e55d0 con 0x7f2fdc1087a0 2024-09-10T22:18:21.794 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fe4d2f740 1 -- start start 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fe4d2f740 1 Processor -- start 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.774+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2fc80b5290 0x7f2fc80b7750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0057c0 tx=0x7f2fcc031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eee4d0 0x560b98efa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 0x560b98ef7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98efad80 0x560b98ef7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x560b98cb5700 con 0x560b98eeedf0 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x560b98def160 con 0x560b98efad80 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x560b98efd9a0 con 0x560b98eee4d0 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe4d2f740 10 client.0 _ll_register_callbacks cb 0x560b98e089e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 0x560b98ef7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 0x560b98ef7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53258/0 (socket says 172.21.15.5:53258) 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 -- 172.21.15.5:0/2093204213 learned_addr learned my addr 172.21.15.5:0/2093204213 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:21.795 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 -- 172.21.15.5:0/2093204213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eee4d0 msgr2=0x560b98efa600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eee4d0 0x560b98efa600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 -- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98efad80 msgr2=0x560b98ef7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98efad80 0x560b98ef7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98efad80 0x560b98ef7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 -- 172.21.15.5:0/2093204213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b98e1cc90 con 0x560b98eeedf0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98efad80 0x560b98ef7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 0x560b98ef7a50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009f40 tx=0x7f2fc40ab5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6ae3c7c7779ee1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.775+0000 7f2fbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2093204213 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4020070 con 0x560b98eeedf0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2093204213 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f2fc40930b0 con 0x560b98eeedf0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fcc0054f0 con 0x560b98eeedf0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2093204213 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2fc4005330 con 0x560b98eeedf0 2024-09-10T22:18:21.796 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 10 client.15639 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b98f092a0 con 0x560b98eeedf0 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2093204213 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fcc0054f0 con 0x560b98eeedf0 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2093204213 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2fc40a77c0 con 0x560b98eeedf0 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 10 client.15639 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 10 client.15639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 20 client.15639 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f0a760 0x560b98f0cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 4 client.15639 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.776+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b98e66df0 con 0x560b98f0a760 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.777+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f0a760 0x560b98f0cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.777+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f0a760 0x560b98f0cb50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e27630b3f1298f1 server_cookie=c5f83d3741183274 in_seq=0 out_seq=0 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.777+0000 7f2fbb7fe640 10 client.15639 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:21.797 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2093204213 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b98e66df0 con 0x560b98f0a760 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fbb7fe640 10 client.15639 handle_command_reply: tid=0 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 client.15639 shutdown 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 msgr2=0x560b98ef7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 0x560b98ef7a50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4009f40 tx=0x7f2fc40ab5e0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 shutdown_connections 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98efad80 0x560b98ef7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f0a760 0x560b98f0cb50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98eeedf0 0x560b98ef7a50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2093204213 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eee4d0 0x560b98efa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fbb7fe640 0 client.15639 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 >> 172.21.15.5:0/2093204213 conn(0x560b98eec300 msgr2=0x560b98ef1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 shutdown_connections 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2093204213 wait complete. 2024-09-10T22:18:21.798 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.778+0000 7f2fe4d2f740 20 client.15639 trim_cache size 0 max 16384 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 Processor -- start 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 -- start start 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98ef9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98ef4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98ef51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc1b0af0 con 0x560b98efad80 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc1ae3c0 con 0x560b98eee4d0 2024-09-10T22:18:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc1ac210 con 0x560b98eeedf0 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe0ef7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98ef51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe0ef7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98ef51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53262/0 (socket says 172.21.15.5:53262) 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/1110356406 learned_addr learned my addr 172.21.15.5:0/1110356406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.807+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98ef4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98ef9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/1110356406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 msgr2=0x560b98ef4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98ef4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/1110356406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 msgr2=0x560b98ef9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98ef9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/1110356406 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b98eed9e0 con 0x560b98efad80 2024-09-10T22:18:21.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98ef4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98ef51c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4012470 tx=0x7f2fd4012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25066731faa913bb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fd1ffb640 1 -- 172.21.15.5:0/1110356406 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4004b20 con 0x560b98efad80 2024-09-10T22:18:21.813 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fd1ffb640 1 -- 172.21.15.5:0/1110356406 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fd4003e20 con 0x560b98efad80 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.808+0000 7f2fd1ffb640 1 -- 172.21.15.5:0/1110356406 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4005020 con 0x560b98efad80 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/1110356406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 msgr2=0x560b98ef51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98ef51c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4012470 tx=0x7f2fd4012870 comp rx=0 tx=0).stop 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/1110356406 shutdown_connections 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98ef51c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98ef4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/1110356406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98ef9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/1110356406 >> 172.21.15.5:0/1110356406 conn(0x560b98eec300 msgr2=0x560b98ef9080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/1110356406 shutdown_connections 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.809+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/1110356406 wait complete. 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 -- start start 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 Processor -- start 2024-09-10T22:18:21.814 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98effab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98f705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc1ac880 con 0x560b98efad80 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc1adcf0 con 0x560b98eee4d0 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc1acf50 con 0x560b98eeedf0 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe4d2f740 10 client.0 _ll_register_callbacks cb 0x7f2fc4005ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe0ef7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98f705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe0ef7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98f705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:53276/0 (socket says 172.21.15.5:53276) 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/2940384537 learned_addr learned my addr 172.21.15.5:0/2940384537 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.810+0000 7f2fd3fff640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98effab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/2940384537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 msgr2=0x560b98effab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98effab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.815 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 msgr2=0x560b98eff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe0ef7640 1 -- 172.21.15.5:0/2940384537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b98f70ce0 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe0ef7640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98f705d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4000f80 tx=0x7f2fd4004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282f6fff6406cae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fbb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2940384537 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4003970 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2940384537 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f2fd4003b10 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fd4003e20 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2940384537 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2fd4004a40 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe4d2f740 10 client.15645 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.811+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b98f78080 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2940384537 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fd4003e20 con 0x560b98efad80 2024-09-10T22:18:21.816 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2940384537 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2fd402d030 con 0x560b98efad80 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fe4d2f740 10 client.15645 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fe4d2f740 10 client.15645 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fe4d2f740 20 client.15645 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f787a0 0x560b98f7abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fe4d2f740 4 client.15645 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b98e628a0 con 0x560b98f787a0 2024-09-10T22:18:21.817 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.812+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f787a0 0x560b98f7abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fbb7fe640 10 client.15645 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fdbfff640 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f787a0 0x560b98f7abc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87ec41912fda7de1 server_cookie=f40a79ff6778ced1 in_seq=0 out_seq=0 2024-09-10T22:18:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fbb7fe640 1 -- 172.21.15.5:0/2940384537 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b98e628a0 con 0x560b98f787a0 2024-09-10T22:18:21.818 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fbb7fe640 10 client.15645 handle_command_reply: tid=0 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 client.15645 shutdown 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 msgr2=0x560b98f705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98f705d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4000f80 tx=0x7f2fd4004890 comp rx=0 tx=0).stop 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 shutdown_connections 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x560b98f787a0 0x560b98f7abc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fbb7fe640 0 client.15645 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x560b98efad80 0x560b98f705d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x560b98eeedf0 0x560b98effab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 --2- 172.21.15.5:0/2940384537 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x560b98eee4d0 0x560b98eff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 >> 172.21.15.5:0/2940384537 conn(0x560b98eec300 msgr2=0x560b98ef98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 shutdown_connections 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.813+0000 7f2fe4d2f740 1 -- 172.21.15.5:0/2940384537 wait complete. 2024-09-10T22:18:21.819 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe4d2f740 20 client.15645 trim_cache size 0 max 16384 2024-09-10T22:18:21.820 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:18:21.820 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2fc80b5290 msgr2=0x7f2fc80b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2fc80b5290 0x7f2fc80b7750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0057c0 tx=0x7f2fcc031400 comp rx=0 tx=0).stop 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 msgr2=0x7f2fdc199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc199820 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400d770 tx=0x7f2fc400dc30 comp rx=0 tx=0).stop 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 shutdown_connections 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f2fc80b5290 0x7f2fc80b7750 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f2fdc109120 0x7f2fdc19ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f2fdc1087a0 0x7f2fdc199820 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 --2- 172.21.15.5:0/3664054780 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f2fdc102d90 0x7f2fdc1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 >> 172.21.15.5:0/3664054780 conn(0x7f2fdc0fe820 msgr2=0x7f2fdc100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 shutdown_connections 2024-09-10T22:18:21.821 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:21.814+0000 7f2fe295a640 1 -- 172.21.15.5:0/3664054780 wait complete. 2024-09-10T22:18:22.567 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:18:22.836 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.317+0000 7f398acbd640 1 -- 172.21.15.5:0/1005004495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3984102de0 msgr2=0x7f39841031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.317+0000 7f398acbd640 1 --2- 172.21.15.5:0/1005004495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3984102de0 0x7f39841031c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3978009900 tx=0x7f397802a410 comp rx=0 tx=0).stop 2024-09-10T22:18:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 -- 172.21.15.5:0/1005004495 shutdown_connections 2024-09-10T22:18:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 --2- 172.21.15.5:0/1005004495 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3984109170 0x7f398410f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.340 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 --2- 172.21.15.5:0/1005004495 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f39841087f0 0x7f3984108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 --2- 172.21.15.5:0/1005004495 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3984102de0 0x7f39841031c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 -- 172.21.15.5:0/1005004495 >> 172.21.15.5:0/1005004495 conn(0x7f39840fe830 msgr2=0x7f3984100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 -- 172.21.15.5:0/1005004495 shutdown_connections 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 -- 172.21.15.5:0/1005004495 wait complete. 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 Processor -- start 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.318+0000 7f398acbd640 1 -- start start 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398acbd640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3984102de0 0x7f3984199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398acbd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 0x7f3984199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398acbd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3984109170 0x7f398419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398acbd640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3984112e30 con 0x7f39841087f0 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398acbd640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3984112cb0 con 0x7f3984102de0 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398acbd640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3984112fb0 con 0x7f3984109170 2024-09-10T22:18:23.341 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 0x7f3984199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 0x7f3984199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43904/0 (socket says 172.21.15.5:43904) 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 -- 172.21.15.5:0/1446238225 learned_addr learned my addr 172.21.15.5:0/1446238225 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f398925a640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3984109170 0x7f398419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3988a59640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3984102de0 0x7f3984199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 -- 172.21.15.5:0/1446238225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3984109170 msgr2=0x7f398419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3984109170 0x7f398419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 -- 172.21.15.5:0/1446238225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3984102de0 msgr2=0x7f3984199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3984102de0 0x7f3984199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 -- 172.21.15.5:0/1446238225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398419f3f0 con 0x7f39841087f0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3988a59640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3984102de0 0x7f3984199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.319+0000 7f3983fff640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 0x7f3984199880 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f397000c890 tx=0x7f397000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.320+0000 7f3981ffb640 1 -- 172.21.15.5:0/1446238225 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970004220 con 0x7f39841087f0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.320+0000 7f3981ffb640 1 -- 172.21.15.5:0/1446238225 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700043c0 con 0x7f39841087f0 2024-09-10T22:18:23.342 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.320+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398419f6e0 con 0x7f39841087f0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.320+0000 7f3981ffb640 1 -- 172.21.15.5:0/1446238225 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970004a00 con 0x7f39841087f0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.320+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39841a5da0 con 0x7f39841087f0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.322+0000 7f3981ffb640 1 -- 172.21.15.5:0/1446238225 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f39700079b0 con 0x7f39841087f0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.323+0000 7f3981ffb640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f39740b52e0 0x7f39740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.323+0000 7f3988a59640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f39740b52e0 0x7f39740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.323+0000 7f3981ffb640 1 -- 172.21.15.5:0/1446238225 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f39700e5940 con 0x7f39841087f0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f3988a59640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f39740b52e0 0x7f39740b77a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3978031440 tx=0x7f39780095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 Processor -- start 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 -- start start 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f92e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 0x55593f93a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55593f8a4ea0 con 0x55593f92edf0 2024-09-10T22:18:23.343 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55593f8942d0 con 0x55593f93ad80 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.324+0000 7f398d092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55593f8980e0 con 0x55593f92e4d0 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 0x55593f93a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 0x55593f93a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43908/0 (socket says 172.21.15.5:43908) 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 -- 172.21.15.5:0/1649083307 learned_addr learned my addr 172.21.15.5:0/1649083307 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3988a59640 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f92e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f398925a640 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 -- 172.21.15.5:0/1649083307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 msgr2=0x55593f92e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f92e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 -- 172.21.15.5:0/1649083307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 msgr2=0x55593f93d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 -- 172.21.15.5:0/1649083307 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593f5f2650 con 0x55593f92edf0 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f3983fff640 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 0x55593f93a840 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f39700ac0c0 tx=0x7f39700ac000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3d0086e0e9a7d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.344 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f396effd640 1 -- 172.21.15.5:0/1649083307 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397001d040 con 0x55593f92edf0 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f396effd640 1 -- 172.21.15.5:0/1649083307 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700abc40 con 0x55593f92edf0 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.325+0000 7f396effd640 1 -- 172.21.15.5:0/1649083307 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3970007de0 con 0x55593f92edf0 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 -- 172.21.15.5:0/1649083307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 msgr2=0x55593f93a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 0x55593f93a840 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f39700ac0c0 tx=0x7f39700ac000 comp rx=0 tx=0).stop 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 -- 172.21.15.5:0/1649083307 shutdown_connections 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92edf0 0x55593f93a840 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 --2- 172.21.15.5:0/1649083307 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f92e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.326+0000 7f398d092740 1 -- 172.21.15.5:0/1649083307 >> 172.21.15.5:0/1649083307 conn(0x55593f92c300 msgr2=0x55593f92d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 -- 172.21.15.5:0/1649083307 shutdown_connections 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 -- 172.21.15.5:0/1649083307 wait complete. 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 -- start start 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 Processor -- start 2024-09-10T22:18:23.345 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f93a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f937ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f9380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55593f6f5700 con 0x55593f92e4d0 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55593f82f160 con 0x55593f93ad80 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55593f93d940 con 0x55593f92edf0 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.327+0000 7f398d092740 10 client.0 _ll_register_callbacks cb 0x55593f8489e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f93a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f93a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43914/0 (socket says 172.21.15.5:43914) 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 -- 172.21.15.5:0/382479857 learned_addr learned my addr 172.21.15.5:0/382479857 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f398925a640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f9380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3983fff640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f937ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 -- 172.21.15.5:0/382479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 msgr2=0x55593f937ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f937ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.346 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 -- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 msgr2=0x55593f9380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f9380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 -- 172.21.15.5:0/382479857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593f85cc90 con 0x55593f92e4d0 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3983fff640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f937ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3988a59640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f93a670 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3978033000 tx=0x7f3978009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3892c8af79b6f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3963fff640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3963fff640 1 -- 172.21.15.5:0/382479857 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397804c070 con 0x55593f92e4d0 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f3963fff640 1 -- 172.21.15.5:0/382479857 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f397803bab0 con 0x55593f92e4d0 2024-09-10T22:18:23.347 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.328+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39700abc40 con 0x55593f92e4d0 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f3963fff640 1 -- 172.21.15.5:0/382479857 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3978035050 con 0x55593f92e4d0 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 10 client.15657 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55593f949270 con 0x55593f92e4d0 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f3963fff640 1 -- 172.21.15.5:0/382479857 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700abc40 con 0x55593f92e4d0 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f3963fff640 1 -- 172.21.15.5:0/382479857 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f39780038b0 con 0x55593f92e4d0 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 10 client.15657 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 20 client.15657 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f94a730 0x55593f94cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 4 client.15657 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55593f8a6df0 con 0x55593f94a730 2024-09-10T22:18:23.348 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.329+0000 7f3983fff640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f94a730 0x55593f94cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.330+0000 7f3963fff640 10 client.15657 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.330+0000 7f3983fff640 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f94a730 0x55593f94cb60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7521f5fd3cb3942c server_cookie=7358ff36e254a976 in_seq=0 out_seq=0 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f3963fff640 1 -- 172.21.15.5:0/382479857 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55593f8a6df0 con 0x55593f94a730 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f3963fff640 10 client.15657 handle_command_reply: tid=0 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 client.15657 shutdown 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 msgr2=0x55593f93a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f93a670 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f3978033000 tx=0x7f3978009260 comp rx=0 tx=0).stop 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 shutdown_connections 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f94a730 0x55593f94cb60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.349 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f9380f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f937ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f3963fff640 0 client.15657 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 --2- 172.21.15.5:0/382479857 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f93a670 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 >> 172.21.15.5:0/382479857 conn(0x55593f92c300 msgr2=0x55593f931ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 shutdown_connections 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 1 -- 172.21.15.5:0/382479857 wait complete. 2024-09-10T22:18:23.350 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.331+0000 7f398d092740 20 client.15657 trim_cache size 0 max 16384 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 Processor -- start 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 -- start start 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f946b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f92edf0 0x55593f936340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f93ad80 0x55593f936880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39841b0c80 con 0x55593f93ad80 2024-09-10T22:18:23.355 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39841ae550 con 0x55593f92edf0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398d092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39841ac3a0 con 0x55593f92e4d0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398925a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f93ad80 0x55593f936880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f3983fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f92edf0 0x55593f936340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398925a640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f93ad80 0x55593f936880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43926/0 (socket says 172.21.15.5:43926) 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f398925a640 1 -- 172.21.15.5:0/3873134141 learned_addr learned my addr 172.21.15.5:0/3873134141 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.346+0000 7f3988a59640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f946b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f3983fff640 1 -- 172.21.15.5:0/3873134141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 msgr2=0x55593f946b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f3983fff640 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f946b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f3983fff640 1 -- 172.21.15.5:0/3873134141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f93ad80 msgr2=0x55593f936880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f3983fff640 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f93ad80 0x55593f936880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f3983fff640 1 -- 172.21.15.5:0/3873134141 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55593f937870 con 0x55593f92edf0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f3983fff640 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f92edf0 0x55593f936340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55593f92d1e0 tx=0x7f3970093040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba9e39a4e94ecb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.356 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f396e7fc640 1 -- 172.21.15.5:0/3873134141 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397001d040 con 0x55593f92edf0 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f396e7fc640 1 -- 172.21.15.5:0/3873134141 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700ac830 con 0x55593f92edf0 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.347+0000 7f396e7fc640 1 -- 172.21.15.5:0/3873134141 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39700cdb10 con 0x55593f92edf0 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 -- 172.21.15.5:0/3873134141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f92edf0 msgr2=0x55593f936340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f92edf0 0x55593f936340 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55593f92d1e0 tx=0x7f3970093040 comp rx=0 tx=0).stop 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 -- 172.21.15.5:0/3873134141 shutdown_connections 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f93ad80 0x55593f936880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f92edf0 0x55593f936340 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 --2- 172.21.15.5:0/3873134141 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92e4d0 0x55593f946b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 -- 172.21.15.5:0/3873134141 >> 172.21.15.5:0/3873134141 conn(0x55593f92c300 msgr2=0x55593f932cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.357 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 -- 172.21.15.5:0/3873134141 shutdown_connections 2024-09-10T22:18:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 -- 172.21.15.5:0/3873134141 wait complete. 2024-09-10T22:18:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.348+0000 7f398d092740 1 -- start start 2024-09-10T22:18:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 Processor -- start 2024-09-10T22:18:23.358 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f943020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f9435a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f39841aca10 con 0x55593f92e4d0 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f39841ade80 con 0x55593f93ad80 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f39841ad0e0 con 0x55593f92edf0 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398d092740 10 client.0 _ll_register_callbacks cb 0x7f3978009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f3988a59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f943020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f3988a59640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f943020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43938/0 (socket says 172.21.15.5:43938) 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f3988a59640 1 -- 172.21.15.5:0/388283127 learned_addr learned my addr 172.21.15.5:0/388283127 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f398925a640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.349+0000 7f3983fff640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f9435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398925a640 1 -- 172.21.15.5:0/388283127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 msgr2=0x55593f9435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.359 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398925a640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f9435a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398925a640 1 -- 172.21.15.5:0/388283127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 msgr2=0x55593f943020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398925a640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f943020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398925a640 1 -- 172.21.15.5:0/388283127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55593f93e610 con 0x55593f93ad80 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f3988a59640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f943020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398925a640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93dde0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f397c00a700 tx=0x7f397c00f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc2d7f7c2d7ae1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f3963fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f3963fff640 1 -- 172.21.15.5:0/388283127 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c004b20 con 0x55593f93ad80 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39700ac830 con 0x55593f93ad80 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f3963fff640 1 -- 172.21.15.5:0/388283127 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f397c004cc0 con 0x55593f93ad80 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f3963fff640 1 -- 172.21.15.5:0/388283127 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f397c005020 con 0x55593f93ad80 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398d092740 10 client.25253 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55593f9b83a0 con 0x55593f93ad80 2024-09-10T22:18:23.360 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.350+0000 7f3963fff640 1 -- 172.21.15.5:0/388283127 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39700ac830 con 0x55593f93ad80 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f3963fff640 1 -- 172.21.15.5:0/388283127 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f397c01c640 con 0x55593f93ad80 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f398d092740 10 client.25253 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f398d092740 10 client.25253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f398d092740 20 client.25253 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f398d092740 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f9b8b40 0x55593f9baf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f398d092740 4 client.25253 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55593f8a28a0 con 0x55593f9b8b40 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f3988a59640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f9b8b40 0x55593f9baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f3963fff640 10 client.25253 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.351+0000 7f3988a59640 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f9b8b40 0x55593f9baf60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c25a1373c60111bb server_cookie=2b2dbe27e3881f27 in_seq=0 out_seq=0 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f3963fff640 1 -- 172.21.15.5:0/388283127 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55593f8a28a0 con 0x55593f9b8b40 2024-09-10T22:18:23.361 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f3963fff640 10 client.25253 handle_command_reply: tid=0 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 client.25253 shutdown 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 msgr2=0x55593f93dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93dde0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f397c00a700 tx=0x7f397c00f7f0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 shutdown_connections 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55593f9b8b40 0x55593f9baf60 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55593f93ad80 0x55593f93dde0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55593f92edf0 0x55593f9435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 --2- 172.21.15.5:0/388283127 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55593f92e4d0 0x55593f943020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 >> 172.21.15.5:0/388283127 conn(0x55593f92c300 msgr2=0x55593f935f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f3963fff640 0 client.25253 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 shutdown_connections 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 1 -- 172.21.15.5:0/388283127 wait complete. 2024-09-10T22:18:23.362 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.352+0000 7f398d092740 20 client.25253 trim_cache size 0 max 16384 2024-09-10T22:18:23.363 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:18:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f39740b52e0 msgr2=0x7f39740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.363 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f39740b52e0 0x7f39740b77a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3978031440 tx=0x7f39780095f0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 msgr2=0x7f3984199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 0x7f3984199880 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f397000c890 tx=0x7f397000cd50 comp rx=0 tx=0).stop 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 shutdown_connections 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f39740b52e0 0x7f39740b77a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3984109170 0x7f398419ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f39841087f0 0x7f3984199880 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 --2- 172.21.15.5:0/1446238225 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3984102de0 0x7f3984199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 >> 172.21.15.5:0/1446238225 conn(0x7f39840fe830 msgr2=0x7f3984100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 shutdown_connections 2024-09-10T22:18:23.364 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:23.353+0000 7f398acbd640 1 -- 172.21.15.5:0/1446238225 wait complete. 2024-09-10T22:18:23.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:23 smithi005 ceph-mon[31115]: pgmap v392: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 865 KiB/s wr, 13 op/s 2024-09-10T22:18:23.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:23 smithi189 ceph-mon[35784]: pgmap v392: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 865 KiB/s wr, 13 op/s 2024-09-10T22:18:23.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:23 smithi052 ceph-mon[34997]: pgmap v392: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 865 KiB/s wr, 13 op/s 2024-09-10T22:18:25.019 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:18:25.019 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:18:25.288 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:25.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:25 smithi189 ceph-mon[35784]: pgmap v393: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-10T22:18:25.698 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:25 smithi005 ceph-mon[31115]: pgmap v393: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-10T22:18:25.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:25 smithi052 ceph-mon[34997]: pgmap v393: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-09-10T22:18:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 -- 172.21.15.5:0/434024081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb154103b90 msgr2=0x7fb154103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.833 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 --2- 172.21.15.5:0/434024081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb154103b90 0x7fb154103f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb144009900 tx=0x7fb14402a410 comp rx=0 tx=0).stop 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 -- 172.21.15.5:0/434024081 shutdown_connections 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 --2- 172.21.15.5:0/434024081 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb15410d140 0x7fb15410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 --2- 172.21.15.5:0/434024081 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 0x7fb15410cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 --2- 172.21.15.5:0/434024081 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb154103b90 0x7fb154103f70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 -- 172.21.15.5:0/434024081 >> 172.21.15.5:0/434024081 conn(0x7fb1540fd700 msgr2=0x7fb1540ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 -- 172.21.15.5:0/434024081 shutdown_connections 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.787+0000 7fb15996e640 1 -- 172.21.15.5:0/434024081 wait complete. 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 Processor -- start 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 -- start start 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb154103b90 0x7fb154101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 0x7fb154101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 0x7fb154102490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb154112d60 con 0x7fb15410d140 2024-09-10T22:18:25.834 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb154112be0 con 0x7fb154104590 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb15996e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb154112ee0 con 0x7fb154103b90 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb1537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 0x7fb154102490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb1537fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 0x7fb154102490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43962/0 (socket says 172.21.15.5:43962) 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb1537fe640 1 -- 172.21.15.5:0/3788075905 learned_addr learned my addr 172.21.15.5:0/3788075905 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.788+0000 7fb152ffd640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb154103b90 0x7fb154101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 0x7fb154101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb1537fe640 1 -- 172.21.15.5:0/3788075905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb154103b90 msgr2=0x7fb154101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb1537fe640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb154103b90 0x7fb154101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb1537fe640 1 -- 172.21.15.5:0/3788075905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 msgr2=0x7fb154101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb1537fe640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 0x7fb154101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb1537fe640 1 -- 172.21.15.5:0/3788075905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1541a76b0 con 0x7fb15410d140 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 0x7fb154101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:25.835 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb1537fe640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 0x7fb154102490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00eb40 tx=0x7fb14c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb15896c640 1 -- 172.21.15.5:0/3788075905 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c004b20 con 0x7fb15410d140 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1541a79a0 con 0x7fb15410d140 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb15896c640 1 -- 172.21.15.5:0/3788075905 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb14c004cc0 con 0x7fb15410d140 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb15896c640 1 -- 172.21.15.5:0/3788075905 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c010720 con 0x7fb15410d140 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.789+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1541a7ee0 con 0x7fb15410d140 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15896c640 1 -- 172.21.15.5:0/3788075905 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb14c005560 con 0x7fb15410d140 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 Processor -- start 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 -- start start 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5614ba117e60 con 0x5614ba1a0ee0 2024-09-10T22:18:25.836 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5614ba107290 con 0x5614ba1a1800 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb15bd43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5614ba10b0a0 con 0x5614ba1ad790 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43970/0 (socket says 172.21.15.5:43970) 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb14bfff640 1 -- 172.21.15.5:0/1157889970 learned_addr learned my addr 172.21.15.5:0/1157889970 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.792+0000 7fb152ffd640 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb14bfff640 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb152ffd640 1 -- 172.21.15.5:0/1157889970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 msgr2=0x5614ba1afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb152ffd640 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb152ffd640 1 -- 172.21.15.5:0/1157889970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 msgr2=0x5614ba1a12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb152ffd640 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb152ffd640 1 -- 172.21.15.5:0/1157889970 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614b9e65930 con 0x5614ba1a1800 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb14bfff640 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb15896c640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb1400b52e0 0x7fb1400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.837 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb152ffd640 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1ad250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb144009230 tx=0x7fb144032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=582132daf6a0254d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb1400b52e0 0x7fb1400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb15896c640 1 -- 172.21.15.5:0/3788075905 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb14c0e6370 con 0x7fb15410d140 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.793+0000 7fb149ffb640 1 -- 172.21.15.5:0/1157889970 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144040070 con 0x5614ba1a1800 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb149ffb640 1 -- 172.21.15.5:0/1157889970 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb144004030 con 0x5614ba1a1800 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb149ffb640 1 -- 172.21.15.5:0/1157889970 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144035040 con 0x5614ba1a1800 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 -- 172.21.15.5:0/1157889970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 msgr2=0x5614ba1ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb1400b52e0 0x7fb1400b77a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5614ba1a0e90 tx=0x7fb13c0097d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1ad250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb144009230 tx=0x7fb144032b20 comp rx=0 tx=0).stop 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 -- 172.21.15.5:0/1157889970 shutdown_connections 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1ad250 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 --2- 172.21.15.5:0/1157889970 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 -- 172.21.15.5:0/1157889970 >> 172.21.15.5:0/1157889970 conn(0x5614ba19ed10 msgr2=0x5614ba19feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 -- 172.21.15.5:0/1157889970 shutdown_connections 2024-09-10T22:18:25.838 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.794+0000 7fb15bd43740 1 -- 172.21.15.5:0/1157889970 wait complete. 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 -- start start 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 Processor -- start 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1aa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5614b9f68890 con 0x5614ba1a0ee0 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5614ba0a1d40 con 0x5614ba1a1800 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5614ba1b03e0 con 0x5614ba1ad790 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb15bd43740 10 client.0 _ll_register_callbacks cb 0x5614ba105c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.795+0000 7fb152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43972/0 (socket says 172.21.15.5:43972) 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 -- 172.21.15.5:0/2823115140 learned_addr learned my addr 172.21.15.5:0/2823115140 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb14bfff640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.839 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb1537fe640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 -- 172.21.15.5:0/2823115140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 msgr2=0x5614ba1ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 -- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 msgr2=0x5614ba1aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 -- 172.21.15.5:0/2823115140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ba1c1ff0 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb152ffd640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1aa780 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb144005c40 tx=0x7fb144032f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb9e9f4ae781d25 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb132ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb132ffd640 1 -- 172.21.15.5:0/2823115140 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144040070 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb132ffd640 1 -- 172.21.15.5:0/2823115140 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb1440316a0 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb144004030 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.796+0000 7fb132ffd640 1 -- 172.21.15.5:0/2823115140 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb144035040 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 10 client.15675 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614ba1c49a0 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb132ffd640 1 -- 172.21.15.5:0/2823115140 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb144004030 con 0x5614ba1a0ee0 2024-09-10T22:18:25.840 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb132ffd640 1 -- 172.21.15.5:0/2823115140 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb144004bd0 con 0x5614ba1a0ee0 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 10 client.15675 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 20 client.15675 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba1c5cf0 0x5614ba1c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 4 client.15675 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614ba119db0 con 0x5614ba1c5cf0 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.797+0000 7fb14bfff640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba1c5cf0 0x5614ba1c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.798+0000 7fb14bfff640 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba1c5cf0 0x5614ba1c80e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c296280e15ea1622 server_cookie=457901120087d310 in_seq=0 out_seq=0 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.798+0000 7fb132ffd640 10 client.15675 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.798+0000 7fb132ffd640 1 -- 172.21.15.5:0/2823115140 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614ba119db0 con 0x5614ba1c5cf0 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.798+0000 7fb132ffd640 10 client.15675 handle_command_reply: tid=0 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.798+0000 7fb15bd43740 1 client.15675 shutdown 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 msgr2=0x5614ba1aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.841 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1aa780 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb144005c40 tx=0x7fb144032f40 comp rx=0 tx=0).stop 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 shutdown_connections 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba1c5cf0 0x5614ba1c80e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1ad790 0x5614ba1ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1a1800 0x5614ba1aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb132ffd640 0 client.15675 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2823115140 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1aa780 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 >> 172.21.15.5:0/2823115140 conn(0x5614ba19ed10 msgr2=0x5614ba19df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 shutdown_connections 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 1 -- 172.21.15.5:0/2823115140 wait complete. 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.799+0000 7fb15bd43740 20 client.15675 trim_cache size 0 max 16384 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 Processor -- start 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 -- start start 2024-09-10T22:18:25.842 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a1800 0x5614ba1a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1541ae910 con 0x5614ba1a0ee0 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1541ac1e0 con 0x5614ba1ad790 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb15bd43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1541aa030 con 0x5614ba1a1800 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb152ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43978/0 (socket says 172.21.15.5:43978) 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.817+0000 7fb152ffd640 1 -- 172.21.15.5:0/2952579190 learned_addr learned my addr 172.21.15.5:0/2952579190 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb1537fe640 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb14bfff640 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a1800 0x5614ba1a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb152ffd640 1 -- 172.21.15.5:0/2952579190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a1800 msgr2=0x5614ba1a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb152ffd640 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a1800 0x5614ba1a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb152ffd640 1 -- 172.21.15.5:0/2952579190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 msgr2=0x5614ba1cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.843 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb152ffd640 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb152ffd640 1 -- 172.21.15.5:0/2952579190 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614ba19f560 con 0x5614ba1a0ee0 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb152ffd640 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a7990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb144004fa0 tx=0x7fb1440097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c4574bc36e7e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb1497fa640 1 -- 172.21.15.5:0/2952579190 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144040070 con 0x5614ba1a0ee0 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb1497fa640 1 -- 172.21.15.5:0/2952579190 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb14404d070 con 0x5614ba1a0ee0 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.818+0000 7fb1497fa640 1 -- 172.21.15.5:0/2952579190 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1440053b0 con 0x5614ba1a0ee0 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 -- 172.21.15.5:0/2952579190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 msgr2=0x5614ba1a7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a7990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb144004fa0 tx=0x7fb1440097c0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 -- 172.21.15.5:0/2952579190 shutdown_connections 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a1800 0x5614ba1a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 --2- 172.21.15.5:0/2952579190 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a0ee0 0x5614ba1a7990 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 -- 172.21.15.5:0/2952579190 >> 172.21.15.5:0/2952579190 conn(0x5614ba19ed10 msgr2=0x5614ba1a9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 -- 172.21.15.5:0/2952579190 shutdown_connections 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 -- 172.21.15.5:0/2952579190 wait complete. 2024-09-10T22:18:25.844 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.819+0000 7fb15bd43740 1 -- start start 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 Processor -- start 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a0ee0 0x5614ba1b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 0x5614ba1ba490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb1541aa6a0 con 0x5614ba1a1800 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb1541abb10 con 0x5614ba1ad790 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb1541aad70 con 0x5614ba1a0ee0 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb15bd43740 10 client.0 _ll_register_callbacks cb 0x7fb13c0096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 0x5614ba1ba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 0x5614ba1ba490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:43988/0 (socket says 172.21.15.5:43988) 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 -- 172.21.15.5:0/3647841541 learned_addr learned my addr 172.21.15.5:0/3647841541 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb152ffd640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a0ee0 0x5614ba1b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.845 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb1537fe640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 -- 172.21.15.5:0/3647841541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a0ee0 msgr2=0x5614ba1b9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a0ee0 0x5614ba1b9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 -- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 msgr2=0x5614ba1ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb14bfff640 1 -- 172.21.15.5:0/3647841541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614ba231a10 con 0x5614ba1a1800 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.820+0000 7fb1537fe640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb14bfff640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 0x5614ba1ba490 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x5614ba1c8650 tx=0x7fb13c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d749e0450ca942 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb132ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb132ffd640 1 -- 172.21.15.5:0/3647841541 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb13c012b30 con 0x5614ba1a1800 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb132ffd640 1 -- 172.21.15.5:0/3647841541 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb13c012cd0 con 0x5614ba1a1800 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb14404d070 con 0x5614ba1a1800 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb132ffd640 1 -- 172.21.15.5:0/3647841541 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb13c004020 con 0x5614ba1a1800 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 10 client.15681 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:25.846 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5614ba232de0 con 0x5614ba1a1800 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb132ffd640 1 -- 172.21.15.5:0/3647841541 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb14404d070 con 0x5614ba1a1800 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb132ffd640 1 -- 172.21.15.5:0/3647841541 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb13c01d040 con 0x5614ba1a1800 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 10 client.15681 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 10 client.15681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 20 client.15681 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.821+0000 7fb15bd43740 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba233590 0x5614ba2359b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.822+0000 7fb15bd43740 4 client.15681 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.822+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5614ba115860 con 0x5614ba233590 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.822+0000 7fb152ffd640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba233590 0x5614ba2359b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.822+0000 7fb152ffd640 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba233590 0x5614ba2359b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a582bd4bbeb073f server_cookie=2a15cb9251793cab in_seq=0 out_seq=0 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.822+0000 7fb132ffd640 10 client.15681 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb132ffd640 1 -- 172.21.15.5:0/3647841541 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5614ba115860 con 0x5614ba233590 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb132ffd640 10 client.15681 handle_command_reply: tid=0 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 client.15681 shutdown 2024-09-10T22:18:25.847 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 msgr2=0x5614ba1ba490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 0x5614ba1ba490 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x5614ba1c8650 tx=0x7fb13c004730 comp rx=0 tx=0).stop 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 shutdown_connections 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5614ba233590 0x5614ba2359b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "f77c5dc5-804e-4f38-a87c-99a8b446d95b", 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-09-10T22:18:25.848 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5614ba1ad790 0x5614ba1ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5614ba1a1800 0x5614ba1ba490 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb132ffd640 0 client.15681 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 --2- 172.21.15.5:0/3647841541 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5614ba1a0ee0 0x5614ba1b9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 >> 172.21.15.5:0/3647841541 conn(0x5614ba19ed10 msgr2=0x5614ba1a3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 shutdown_connections 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 1 -- 172.21.15.5:0/3647841541 wait complete. 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.824+0000 7fb15bd43740 20 client.15681 trim_cache size 0 max 16384 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb1400b52e0 msgr2=0x7fb1400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb1400b52e0 0x7fb1400b77a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5614ba1a0e90 tx=0x7fb13c0097d0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 msgr2=0x7fb154102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:25.849 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 0x7fb154102490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00eb40 tx=0x7fb14c00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 shutdown_connections 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb1400b52e0 0x7fb1400b77a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb15410d140 0x7fb154102490 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb154104590 0x7fb154101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 --2- 172.21.15.5:0/3788075905 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb154103b90 0x7fb154101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 >> 172.21.15.5:0/3788075905 conn(0x7fb1540fd700 msgr2=0x7fb1540fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 shutdown_connections 2024-09-10T22:18:25.850 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:25.825+0000 7fb15996e640 1 -- 172.21.15.5:0/3788075905 wait complete. 2024-09-10T22:18:26.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:26 smithi189 ceph-mon[35784]: scrub queued for path: / 2024-09-10T22:18:26.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:26 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:26.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:26 smithi189 ceph-mon[35784]: scrub summary: active paths [/] 2024-09-10T22:18:26.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:26 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:26.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:26 smithi052 ceph-mon[34997]: scrub queued for path: / 2024-09-10T22:18:26.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:26 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:26.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:26 smithi052 ceph-mon[34997]: scrub summary: active paths [/] 2024-09-10T22:18:26.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:26 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:26.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:26 smithi005 ceph-mon[31115]: scrub queued for path: / 2024-09-10T22:18:26.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:26 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:26.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:26 smithi005 ceph-mon[31115]: scrub summary: active paths [/] 2024-09-10T22:18:26.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:26 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:27.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:18:27.685 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:27 smithi189 ceph-mon[35784]: pgmap v394: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 12 op/s 2024-09-10T22:18:27.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:27 smithi189 ceph-mon[35784]: scrub summary: idle 2024-09-10T22:18:27.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:27 smithi052 ceph-mon[34997]: pgmap v394: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 12 op/s 2024-09-10T22:18:27.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:27 smithi052 ceph-mon[34997]: scrub summary: idle 2024-09-10T22:18:27.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:27 smithi005 ceph-mon[31115]: pgmap v394: 97 pgs: 97 active+clean; 1.9 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 12 op/s 2024-09-10T22:18:27.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:27 smithi005 ceph-mon[31115]: scrub summary: idle 2024-09-10T22:18:29.124 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 -- 172.21.15.5:0/3144264394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b781076c0 msgr2=0x7f3b78107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/3144264394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b781076c0 0x7f3b78107b00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009900 tx=0x7f3b6802a410 comp rx=0 tx=0).stop 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 -- 172.21.15.5:0/3144264394 shutdown_connections 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/3144264394 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b78108040 0x7f3b7810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/3144264394 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b781076c0 0x7f3b78107b00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/3144264394 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b78101cb0 0x7f3b78102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 -- 172.21.15.5:0/3144264394 >> 172.21.15.5:0/3144264394 conn(0x7f3b780fd700 msgr2=0x7f3b780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:29.125 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 -- 172.21.15.5:0/3144264394 shutdown_connections 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.120+0000 7f3b7fed7640 1 -- 172.21.15.5:0/3144264394 wait complete. 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 Processor -- start 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 -- start start 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 0x7f3b78199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b781076c0 0x7f3b78199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b78108040 0x7f3b7819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78111d00 con 0x7f3b78101cb0 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78111b80 con 0x7f3b78108040 2024-09-10T22:18:29.126 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7dc73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 0x7f3b78199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7fed7640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b78111e80 con 0x7f3b781076c0 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7dc73640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 0x7f3b78199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44004/0 (socket says 172.21.15.5:44004) 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7dc73640 1 -- 172.21.15.5:0/2015816453 learned_addr learned my addr 172.21.15.5:0/2015816453 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7d472640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b781076c0 0x7f3b78199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.121+0000 7f3b7e474640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b78108040 0x7f3b7819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7dc73640 1 -- 172.21.15.5:0/2015816453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b781076c0 msgr2=0x7f3b78199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7dc73640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b781076c0 0x7f3b78199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7dc73640 1 -- 172.21.15.5:0/2015816453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b78108040 msgr2=0x7f3b7819eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.127 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7dc73640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b78108040 0x7f3b7819eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7dc73640 1 -- 172.21.15.5:0/2015816453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7819f2f0 con 0x7f3b78101cb0 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7dc73640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 0x7f3b78199240 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400d950 tx=0x7f3b7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b6effd640 1 -- 172.21.15.5:0/2015816453 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b74017070 con 0x7f3b78101cb0 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7819f5e0 con 0x7f3b78101cb0 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b6effd640 1 -- 172.21.15.5:0/2015816453 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b74009c30 con 0x7f3b78101cb0 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b6effd640 1 -- 172.21.15.5:0/2015816453 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400f620 con 0x7f3b78101cb0 2024-09-10T22:18:29.128 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.122+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b781a5e70 con 0x7f3b78101cb0 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.125+0000 7f3b822ac740 1 Processor -- start 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.125+0000 7f3b6effd640 1 -- 172.21.15.5:0/2015816453 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f3b74010460 con 0x7f3b78101cb0 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.125+0000 7f3b822ac740 1 -- start start 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a91104820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91107150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b822ac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a9106ae50 con 0x562a910f40a0 2024-09-10T22:18:29.132 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b822ac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562a9105a280 con 0x562a910f49c0 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b822ac740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562a9105e090 con 0x562a91104d60 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b7e474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b7e474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44010/0 (socket says 172.21.15.5:44010) 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b7e474640 1 -- 172.21.15.5:0/248903585 learned_addr learned my addr 172.21.15.5:0/248903585 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b7dc73640 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a91104820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.126+0000 7f3b7d472640 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91107150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7e474640 1 -- 172.21.15.5:0/248903585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 msgr2=0x562a91107150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7e474640 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91107150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7e474640 1 -- 172.21.15.5:0/248903585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 msgr2=0x562a91104820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7e474640 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a91104820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7e474640 1 -- 172.21.15.5:0/248903585 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a90db8650 con 0x562a910f40a0 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7e474640 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f4480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009f10 tx=0x7f3b70010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9648a3969cf22a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b6effd640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3b640b5360 0x7f3b640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.133 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b63fff640 1 -- 172.21.15.5:0/248903585 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70016070 con 0x562a910f40a0 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b63fff640 1 -- 172.21.15.5:0/248903585 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b70004d20 con 0x562a910f40a0 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b6effd640 1 -- 172.21.15.5:0/2015816453 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3b740e5760 con 0x7f3b78101cb0 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.127+0000 7f3b7dc73640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3b640b5360 0x7f3b640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b63fff640 1 -- 172.21.15.5:0/248903585 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b700127d0 con 0x562a910f40a0 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 -- 172.21.15.5:0/248903585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 msgr2=0x562a910f4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f4480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3b70009f10 tx=0x7f3b70010740 comp rx=0 tx=0).stop 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 -- 172.21.15.5:0/248903585 shutdown_connections 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a91104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 --2- 172.21.15.5:0/248903585 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f4480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 -- 172.21.15.5:0/248903585 >> 172.21.15.5:0/248903585 conn(0x562a910f1ed0 msgr2=0x562a910f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b7dc73640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3b640b5360 0x7f3b640b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b740e3600 tx=0x7f3b74000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 -- 172.21.15.5:0/248903585 shutdown_connections 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.128+0000 7f3b822ac740 1 -- 172.21.15.5:0/248903585 wait complete. 2024-09-10T22:18:29.134 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.129+0000 7f3b822ac740 1 -- start start 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.129+0000 7f3b822ac740 1 Processor -- start 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f40a0 0x562a91104790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a91104d60 0x562a910fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x562a90ebb700 con 0x562a91104d60 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x562a90ff5110 con 0x562a910f49c0 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x562a910fa660 con 0x562a910f40a0 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b822ac740 10 client.0 _ll_register_callbacks cb 0x562a9100e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910fdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:54702/0 (socket says 172.21.15.5:54702) 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 -- 172.21.15.5:0/4259255974 learned_addr learned my addr 172.21.15.5:0/4259255974 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a91104d60 0x562a910fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f40a0 0x562a91104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 -- 172.21.15.5:0/4259255974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f40a0 msgr2=0x562a91104790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f40a0 0x562a91104790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 -- 172.21.15.5:0/4259255974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a91104d60 msgr2=0x562a910fe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a91104d60 0x562a910fe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.130+0000 7f3b7d472640 1 -- 172.21.15.5:0/4259255974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a91022c40 con 0x562a910f49c0 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910fdbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009900 tx=0x7f3b680316d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b55fd52277d3183 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b617fa640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b617fa640 1 -- 172.21.15.5:0/4259255974 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b68035040 con 0x562a910f49c0 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b617fa640 1 -- 172.21.15.5:0/4259255974 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3b68004040 con 0x562a910f49c0 2024-09-10T22:18:29.136 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b70004d20 con 0x562a910f49c0 2024-09-10T22:18:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b617fa640 1 -- 172.21.15.5:0/4259255974 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b68004240 con 0x562a910f49c0 2024-09-10T22:18:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b822ac740 10 client.25283 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a9110ef70 con 0x562a910f49c0 2024-09-10T22:18:29.138 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.131+0000 7f3b617fa640 1 -- 172.21.15.5:0/4259255974 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b70004d20 con 0x562a910f49c0 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b617fa640 1 -- 172.21.15.5:0/4259255974 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3b68004870 con 0x562a910f49c0 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b822ac740 10 client.25283 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b822ac740 10 client.25283 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b822ac740 20 client.25283 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911128c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b822ac740 4 client.25283 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a9106cda0 con 0x562a911104d0 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.132+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.133+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911128c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48da2516300a4baf server_cookie=d72210409e2d214e in_seq=0 out_seq=0 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.133+0000 7f3b617fa640 10 client.25283 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.133+0000 7f3b617fa640 1 -- 172.21.15.5:0/4259255974 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a9106cda0 con 0x562a911104d0 2024-09-10T22:18:29.139 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.133+0000 7f3b617fa640 10 client.25283 handle_command_reply: tid=0 2024-09-10T22:18:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.133+0000 7f3b822ac740 1 client.25283 shutdown 2024-09-10T22:18:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 msgr2=0x562a910fdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910fdbc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009900 tx=0x7f3b680316d0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 shutdown_connections 2024-09-10T22:18:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911128c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.140 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a91104d60 0x562a910fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b617fa640 0 client.25283 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910fdbc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4259255974 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f40a0 0x562a91104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 >> 172.21.15.5:0/4259255974 conn(0x562a910f1ed0 msgr2=0x562a910f7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 shutdown_connections 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 1 -- 172.21.15.5:0/4259255974 wait complete. 2024-09-10T22:18:29.141 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.134+0000 7f3b822ac740 20 client.25283 trim_cache size 0 max 16384 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.172+0000 7f3b822ac740 1 Processor -- start 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.172+0000 7f3b822ac740 1 -- start start 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.172+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910f3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91118160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b822ac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781ae9d0 con 0x562a910f40a0 2024-09-10T22:18:29.175 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b822ac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781ac2a0 con 0x562a910f49c0 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b822ac740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781aa110 con 0x562a91104d60 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44018/0 (socket says 172.21.15.5:44018) 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 -- 172.21.15.5:0/550083978 learned_addr learned my addr 172.21.15.5:0/550083978 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91118160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7d472640 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 -- 172.21.15.5:0/550083978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 msgr2=0x562a91118160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91118160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 -- 172.21.15.5:0/550083978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 msgr2=0x562a910f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 -- 172.21.15.5:0/550083978 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a910f1d00 con 0x562a910f40a0 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7d472640 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:29.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.173+0000 7f3b7e474640 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f1710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005a40 tx=0x7f3b70005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c87099898f3d935 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.174+0000 7f3b637fe640 1 -- 172.21.15.5:0/550083978 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70022040 con 0x562a910f40a0 2024-09-10T22:18:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.174+0000 7f3b637fe640 1 -- 172.21.15.5:0/550083978 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b70012c80 con 0x562a910f40a0 2024-09-10T22:18:29.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.174+0000 7f3b637fe640 1 -- 172.21.15.5:0/550083978 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b70016040 con 0x562a910f40a0 2024-09-10T22:18:29.180 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.174+0000 7f3b822ac740 1 -- 172.21.15.5:0/550083978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 msgr2=0x562a910f1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.174+0000 7f3b822ac740 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f1710 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005a40 tx=0x7f3b70005a70 comp rx=0 tx=0).stop 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 -- 172.21.15.5:0/550083978 shutdown_connections 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a91104d60 0x562a91118160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a910f49c0 0x562a910f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 --2- 172.21.15.5:0/550083978 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a910f1710 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 -- 172.21.15.5:0/550083978 >> 172.21.15.5:0/550083978 conn(0x562a910f1ed0 msgr2=0x562a910f2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 -- 172.21.15.5:0/550083978 shutdown_connections 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 -- 172.21.15.5:0/550083978 wait complete. 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 -- start start 2024-09-10T22:18:29.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.175+0000 7f3b822ac740 1 Processor -- start 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a9110cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f49c0 0x562a9110d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a91104d60 0x562a91109990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781aa760 con 0x562a910f40a0 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781abbd0 con 0x562a91104d60 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f3b781aae30 con 0x562a910f49c0 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b822ac740 10 client.0 _ll_register_callbacks cb 0x7f3b68009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a9110cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a9110cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44026/0 (socket says 172.21.15.5:44026) 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 -- 172.21.15.5:0/4074600334 learned_addr learned my addr 172.21.15.5:0/4074600334 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f49c0 0x562a9110d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a91104d60 0x562a91109990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.182 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 -- 172.21.15.5:0/4074600334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f49c0 msgr2=0x562a9110d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f49c0 0x562a9110d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 -- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a91104d60 msgr2=0x562a91109990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a91104d60 0x562a91109990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7e474640 1 -- 172.21.15.5:0/4074600334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9110a1c0 con 0x562a910f40a0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.176+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f49c0 0x562a9110d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b7e474640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a9110cca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005bd0 tx=0x7f3b70010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9721bc2df6aacd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b617fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b617fa640 1 -- 172.21.15.5:0/4074600334 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7003d060 con 0x562a910f40a0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b617fa640 1 -- 172.21.15.5:0/4074600334 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f3b7001a5d0 con 0x562a910f40a0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b70012c80 con 0x562a910f40a0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b617fa640 1 -- 172.21.15.5:0/4074600334 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b70016030 con 0x562a910f40a0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b822ac740 10 client.15699 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562a9117dfc0 con 0x562a910f40a0 2024-09-10T22:18:29.183 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b617fa640 1 -- 172.21.15.5:0/4074600334 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b70012c80 con 0x562a910f40a0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.177+0000 7f3b617fa640 1 -- 172.21.15.5:0/4074600334 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3b7002d070 con 0x562a910f40a0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b822ac740 10 client.15699 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b822ac740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b822ac740 20 client.15699 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b822ac740 4 client.15699 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a91068850 con 0x562a911104d0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b617fa640 10 client.15699 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.178+0000 7f3b7d472640 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911804b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3da01140b945174 server_cookie=530b3e51c225557c in_seq=0 out_seq=0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b617fa640 1 -- 172.21.15.5:0/4074600334 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x562a91068850 con 0x562a911104d0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b617fa640 10 client.15699 handle_command_reply: tid=0 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 client.15699 shutdown 2024-09-10T22:18:29.184 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 msgr2=0x562a9110cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a9110cca0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3b70005bd0 tx=0x7f3b70010740 comp rx=0 tx=0).stop 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 shutdown_connections 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x562a911104d0 0x562a911804b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x562a91104d60 0x562a91109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x562a910f49c0 0x562a9110d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 --2- 172.21.15.5:0/4074600334 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x562a910f40a0 0x562a9110cca0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 >> 172.21.15.5:0/4074600334 conn(0x562a910f1ed0 msgr2=0x562a910f33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.179+0000 7f3b617fa640 0 client.15699 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 shutdown_connections 2024-09-10T22:18:29.185 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b822ac740 1 -- 172.21.15.5:0/4074600334 wait complete. 2024-09-10T22:18:29.186 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b822ac740 20 client.15699 trim_cache size 0 max 16384 2024-09-10T22:18:29.186 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:18:29.186 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-09-10T22:18:29.186 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-09-10T22:18:29.186 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:18:29.186 INFO:teuthology.orchestra.run.smithi005.stdout: "f77c5dc5-804e-4f38-a87c-99a8b446d95b": { 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:18:25.822342+0000", 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "c3f491a8-f960-4d70-807d-4784191d67d0": { 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:43.094860+0000", 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:29.187 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:29.188 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:29.189 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:29.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:29.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:29.189 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:18:29.189 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3b640b5360 msgr2=0x7f3b640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3b640b5360 0x7f3b640b7820 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b740e3600 tx=0x7f3b74000bc0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 msgr2=0x7f3b78199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 0x7f3b78199240 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400d950 tx=0x7f3b7400de10 comp rx=0 tx=0).stop 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 shutdown_connections 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f3b640b5360 0x7f3b640b7820 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f3b78108040 0x7f3b7819eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f3b781076c0 0x7f3b78199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.180+0000 7f3b7fed7640 1 --2- 172.21.15.5:0/2015816453 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f3b78101cb0 0x7f3b78199240 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:29.190 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.181+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 >> 172.21.15.5:0/2015816453 conn(0x7f3b780fd700 msgr2=0x7f3b7806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.181+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 shutdown_connections 2024-09-10T22:18:29.191 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:29.181+0000 7f3b7fed7640 1 -- 172.21.15.5:0/2015816453 wait complete. 2024-09-10T22:18:29.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:29 smithi005 ceph-mon[31115]: pgmap v395: 97 pgs: 97 active+clean; 54 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.2 MiB/s wr, 12 op/s 2024-09-10T22:18:29.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:29 smithi189 ceph-mon[35784]: pgmap v395: 97 pgs: 97 active+clean; 54 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.2 MiB/s wr, 12 op/s 2024-09-10T22:18:29.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:29 smithi052 ceph-mon[34997]: pgmap v395: 97 pgs: 97 active+clean; 54 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.2 MiB/s wr, 12 op/s 2024-09-10T22:18:29.877 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:18:29.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:18:30.175 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2667578167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac10d100 msgr2=0x7f7aac10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2667578167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac10d100 0x7f7aac10f560 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009900 tx=0x7f7aa402a410 comp rx=0 tx=0).stop 2024-09-10T22:18:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2667578167 shutdown_connections 2024-09-10T22:18:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2667578167 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac10d100 0x7f7aac10f560 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2667578167 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aac1045c0 0x7f7aac10cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.748 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2667578167 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac103ca0 0x7f7aac104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2667578167 >> 172.21.15.5:0/2667578167 conn(0x7f7aac0fd700 msgr2=0x7f7aac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2667578167 shutdown_connections 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.724+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2667578167 wait complete. 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 Processor -- start 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 -- start start 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 0x7f7aac1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac1045c0 0x7f7aac199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aac10d100 0x7f7aac19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac112dc0 con 0x7f7aac103ca0 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac112c40 con 0x7f7aac1045c0 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.725+0000 7f7ab41ed640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7aac112f40 con 0x7f7aac10d100 2024-09-10T22:18:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 0x7f7aac1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 0x7f7aac1991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:44052/0 (socket says 172.21.15.5:44052) 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 -- 172.21.15.5:0/2243717993 learned_addr learned my addr 172.21.15.5:0/2243717993 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab278a640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aac10d100 0x7f7aac19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1788640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac1045c0 0x7f7aac199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 -- 172.21.15.5:0/2243717993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aac10d100 msgr2=0x7f7aac19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aac10d100 0x7f7aac19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 -- 172.21.15.5:0/2243717993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac1045c0 msgr2=0x7f7aac199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac1045c0 0x7f7aac199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 -- 172.21.15.5:0/2243717993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aac19f280 con 0x7f7aac103ca0 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1788640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac1045c0 0x7f7aac199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab1f89640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 0x7f7aac1991d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c920 tx=0x7f7aa800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8007c70 con 0x7f7aac103ca0 2024-09-10T22:18:30.750 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa8007e10 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aac19f570 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8018820 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.726+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aac1a5c30 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.728+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aac104080 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.729+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7aa800f450 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.730+0000 7f7a9effd640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a980b52e0 0x7f7a980b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.730+0000 7f7ab1788640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a980b52e0 0x7f7a980b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.730+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7aa80e5f80 con 0x7f7aac103ca0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.731+0000 7f7ab1788640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a980b52e0 0x7f7a980b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0fff10 tx=0x7f7aa0009530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:30.751 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.734+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7aa8014030 con 0x7f7aac103ca0 2024-09-10T22:18:30.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.962+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7aac1a6050 con 0x7f7aac103ca0 2024-09-10T22:18:30.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.962+0000 7f7a9effd640 1 -- 172.21.15.5:0/2243717993 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f7aa80acf00 con 0x7f7aac103ca0 2024-09-10T22:18:30.965 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:18:30.965 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:18:30.966 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a980b52e0 msgr2=0x7f7a980b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a980b52e0 0x7f7a980b77a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0fff10 tx=0x7f7aa0009530 comp rx=0 tx=0).stop 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 msgr2=0x7f7aac1991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 0x7f7aac1991d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7aa800c920 tx=0x7f7aa800cde0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 shutdown_connections 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a980b52e0 0x7f7a980b77a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aac10d100 0x7f7aac19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aac1045c0 0x7f7aac199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 --2- 172.21.15.5:0/2243717993 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aac103ca0 0x7f7aac1991d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 >> 172.21.15.5:0/2243717993 conn(0x7f7aac0fd700 msgr2=0x7f7aac10f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:30.968 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 shutdown_connections 2024-09-10T22:18:30.969 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:30.965+0000 7f7ab41ed640 1 -- 172.21.15.5:0/2243717993 wait complete. 2024-09-10T22:18:31.653 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:31 smithi005 ceph-mon[31115]: pgmap v396: 97 pgs: 97 active+clean; 130 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-10T22:18:31.654 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:31 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2243717993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:18:31.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:18:31.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:31 smithi189 ceph-mon[35784]: pgmap v396: 97 pgs: 97 active+clean; 130 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-10T22:18:31.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:31 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2243717993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:18:31.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:31 smithi052 ceph-mon[34997]: pgmap v396: 97 pgs: 97 active+clean; 130 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-10T22:18:31.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:31 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2243717993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:18:31.959 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.265+0000 7f6bca552640 1 -- 172.21.15.5:0/2806075704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4101880 msgr2=0x7f6bc4101c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.265+0000 7f6bca552640 1 --2- 172.21.15.5:0/2806075704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4101880 0x7f6bc4101c80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009930 tx=0x7f6bb402a420 comp rx=0 tx=0).stop 2024-09-10T22:18:32.270 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 -- 172.21.15.5:0/2806075704 shutdown_connections 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 --2- 172.21.15.5:0/2806075704 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc4103390 0x7f6bc4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 --2- 172.21.15.5:0/2806075704 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc41029d0 0x7f6bc4102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 --2- 172.21.15.5:0/2806075704 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4101880 0x7f6bc4101c80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 -- 172.21.15.5:0/2806075704 >> 172.21.15.5:0/2806075704 conn(0x7f6bc40fd140 msgr2=0x7f6bc40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 -- 172.21.15.5:0/2806075704 shutdown_connections 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 -- 172.21.15.5:0/2806075704 wait complete. 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 Processor -- start 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 -- start start 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.266+0000 7f6bca552640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4101880 0x7f6bc406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bca552640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc41029d0 0x7f6bc419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bca552640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 0x7f6bc41a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bca552640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc410d4f0 con 0x7f6bc4103390 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bca552640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc410d370 con 0x7f6bc4101880 2024-09-10T22:18:32.271 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bca552640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc410d670 con 0x7f6bc41029d0 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 0x7f6bc41a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 0x7f6bc41a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42120/0 (socket says 172.21.15.5:42120) 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 -- 172.21.15.5:0/719169810 learned_addr learned my addr 172.21.15.5:0/719169810 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc41029d0 0x7f6bc419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4101880 0x7f6bc406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 -- 172.21.15.5:0/719169810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc41029d0 msgr2=0x7f6bc419dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc41029d0 0x7f6bc419dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 -- 172.21.15.5:0/719169810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4101880 msgr2=0x7f6bc406b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4101880 0x7f6bc406b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.272 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 -- 172.21.15.5:0/719169810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc41a0980 con 0x7f6bc4103390 2024-09-10T22:18:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 0x7f6bc41a00c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00eaa0 tx=0x7f6bbc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.267+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/719169810 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00cdb0 con 0x7f6bc4103390 2024-09-10T22:18:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.268+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc41a0c70 con 0x7f6bc4103390 2024-09-10T22:18:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.268+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/719169810 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bbc005020 con 0x7f6bc4103390 2024-09-10T22:18:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.268+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/719169810 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0116d0 con 0x7f6bc4103390 2024-09-10T22:18:32.273 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.268+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc41a11c0 con 0x7f6bc4103390 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 Processor -- start 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/719169810 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6bbc00f040 con 0x7f6bc4103390 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 -- start start 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee8164c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee8167580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564ee80d46f0 con 0x564ee8165190 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564ee80c3b20 con 0x564ee8162860 2024-09-10T22:18:32.281 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.270+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ee80c7930 con 0x564ee8167bd0 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee8167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee8167580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42128/0 (socket says 172.21.15.5:42128) 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 -- 172.21.15.5:0/786173935 learned_addr learned my addr 172.21.15.5:0/786173935 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee8164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 -- 172.21.15.5:0/786173935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 msgr2=0x564ee816a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 -- 172.21.15.5:0/786173935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 msgr2=0x564ee8164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee8164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 -- 172.21.15.5:0/786173935 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee8089530 con 0x564ee8165190 2024-09-10T22:18:32.282 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee8167580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6bb402a940 tx=0x7f6bb4032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7e50b33fd14865 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bc1ffb640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6bb00b52e0 0x7f6bb00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.271+0000 7f6bba7fc640 1 -- 172.21.15.5:0/786173935 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb403f070 con 0x564ee8165190 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bba7fc640 1 -- 172.21.15.5:0/786173935 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb4004040 con 0x564ee8165190 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bba7fc640 1 -- 172.21.15.5:0/786173935 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4035070 con 0x564ee8165190 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6bb00b52e0 0x7f6bb00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bc1ffb640 1 -- 172.21.15.5:0/719169810 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6bbc0e5980 con 0x7f6bc4103390 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/786173935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 msgr2=0x564ee8167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee8167580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6bb402a940 tx=0x7f6bb4032bd0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6bb00b52e0 0x7f6bb00b77a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00bfd0 tx=0x7f6bac00b650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/786173935 shutdown_connections 2024-09-10T22:18:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee8167580 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/786173935 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee8164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/786173935 >> 172.21.15.5:0/786173935 conn(0x564ee815d9b0 msgr2=0x564ee815e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/786173935 shutdown_connections 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.272+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/786173935 wait complete. 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 -- start start 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 Processor -- start 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 0x564ee816be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8165190 0x564ee816c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x564ee7ffbab0 con 0x564ee8162860 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x564ee8069730 con 0x564ee8165190 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x564ee816ab50 con 0x564ee8167bd0 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bcd3fb740 10 client.0 _ll_register_callbacks cb 0x564ee80bd6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 0x564ee816be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 0x564ee816be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42142/0 (socket says 172.21.15.5:42142) 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.273+0000 7f6bc3fff640 1 -- 172.21.15.5:0/4082278136 learned_addr learned my addr 172.21.15.5:0/4082278136 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8165190 0x564ee816c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.285 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc3fff640 1 -- 172.21.15.5:0/4082278136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 msgr2=0x564ee816d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc3fff640 1 -- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8165190 msgr2=0x564ee816c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8165190 0x564ee816c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc3fff640 1 -- 172.21.15.5:0/4082278136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee7e25790 con 0x564ee8162860 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 0x564ee816be70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004450 tx=0x7f6bb4004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c749f46473937d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6ba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6ba37fe640 1 -- 172.21.15.5:0/4082278136 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4035070 con 0x564ee8162860 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6ba37fe640 1 -- 172.21.15.5:0/4082278136 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6bb40035f0 con 0x564ee8162860 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb4004040 con 0x564ee8162860 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6ba37fe640 1 -- 172.21.15.5:0/4082278136 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bb403f040 con 0x564ee8162860 2024-09-10T22:18:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bcd3fb740 10 client.15717 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.274+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ee7e9e620 con 0x564ee8162860 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6ba37fe640 1 -- 172.21.15.5:0/4082278136 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb4004040 con 0x564ee8162860 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6ba37fe640 1 -- 172.21.15.5:0/4082278136 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bb4004a20 con 0x564ee8162860 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bcd3fb740 10 client.15717 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bcd3fb740 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bcd3fb740 20 client.15717 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee8177310 0x564ee8179700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bcd3fb740 4 client.15717 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ee80d6640 con 0x564ee8177310 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee8177310 0x564ee8179700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6ba37fe640 10 client.15717 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.275+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee8177310 0x564ee8179700 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32f9055e29bb5ec1 server_cookie=bf33de24cfadf703 in_seq=0 out_seq=0 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6ba37fe640 1 -- 172.21.15.5:0/4082278136 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ee80d6640 con 0x564ee8177310 2024-09-10T22:18:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6ba37fe640 10 client.15717 handle_command_reply: tid=0 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 client.15717 shutdown 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 msgr2=0x564ee816be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 0x564ee816be70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004450 tx=0x7f6bb4004480 comp rx=0 tx=0).stop 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 shutdown_connections 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee8177310 0x564ee8179700 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee816d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8165190 0x564ee816c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4082278136 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8162860 0x564ee816be70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6ba37fe640 0 client.15717 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.276+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 >> 172.21.15.5:0/4082278136 conn(0x564ee815d9b0 msgr2=0x564ee815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.277+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 shutdown_connections 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.277+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4082278136 wait complete. 2024-09-10T22:18:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.277+0000 7f6bcd3fb740 20 client.15717 trim_cache size 0 max 16384 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.292+0000 7f6bcd3fb740 1 Processor -- start 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.292+0000 7f6bcd3fb740 1 -- start start 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee815f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee815fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41ac700 con 0x564ee8165190 2024-09-10T22:18:32.297 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41a9fd0 con 0x564ee8162860 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41a7e20 con 0x564ee8167bd0 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee815f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee815f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42144/0 (socket says 172.21.15.5:42144) 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 -- 172.21.15.5:0/4145418961 learned_addr learned my addr 172.21.15.5:0/4145418961 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee815fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 -- 172.21.15.5:0/4145418961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 msgr2=0x564ee815fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee815fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 -- 172.21.15.5:0/4145418961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 msgr2=0x564ee815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee815cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 -- 172.21.15.5:0/4145418961 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ee8179a70 con 0x564ee8165190 2024-09-10T22:18:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.293+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee815f7e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6bac012fd0 tx=0x7f6bac014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30824c2fb2a70949 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bb9ffb640 1 -- 172.21.15.5:0/4145418961 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac005020 con 0x564ee8165190 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bb9ffb640 1 -- 172.21.15.5:0/4145418961 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bac023800 con 0x564ee8165190 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bb9ffb640 1 -- 172.21.15.5:0/4145418961 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0047a0 con 0x564ee8165190 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4145418961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 msgr2=0x564ee815f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee815f7e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6bac012fd0 tx=0x7f6bac014070 comp rx=0 tx=0).stop 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4145418961 shutdown_connections 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8167bd0 0x564ee815fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee815f7e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/4145418961 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8162860 0x564ee815cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4145418961 >> 172.21.15.5:0/4145418961 conn(0x564ee815d9b0 msgr2=0x564ee815c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4145418961 shutdown_connections 2024-09-10T22:18:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.294+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/4145418961 wait complete. 2024-09-10T22:18:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 -- start start 2024-09-10T22:18:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 Processor -- start 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8162860 0x564ee8173bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee81729c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8167bd0 0x564ee8173070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41a8490 con 0x564ee8165190 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41a9900 con 0x564ee8167bd0 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc41a8b60 con 0x564ee8162860 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bcd3fb740 10 client.0 _ll_register_callbacks cb 0x7f6bac00bb20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee81729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bbbfff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee81729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42160/0 (socket says 172.21.15.5:42160) 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bbbfff640 1 -- 172.21.15.5:0/3233803202 learned_addr learned my addr 172.21.15.5:0/3233803202 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.295+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8167bd0 0x564ee8173070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8162860 0x564ee8173bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bbbfff640 1 -- 172.21.15.5:0/3233803202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8162860 msgr2=0x564ee8173bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8162860 0x564ee8173bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bbbfff640 1 -- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8167bd0 msgr2=0x564ee8173070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8167bd0 0x564ee8173070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bbbfff640 1 -- 172.21.15.5:0/3233803202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ee81713f0 con 0x564ee8165190 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bc8aef640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8167bd0 0x564ee8173070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bbbfff640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee81729c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00bc90 tx=0x7f6bac023a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6eec903b201b27 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6ba37fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6ba37fe640 1 -- 172.21.15.5:0/3233803202 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac039020 con 0x564ee8165190 2024-09-10T22:18:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6ba37fe640 1 -- 172.21.15.5:0/3233803202 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f6bac023c30 con 0x564ee8165190 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bac023800 con 0x564ee8165190 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6ba37fe640 1 -- 172.21.15.5:0/3233803202 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bac023e30 con 0x564ee8165190 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bcd3fb740 10 client.15723 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.296+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564ee81e4410 con 0x564ee8165190 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6ba37fe640 1 -- 172.21.15.5:0/3233803202 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bac023800 con 0x564ee8165190 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6ba37fe640 1 -- 172.21.15.5:0/3233803202 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bac010660 con 0x564ee8165190 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bcd3fb740 10 client.15723 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bcd3fb740 10 client.15723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bcd3fb740 20 client.15723 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee81e4df0 0x564ee81e7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bcd3fb740 4 client.15723 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:18:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ee80d20f0 con 0x564ee81e4df0 2024-09-10T22:18:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee81e4df0 0x564ee81e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6bc3fff640 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee81e4df0 0x564ee81e7210 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b80a81a49368506 server_cookie=ac0321b4d32a1af4 in_seq=0 out_seq=0 2024-09-10T22:18:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.297+0000 7f6ba37fe640 10 client.15723 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6ba37fe640 1 -- 172.21.15.5:0/3233803202 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ee80d20f0 con 0x564ee81e4df0 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6ba37fe640 10 client.15723 handle_command_reply: tid=0 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 client.15723 shutdown 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 msgr2=0x564ee81729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee81729c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00bc90 tx=0x7f6bac023a40 comp rx=0 tx=0).stop 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 shutdown_connections 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x564ee81e4df0 0x564ee81e7210 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x564ee8167bd0 0x564ee8173070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6ba37fe640 0 client.15723 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x564ee8165190 0x564ee81729c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 --2- 172.21.15.5:0/3233803202 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x564ee8162860 0x564ee8173bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 >> 172.21.15.5:0/3233803202 conn(0x564ee815d9b0 msgr2=0x564ee815cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 shutdown_connections 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.307+0000 7f6bcd3fb740 1 -- 172.21.15.5:0/3233803202 wait complete. 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bcd3fb740 20 client.15723 trim_cache size 0 max 16384 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:18:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6bb00b52e0 msgr2=0x7f6bb00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6bb00b52e0 0x7f6bb00b77a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00bfd0 tx=0x7f6bac00b650 comp rx=0 tx=0).stop 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 msgr2=0x7f6bc41a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 0x7f6bc41a00c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00eaa0 tx=0x7f6bbc00ef60 comp rx=0 tx=0).stop 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 shutdown_connections 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f6bb00b52e0 0x7f6bb00b77a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6bc4103390 0x7f6bc41a00c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6bc41029d0 0x7f6bc419dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 --2- 172.21.15.5:0/719169810 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6bc4101880 0x7f6bc406b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 >> 172.21.15.5:0/719169810 conn(0x7f6bc40fd140 msgr2=0x7f6bc4105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 shutdown_connections 2024-09-10T22:18:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:32.308+0000 7f6bca552640 1 -- 172.21.15.5:0/719169810 wait complete. 2024-09-10T22:18:32.549 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 -- 172.21.15.5:0/3322999813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c701076a0 msgr2=0x7f1c70107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 --2- 172.21.15.5:0/3322999813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c701076a0 0x7f1c70107ae0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009900 tx=0x7f1c5802a3f0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 -- 172.21.15.5:0/3322999813 shutdown_connections 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 --2- 172.21.15.5:0/3322999813 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c70108020 0x7f1c7010e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 --2- 172.21.15.5:0/3322999813 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c701076a0 0x7f1c70107ae0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 --2- 172.21.15.5:0/3322999813 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c70101c90 0x7f1c70102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 -- 172.21.15.5:0/3322999813 >> 172.21.15.5:0/3322999813 conn(0x7f1c700fd700 msgr2=0x7f1c700ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 -- 172.21.15.5:0/3322999813 shutdown_connections 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.529+0000 7f1c7602f640 1 -- 172.21.15.5:0/3322999813 wait complete. 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.530+0000 7f1c7602f640 1 Processor -- start 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.530+0000 7f1c7602f640 1 -- start start 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c7602f640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c70101c90 0x7f1c70198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.550 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c7602f640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c701076a0 0x7f1c701985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c7602f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 0x7f1c7019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c7602f640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70111ce0 con 0x7f1c70108020 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c7602f640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70111b60 con 0x7f1c701076a0 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c7602f640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c70111e60 con 0x7f1c70101c90 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 0x7f1c7019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 0x7f1c7019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42170/0 (socket says 172.21.15.5:42170) 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6ffff640 1 -- 172.21.15.5:0/716140443 learned_addr learned my addr 172.21.15.5:0/716140443 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c70101c90 0x7f1c70198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c701076a0 0x7f1c701985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6ffff640 1 -- 172.21.15.5:0/716140443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c70101c90 msgr2=0x7f1c70198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c70101c90 0x7f1c70198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.531+0000 7f1c6ffff640 1 -- 172.21.15.5:0/716140443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c701076a0 msgr2=0x7f1c701985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c701076a0 0x7f1c701985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.551 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c6ffff640 1 -- 172.21.15.5:0/716140443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7019e140 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 0x7f1c7019d970 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800cce0 tx=0x7f1c6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c6d7fa640 1 -- 172.21.15.5:0/716140443 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6800f450 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c6d7fa640 1 -- 172.21.15.5:0/716140443 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c6800faa0 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7019e430 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c6d7fa640 1 -- 172.21.15.5:0/716140443 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68018a80 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.532+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c701a4af0 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 Processor -- start 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c6d7fa640 1 -- 172.21.15.5:0/716140443 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1c68020030 con 0x7f1c70108020 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 -- start start 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44e4d0 0x557a5b44e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b45ad80 0x557a5b45d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557a5b3c4ea0 con 0x557a5b44edf0 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a5b3b42d0 con 0x557a5b45ad80 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.535+0000 7f1c78404740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a5b3b80e0 con 0x557a5b44e4d0 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42184/0 (socket says 172.21.15.5:42184) 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 -- 172.21.15.5:0/4002335373 learned_addr learned my addr 172.21.15.5:0/4002335373 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b45ad80 0x557a5b45d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44e4d0 0x557a5b44e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 -- 172.21.15.5:0/4002335373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44e4d0 msgr2=0x557a5b44e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44e4d0 0x557a5b44e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 -- 172.21.15.5:0/4002335373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b45ad80 msgr2=0x557a5b45d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b45ad80 0x557a5b45d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 -- 172.21.15.5:0/4002335373 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5b112650 con 0x557a5b44edf0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44e4d0 0x557a5b44e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45a840 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000ad00 tx=0x7f1c6000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbec78bc1426ce11 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c6d7fa640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1c5c0b5360 0x7f1c5c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.536+0000 7f1c65ffb640 1 -- 172.21.15.5:0/4002335373 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c6001d070 con 0x557a5b44edf0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1c5c0b5360 0x7f1c5c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c65ffb640 1 -- 172.21.15.5:0/4002335373 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c60018af0 con 0x557a5b44edf0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c65ffb640 1 -- 172.21.15.5:0/4002335373 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c60010a70 con 0x557a5b44edf0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c6d7fa640 1 -- 172.21.15.5:0/716140443 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f1c680e5d00 con 0x7f1c70108020 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 -- 172.21.15.5:0/4002335373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 msgr2=0x557a5b45a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1c5c0b5360 0x7f1c5c0b7820 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c58031440 tx=0x7f1c58040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45a840 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000ad00 tx=0x7f1c6000f790 comp rx=0 tx=0).stop 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 -- 172.21.15.5:0/4002335373 shutdown_connections 2024-09-10T22:18:32.554 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b45ad80 0x557a5b45d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45a840 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 --2- 172.21.15.5:0/4002335373 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44e4d0 0x557a5b44e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.537+0000 7f1c78404740 1 -- 172.21.15.5:0/4002335373 >> 172.21.15.5:0/4002335373 conn(0x557a5b44c300 msgr2=0x557a5b44d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 -- 172.21.15.5:0/4002335373 shutdown_connections 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 -- 172.21.15.5:0/4002335373 wait complete. 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 -- start start 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 Processor -- start 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 0x557a5b45a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44edf0 0x557a5b457ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b4580f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x557a5b215700 con 0x557a5b44e4d0 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x557a5b34f160 con 0x557a5b44edf0 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.538+0000 7f1c78404740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x557a5b45da00 con 0x557a5b45ad80 2024-09-10T22:18:32.555 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c78404740 10 client.0 _ll_register_callbacks cb 0x557a5b3689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 0x557a5b45a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c6f7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 0x557a5b45a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42196/0 (socket says 172.21.15.5:42196) 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c6f7fe640 1 -- 172.21.15.5:0/7303406 learned_addr learned my addr 172.21.15.5:0/7303406 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44edf0 0x557a5b457ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b4580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 -- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 msgr2=0x557a5b4580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b4580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 -- 172.21.15.5:0/7303406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 msgr2=0x557a5b45a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 0x557a5b45a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 -- 172.21.15.5:0/7303406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5b37cc90 con 0x557a5b44edf0 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 0x557a5b45a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:32.556 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44edf0 0x557a5b457ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009230 tx=0x7f1c58009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea4b5f884baff7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.539+0000 7f1c4effd640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c4effd640 1 -- 172.21.15.5:0/7303406 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5804f030 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c4effd640 1 -- 172.21.15.5:0/7303406 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f1c58003cd0 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c60018af0 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c4effd640 1 -- 172.21.15.5:0/7303406 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c58045070 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 10 client.25310 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a5b469330 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c4effd640 1 -- 172.21.15.5:0/7303406 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c60018af0 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c4effd640 1 -- 172.21.15.5:0/7303406 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1c5803a040 con 0x557a5b44edf0 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 10 client.25310 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 10 client.25310 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 20 client.25310 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b46a740 0x557a5b46cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.557 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 4 client.25310 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.540+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a5b3c6df0 con 0x557a5b46a740 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.541+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b46a740 0x557a5b46cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.541+0000 7f1c4effd640 10 client.25310 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.541+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b46a740 0x557a5b46cbe0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de439f8bda3436f2 server_cookie=41c0bf1ca3841dc8 in_seq=0 out_seq=0 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c4effd640 1 -- 172.21.15.5:0/7303406 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a5b3c6df0 con 0x557a5b46a740 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c4effd640 10 client.25310 handle_command_reply: tid=0 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 client.25310 shutdown 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44edf0 msgr2=0x557a5b457ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44edf0 0x557a5b457ac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c58009230 tx=0x7f1c58009260 comp rx=0 tx=0).stop 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 shutdown_connections 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b4580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b46a740 0x557a5b46cbe0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.558 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44edf0 0x557a5b457ac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 --2- 172.21.15.5:0/7303406 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44e4d0 0x557a5b45a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c4effd640 0 client.25310 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 >> 172.21.15.5:0/7303406 conn(0x557a5b44c300 msgr2=0x557a5b451ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 shutdown_connections 2024-09-10T22:18:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 1 -- 172.21.15.5:0/7303406 wait complete. 2024-09-10T22:18:32.559 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.542+0000 7f1c78404740 20 client.25310 trim_cache size 0 max 16384 2024-09-10T22:18:32.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 Processor -- start 2024-09-10T22:18:32.563 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 -- start start 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b466c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b45c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701b0a60 con 0x557a5b44edf0 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701ae330 con 0x557a5b44e4d0 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c78404740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701ac180 con 0x557a5b45ad80 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.556+0000 7f1c66ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42210/0 (socket says 172.21.15.5:42210) 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 -- 172.21.15.5:0/2002615465 learned_addr learned my addr 172.21.15.5:0/2002615465 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b466c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b45c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 -- 172.21.15.5:0/2002615465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 msgr2=0x557a5b45c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.564 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b45c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 -- 172.21.15.5:0/2002615465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 msgr2=0x557a5b466c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b466c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 -- 172.21.15.5:0/2002615465 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a5b46d260 con 0x557a5b44edf0 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b466c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45c170 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1c5802a910 tx=0x7f1c580315a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4e3ed68cc6f25c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c657fa640 1 -- 172.21.15.5:0/2002615465 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c5804f020 con 0x557a5b44edf0 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c657fa640 1 -- 172.21.15.5:0/2002615465 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c58005170 con 0x557a5b44edf0 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.557+0000 7f1c657fa640 1 -- 172.21.15.5:0/2002615465 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c58035040 con 0x557a5b44edf0 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 -- 172.21.15.5:0/2002615465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 msgr2=0x557a5b45c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45c170 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1c5802a910 tx=0x7f1c580315a0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 -- 172.21.15.5:0/2002615465 shutdown_connections 2024-09-10T22:18:32.565 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b45ad80 0x557a5b45c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b44edf0 0x557a5b45c170 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 --2- 172.21.15.5:0/2002615465 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b466c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 -- 172.21.15.5:0/2002615465 >> 172.21.15.5:0/2002615465 conn(0x557a5b44c300 msgr2=0x557a5b452cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 -- 172.21.15.5:0/2002615465 shutdown_connections 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 -- 172.21.15.5:0/2002615465 wait complete. 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.558+0000 7f1c78404740 1 -- start start 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 Processor -- start 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b463190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44edf0 0x557a5b461cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 0x557a5b4621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701ac7f0 con 0x557a5b45ad80 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701adc60 con 0x557a5b44e4d0 2024-09-10T22:18:32.566 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1c701acec0 con 0x557a5b44edf0 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c78404740 10 client.0 _ll_register_callbacks cb 0x7f1c58004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 0x557a5b4621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c6ffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 0x557a5b4621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42216/0 (socket says 172.21.15.5:42216) 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c6ffff640 1 -- 172.21.15.5:0/3000604441 learned_addr learned my addr 172.21.15.5:0/3000604441 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c66ffd640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44edf0 0x557a5b461cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.559+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b463190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6ffff640 1 -- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44edf0 msgr2=0x557a5b461cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44edf0 0x557a5b461cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6ffff640 1 -- 172.21.15.5:0/3000604441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 msgr2=0x557a5b463190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b463190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6ffff640 1 -- 172.21.15.5:0/3000604441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a5b447990 con 0x557a5b45ad80 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b463190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:32.567 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c6ffff640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 0x557a5b4621f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c680a9760 tx=0x7f1c680abd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feaa4c8e426ae40d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c4effd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c4effd640 1 -- 172.21.15.5:0/3000604441 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c680acbf0 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c4effd640 1 -- 172.21.15.5:0/3000604441 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f1c680ab750 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c58005170 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c4effd640 1 -- 172.21.15.5:0/3000604441 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c680ac4f0 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c78404740 10 client.15741 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a5b4dc650 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.560+0000 7f1c4effd640 1 -- 172.21.15.5:0/3000604441 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c58005170 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c4effd640 1 -- 172.21.15.5:0/3000604441 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1c680ab1c0 con 0x557a5b45ad80 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c78404740 10 client.15741 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c78404740 10 client.15741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c78404740 20 client.15741 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:32.568 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c78404740 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b4dcda0 0x557a5b4df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c78404740 4 client.15741 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:18:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a5b3c28a0 con 0x557a5b4dcda0 2024-09-10T22:18:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b4dcda0 0x557a5b4df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c4effd640 10 client.15741 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:32.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.561+0000 7f1c6f7fe640 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b4dcda0 0x557a5b4df1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af205663ab90a416 server_cookie=3d46e88bff7f9e9f in_seq=0 out_seq=0 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c4effd640 1 -- 172.21.15.5:0/3000604441 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a5b3c28a0 con 0x557a5b4dcda0 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c4effd640 10 client.15741 handle_command_reply: tid=0 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 client.15741 shutdown 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 msgr2=0x557a5b4621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 0x557a5b4621f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1c680a9760 tx=0x7f1c680abd90 comp rx=0 tx=0).stop 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 shutdown_connections 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x557a5b45ad80 0x557a5b4621f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x557a5b44edf0 0x557a5b461cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x557a5b4dcda0 0x557a5b4df1c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 --2- 172.21.15.5:0/3000604441 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x557a5b44e4d0 0x557a5b463190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c4effd640 0 client.15741 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 >> 172.21.15.5:0/3000604441 conn(0x557a5b44c300 msgr2=0x557a5b4590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 shutdown_connections 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 1 -- 172.21.15.5:0/3000604441 wait complete. 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.562+0000 7f1c78404740 20 client.15741 trim_cache size 0 max 16384 2024-09-10T22:18:32.571 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1c5c0b5360 msgr2=0x7f1c5c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1c5c0b5360 0x7f1c5c0b7820 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c58031440 tx=0x7f1c58040040 comp rx=0 tx=0).stop 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 msgr2=0x7f1c7019d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 0x7f1c7019d970 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1c6800cce0 tx=0x7f1c6800a620 comp rx=0 tx=0).stop 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 shutdown_connections 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1c5c0b5360 0x7f1c5c0b7820 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1c70108020 0x7f1c7019d970 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1c701076a0 0x7f1c701985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 --2- 172.21.15.5:0/716140443 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1c70101c90 0x7f1c70198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 >> 172.21.15.5:0/716140443 conn(0x7f1c700fd700 msgr2=0x7f1c700ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:32.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 shutdown_connections 2024-09-10T22:18:32.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:32.563+0000 7f1c7602f640 1 -- 172.21.15.5:0/716140443 wait complete. 2024-09-10T22:18:33.305 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:18:33.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:33 smithi005 ceph-mon[31115]: pgmap v397: 97 pgs: 97 active+clean; 190 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 18 op/s 2024-09-10T22:18:33.584 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:33.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:33 smithi189 ceph-mon[35784]: pgmap v397: 97 pgs: 97 active+clean; 190 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 18 op/s 2024-09-10T22:18:33.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:33 smithi052 ceph-mon[34997]: pgmap v397: 97 pgs: 97 active+clean; 190 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 17 MiB/s wr, 18 op/s 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 -- 172.21.15.5:0/2541670515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2301045c0 msgr2=0x7fc23010cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2541670515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2301045c0 0x7fc23010cab0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc224009900 tx=0x7fc22402a410 comp rx=0 tx=0).stop 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 -- 172.21.15.5:0/2541670515 shutdown_connections 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2541670515 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc23010d100 0x7fc23010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2541670515 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc2301045c0 0x7fc23010cab0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2541670515 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc230103ca0 0x7fc230104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 -- 172.21.15.5:0/2541670515 >> 172.21.15.5:0/2541670515 conn(0x7fc2300fd700 msgr2=0x7fc2300ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 -- 172.21.15.5:0/2541670515 shutdown_connections 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.063+0000 7fc234e8c640 1 -- 172.21.15.5:0/2541670515 wait complete. 2024-09-10T22:18:34.086 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.064+0000 7fc234e8c640 1 Processor -- start 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.064+0000 7fc234e8c640 1 -- start start 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.064+0000 7fc234e8c640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc230103ca0 0x7fc2301992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.064+0000 7fc234e8c640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2301045c0 0x7fc2301997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.064+0000 7fc234e8c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 0x7fc23019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc234e8c640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc230112d70 con 0x7fc23010d100 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc234e8c640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc230112bf0 con 0x7fc230103ca0 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc234e8c640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc230112ef0 con 0x7fc2301045c0 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 0x7fc23019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 0x7fc23019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42224/0 (socket says 172.21.15.5:42224) 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 -- 172.21.15.5:0/2385755084 learned_addr learned my addr 172.21.15.5:0/2385755084 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22e59c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc230103ca0 0x7fc2301992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2301045c0 0x7fc2301997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 -- 172.21.15.5:0/2385755084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2301045c0 msgr2=0x7fc2301997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.087 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2301045c0 0x7fc2301997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 -- 172.21.15.5:0/2385755084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc230103ca0 msgr2=0x7fc2301992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc230103ca0 0x7fc2301992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 -- 172.21.15.5:0/2385755084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23019f350 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc22ed9d640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 0x7fc23019eb80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc22800eaa0 tx=0x7fc22800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc21f7fe640 1 -- 172.21.15.5:0/2385755084 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22800cdb0 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc21f7fe640 1 -- 172.21.15.5:0/2385755084 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc228005020 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc21f7fe640 1 -- 172.21.15.5:0/2385755084 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2280116d0 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.065+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23019f640 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.066+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2301a5d00 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.068+0000 7fc237261740 1 Processor -- start 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc21f7fe640 1 -- 172.21.15.5:0/2385755084 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc22800f040 con 0x7fc23010d100 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 -- start start 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c7668b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.088 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c772840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55854c6dcea0 con 0x55854c766df0 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55854c6cc2d0 con 0x55854c772d80 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc237261740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55854c6d00e0 con 0x55854c7664d0 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.069+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c772840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c772840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42232/0 (socket says 172.21.15.5:42232) 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 -- 172.21.15.5:0/3411687205 learned_addr learned my addr 172.21.15.5:0/3411687205 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c7668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc21f7fe640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc2180b52e0 0x7fc2180b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22ed9d640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc2180b52e0 0x7fc2180b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 -- 172.21.15.5:0/3411687205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 msgr2=0x55854c7668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c7668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 -- 172.21.15.5:0/3411687205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 msgr2=0x55854c775170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 -- 172.21.15.5:0/3411687205 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55854c42a650 con 0x55854c766df0 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc21f7fe640 1 -- 172.21.15.5:0/2385755084 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc2280e59e0 con 0x7fc23010d100 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc22e59c640 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c772840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc22000bd10 tx=0x7fc2200107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfcecb2ae3f25da server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc21cff9640 1 -- 172.21.15.5:0/3411687205 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220004030 con 0x55854c766df0 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc21cff9640 1 -- 172.21.15.5:0/3411687205 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2200035f0 con 0x55854c766df0 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.070+0000 7fc21cff9640 1 -- 172.21.15.5:0/3411687205 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220011680 con 0x55854c766df0 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 -- 172.21.15.5:0/3411687205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 msgr2=0x55854c772840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc22ed9d640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc2180b52e0 0x7fc2180b77a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc22800efd0 tx=0x7fc2280a0b30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c772840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc22000bd10 tx=0x7fc2200107a0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 -- 172.21.15.5:0/3411687205 shutdown_connections 2024-09-10T22:18:34.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c772840 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 --2- 172.21.15.5:0/3411687205 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c7668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 -- 172.21.15.5:0/3411687205 >> 172.21.15.5:0/3411687205 conn(0x55854c764300 msgr2=0x55854c7654a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 -- 172.21.15.5:0/3411687205 shutdown_connections 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.071+0000 7fc237261740 1 -- 172.21.15.5:0/3411687205 wait complete. 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 -- start start 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 Processor -- start 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c7664d0 0x55854c772670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c76fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 0x55854c7700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55854c52d700 con 0x55854c772d80 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55854c667160 con 0x55854c7664d0 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55854c775a00 con 0x55854c766df0 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc237261740 10 client.0 _ll_register_callbacks cb 0x55854c6809e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:34.091 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.072+0000 7fc22dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 0x55854c7700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 0x55854c7700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42248/0 (socket says 172.21.15.5:42248) 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1064897222 learned_addr learned my addr 172.21.15.5:0/1064897222 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c7664d0 0x55854c772670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22e59c640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c76fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1064897222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 msgr2=0x55854c76fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c76fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c7664d0 msgr2=0x55854c772670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c7664d0 0x55854c772670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1064897222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55854c694c90 con 0x55854c772d80 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 0x55854c7700f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc224005940 tx=0x7fc224009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4582ba21fd0a81ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc215ffb640 1 -- 172.21.15.5:0/1064897222 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224035040 con 0x55854c772d80 2024-09-10T22:18:34.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc215ffb640 1 -- 172.21.15.5:0/1064897222 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc224004480 con 0x55854c772d80 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.073+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2200035f0 con 0x55854c772d80 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc215ffb640 1 -- 172.21.15.5:0/1064897222 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc224054050 con 0x55854c772d80 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 10 client.15753 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55854c781330 con 0x55854c772d80 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc215ffb640 1 -- 172.21.15.5:0/1064897222 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2200035f0 con 0x55854c772d80 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc215ffb640 1 -- 172.21.15.5:0/1064897222 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc22404b070 con 0x55854c772d80 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 10 client.15753 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 10 client.15753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 20 client.15753 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c784bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 4 client.15753 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.074+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55854c6dedf0 con 0x55854c782790 2024-09-10T22:18:34.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.075+0000 7fc22e59c640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c784bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.075+0000 7fc22e59c640 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c784bc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f9d0fa9926a8cf42 server_cookie=78d5d644da770323 in_seq=0 out_seq=0 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.075+0000 7fc215ffb640 10 client.15753 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc215ffb640 1 -- 172.21.15.5:0/1064897222 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55854c6dedf0 con 0x55854c782790 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc215ffb640 10 client.15753 handle_command_reply: tid=0 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 client.15753 shutdown 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 msgr2=0x55854c7700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 0x55854c7700f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc224005940 tx=0x7fc224009260 comp rx=0 tx=0).stop 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 shutdown_connections 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c784bc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c772d80 0x55854c7700f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc215ffb640 0 client.15753 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:34.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c76fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 --2- 172.21.15.5:0/1064897222 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c7664d0 0x55854c772670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 >> 172.21.15.5:0/1064897222 conn(0x55854c764300 msgr2=0x55854c769ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 shutdown_connections 2024-09-10T22:18:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 1 -- 172.21.15.5:0/1064897222 wait complete. 2024-09-10T22:18:34.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.076+0000 7fc237261740 20 client.15753 trim_cache size 0 max 16384 2024-09-10T22:18:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.090+0000 7fc237261740 1 Processor -- start 2024-09-10T22:18:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.090+0000 7fc237261740 1 -- start start 2024-09-10T22:18:34.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc237261740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c77ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc237261740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c765a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc237261740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c771800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc237261740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301b0bd0 con 0x55854c766df0 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc237261740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301ae4a0 con 0x55854c772d80 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc237261740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301ac2f0 con 0x55854c7664d0 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c765a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c765a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42254/0 (socket says 172.21.15.5:42254) 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 -- 172.21.15.5:0/3068748315 learned_addr learned my addr 172.21.15.5:0/3068748315 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c77ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c771800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 -- 172.21.15.5:0/3068748315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 msgr2=0x55854c77ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c77ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 -- 172.21.15.5:0/3068748315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 msgr2=0x55854c771800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c771800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 -- 172.21.15.5:0/3068748315 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55854c766c20 con 0x55854c766df0 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.091+0000 7fc22e59c640 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c765a30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc22000bd10 tx=0x7fc220003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9faac8188beede4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc217fff640 1 -- 172.21.15.5:0/3068748315 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220032070 con 0x55854c766df0 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc217fff640 1 -- 172.21.15.5:0/3068748315 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc22000be80 con 0x55854c766df0 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc217fff640 1 -- 172.21.15.5:0/3068748315 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220011440 con 0x55854c766df0 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 -- 172.21.15.5:0/3068748315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 msgr2=0x55854c765a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c765a30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc22000bd10 tx=0x7fc220003f60 comp rx=0 tx=0).stop 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 -- 172.21.15.5:0/3068748315 shutdown_connections 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c771800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c766df0 0x55854c765a30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 --2- 172.21.15.5:0/3068748315 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c7664d0 0x55854c77ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.092+0000 7fc237261740 1 -- 172.21.15.5:0/3068748315 >> 172.21.15.5:0/3068748315 conn(0x55854c764300 msgr2=0x55854c7710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 -- 172.21.15.5:0/3068748315 shutdown_connections 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 -- 172.21.15.5:0/3068748315 wait complete. 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 -- start start 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 Processor -- start 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 0x55854c77af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c77b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301ac960 con 0x55854c7664d0 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301addd0 con 0x55854c772d80 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc2301ad030 con 0x55854c766df0 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc237261740 10 client.0 _ll_register_callbacks cb 0x7fc224005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc22dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 0x55854c77af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc22dd9b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 0x55854c77af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42270/0 (socket says 172.21.15.5:42270) 2024-09-10T22:18:34.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.093+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1530223418 learned_addr learned my addr 172.21.15.5:0/1530223418 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22e59c640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c77b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1530223418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 msgr2=0x55854c77b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c77b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 msgr2=0x55854c775cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 -- 172.21.15.5:0/1530223418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55854c7764e0 con 0x55854c7664d0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc22dd9b640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 0x55854c77af30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc224009230 tx=0x7fc224009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d931d523489cc77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc215ffb640 1 -- 172.21.15.5:0/1530223418 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22405e060 con 0x55854c7664d0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc215ffb640 1 -- 172.21.15.5:0/1530223418 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fc22403da00 con 0x55854c7664d0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55854c6da8a0 con 0x55854c7664d0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc215ffb640 1 -- 172.21.15.5:0/1530223418 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc224035040 con 0x55854c7664d0 2024-09-10T22:18:34.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc237261740 10 client.15759 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.094+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55854c7f02a0 con 0x55854c7664d0 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc215ffb640 1 -- 172.21.15.5:0/1530223418 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2240035f0 con 0x55854c7664d0 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc215ffb640 1 -- 172.21.15.5:0/1530223418 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc22404b040 con 0x55854c7664d0 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc237261740 10 client.15759 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc237261740 10 client.15759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc237261740 20 client.15759 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc237261740 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c7f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc237261740 4 client.15759 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55854c6da8a0 con 0x55854c782790 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.095+0000 7fc22e59c640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c7f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc215ffb640 10 client.15759 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc22e59c640 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c7f2a40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15b50151e60281d server_cookie=b1a4f230c19fd893 in_seq=0 out_seq=0 2024-09-10T22:18:34.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc215ffb640 1 -- 172.21.15.5:0/1530223418 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55854c6da8a0 con 0x55854c782790 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc215ffb640 10 client.15759 handle_command_reply: tid=0 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 client.15759 shutdown 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 msgr2=0x55854c77af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 0x55854c77af30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc224009230 tx=0x7fc224009260 comp rx=0 tx=0).stop 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 shutdown_connections 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55854c772d80 0x55854c775cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55854c766df0 0x55854c77b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x55854c782790 0x55854c7f2a40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 --2- 172.21.15.5:0/1530223418 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55854c7664d0 0x55854c77af30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 >> 172.21.15.5:0/1530223418 conn(0x55854c764300 msgr2=0x55854c765920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.096+0000 7fc215ffb640 0 client.15759 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 shutdown_connections 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc237261740 1 -- 172.21.15.5:0/1530223418 wait complete. 2024-09-10T22:18:34.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc237261740 20 client.15759 trim_cache size 0 max 16384 2024-09-10T22:18:34.106 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:18:34.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc2180b52e0 msgr2=0x7fc2180b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc2180b52e0 0x7fc2180b77a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc22800efd0 tx=0x7fc2280a0b30 comp rx=0 tx=0).stop 2024-09-10T22:18:34.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 msgr2=0x7fc23019eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:34.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 0x7fc23019eb80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc22800eaa0 tx=0x7fc22800ef60 comp rx=0 tx=0).stop 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 shutdown_connections 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc2180b52e0 0x7fc2180b77a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc23010d100 0x7fc23019eb80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc2301045c0 0x7fc2301997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 --2- 172.21.15.5:0/2385755084 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc230103ca0 0x7fc2301992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.097+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 >> 172.21.15.5:0/2385755084 conn(0x7fc2300fd700 msgr2=0x7fc2300fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.098+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 shutdown_connections 2024-09-10T22:18:34.107 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:34.098+0000 7fc234e8c640 1 -- 172.21.15.5:0/2385755084 wait complete. 2024-09-10T22:18:34.841 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:18:35.112 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:35.549 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:35 smithi005 ceph-mon[31115]: pgmap v398: 97 pgs: 97 active+clean; 198 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 16 op/s 2024-09-10T22:18:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 -- 172.21.15.5:0/2591338261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c810f3e0 msgr2=0x7f73c81117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 --2- 172.21.15.5:0/2591338261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c810f3e0 0x7f73c81117d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009ca0 tx=0x7f73c002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 -- 172.21.15.5:0/2591338261 shutdown_connections 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 --2- 172.21.15.5:0/2591338261 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c810f3e0 0x7f73c81117d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 --2- 172.21.15.5:0/2591338261 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73c8075f40 0x7f73c810ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 --2- 172.21.15.5:0/2591338261 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c8075540 0x7f73c8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 -- 172.21.15.5:0/2591338261 >> 172.21.15.5:0/2591338261 conn(0x7f73c80fe830 msgr2=0x7f73c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.547+0000 7f73cd978640 1 -- 172.21.15.5:0/2591338261 shutdown_connections 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.548+0000 7f73cd978640 1 -- 172.21.15.5:0/2591338261 wait complete. 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.548+0000 7f73cd978640 1 Processor -- start 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.548+0000 7f73cd978640 1 -- start start 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73cd978640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 0x7f73c819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73cd978640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c8075f40 0x7f73c819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73cd978640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73c810f3e0 0x7f73c81a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73cd978640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8114fb0 con 0x7f73c8075540 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73cd978640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8114e30 con 0x7f73c8075f40 2024-09-10T22:18:35.570 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73cd978640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8115130 con 0x7f73c810f3e0 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 0x7f73c819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 0x7f73c819b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42290/0 (socket says 172.21.15.5:42290) 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 -- 172.21.15.5:0/2968586435 learned_addr learned my addr 172.21.15.5:0/2968586435 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c77fe640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73c810f3e0 0x7f73c81a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73be7fc640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c8075f40 0x7f73c819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 -- 172.21.15.5:0/2968586435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73c810f3e0 msgr2=0x7f73c81a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73c810f3e0 0x7f73c81a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 -- 172.21.15.5:0/2968586435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c8075f40 msgr2=0x7f73c819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c8075f40 0x7f73c819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.549+0000 7f73c6ffd640 1 -- 172.21.15.5:0/2968586435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c81a15d0 con 0x7f73c8075540 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.550+0000 7f73c6ffd640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 0x7f73c819b520 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f73b800c890 tx=0x7f73b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.550+0000 7f73cc976640 1 -- 172.21.15.5:0/2968586435 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8004220 con 0x7f73c8075540 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.550+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c81a18c0 con 0x7f73c8075540 2024-09-10T22:18:35.571 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.550+0000 7f73cc976640 1 -- 172.21.15.5:0/2968586435 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b80043c0 con 0x7f73c8075540 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.550+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81a8150 con 0x7f73c8075540 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.550+0000 7f73cc976640 1 -- 172.21.15.5:0/2968586435 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b8004a00 con 0x7f73c8075540 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 Processor -- start 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 -- start start 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c3128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558d5c288ea0 con 0x558d5c312df0 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558d5c2782d0 con 0x558d5c3124d0 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558d5c27c0e0 con 0x558d5c31ed80 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73cc976640 1 -- 172.21.15.5:0/2968586435 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f73b8004bc0 con 0x7f73c8075540 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73c6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c3128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.572 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73c77fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c3128b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:47796/0 (socket says 172.21.15.5:47796) 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73c77fe640 1 -- 172.21.15.5:0/4008284132 learned_addr learned my addr 172.21.15.5:0/4008284132 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.553+0000 7f73be7fc640 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c77fe640 1 -- 172.21.15.5:0/4008284132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 msgr2=0x558d5c321170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c77fe640 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c77fe640 1 -- 172.21.15.5:0/4008284132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 msgr2=0x558d5c31e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c77fe640 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c77fe640 1 -- 172.21.15.5:0/4008284132 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5bfd6650 con 0x558d5c3124d0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c77fe640 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c3128b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73c806c280 tx=0x7f73c00099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef006c5bcd962de3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73cc976640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f73b40b52e0 0x7f73b40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73bdffb640 1 -- 172.21.15.5:0/4008284132 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0031450 con 0x558d5c3124d0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73c6ffd640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f73b40b52e0 0x7f73b40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73bdffb640 1 -- 172.21.15.5:0/4008284132 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c0036030 con 0x558d5c3124d0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73bdffb640 1 -- 172.21.15.5:0/4008284132 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c00043c0 con 0x558d5c3124d0 2024-09-10T22:18:35.573 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.554+0000 7f73cc976640 1 -- 172.21.15.5:0/2968586435 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f73b80e5850 con 0x7f73c8075540 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 -- 172.21.15.5:0/4008284132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 msgr2=0x558d5c3128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c3128b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f73c806c280 tx=0x7f73c00099d0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73c6ffd640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f73b40b52e0 0x7f73b40b77a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73b80e36f0 tx=0x7f73b80eb550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 -- 172.21.15.5:0/4008284132 shutdown_connections 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/4008284132 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c3128b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 -- 172.21.15.5:0/4008284132 >> 172.21.15.5:0/4008284132 conn(0x558d5c310300 msgr2=0x558d5c3114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 -- 172.21.15.5:0/4008284132 shutdown_connections 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.555+0000 7f73cfd4d740 1 -- 172.21.15.5:0/4008284132 wait complete. 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 -- start start 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 Processor -- start 2024-09-10T22:18:35.574 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c31bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x558d5c0d9700 con 0x558d5c312df0 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x558d5c213160 con 0x558d5c3124d0 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x558d5c321820 con 0x558d5c31ed80 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73cfd4d740 10 client.0 _ll_register_callbacks cb 0x558d5c22c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42298/0 (socket says 172.21.15.5:42298) 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.556+0000 7f73be7fc640 1 -- 172.21.15.5:0/1545891536 learned_addr learned my addr 172.21.15.5:0/1545891536 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73c77fe640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73c77fe640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c31bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73be7fc640 1 -- 172.21.15.5:0/1545891536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 msgr2=0x558d5c31bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.575 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73be7fc640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c31bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73be7fc640 1 -- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 msgr2=0x558d5c31e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73be7fc640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73be7fc640 1 -- 172.21.15.5:0/1545891536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5c240c90 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73c77fe640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c31bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73be7fc640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31ba00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f73b0010820 tx=0x7f73b0010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a256c2c9d2c41e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73a6ffd640 1 -- 172.21.15.5:0/1545891536 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b000fb10 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73a6ffd640 1 -- 172.21.15.5:0/1545891536 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f73b000fcb0 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73c0036030 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73a6ffd640 1 -- 172.21.15.5:0/1545891536 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73b0005020 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73cfd4d740 10 client.15771 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.557+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d5c32d150 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73a6ffd640 1 -- 172.21.15.5:0/1545891536 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73c0036030 con 0x558d5c312df0 2024-09-10T22:18:35.576 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73a6ffd640 1 -- 172.21.15.5:0/1545891536 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f73b0025480 con 0x558d5c312df0 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73cfd4d740 10 client.15771 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73cfd4d740 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73cfd4d740 20 client.15771 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c32e980 0x558d5c330e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73cfd4d740 4 client.15771 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d5c28adf0 con 0x558d5c32e980 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.558+0000 7f73c77fe640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c32e980 0x558d5c330e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.559+0000 7f73c77fe640 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c32e980 0x558d5c330e00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d3d976538487c8d server_cookie=cabfd8a4c7542d82 in_seq=0 out_seq=0 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.559+0000 7f73a6ffd640 10 client.15771 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.559+0000 7f73a6ffd640 1 -- 172.21.15.5:0/1545891536 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d5c28adf0 con 0x558d5c32e980 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.559+0000 7f73a6ffd640 10 client.15771 handle_command_reply: tid=0 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.559+0000 7f73cfd4d740 1 client.15771 shutdown 2024-09-10T22:18:35.577 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 msgr2=0x558d5c31ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31ba00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f73b0010820 tx=0x7f73b0010ce0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 shutdown_connections 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c32e980 0x558d5c330e00 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c31bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c31ba00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/1545891536 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73a6ffd640 0 client.15771 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 >> 172.21.15.5:0/1545891536 conn(0x558d5c310300 msgr2=0x558d5c315ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 shutdown_connections 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 1 -- 172.21.15.5:0/1545891536 wait complete. 2024-09-10T22:18:35.578 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.560+0000 7f73cfd4d740 20 client.15771 trim_cache size 0 max 16384 2024-09-10T22:18:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 Processor -- start 2024-09-10T22:18:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 -- start start 2024-09-10T22:18:35.581 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c3113c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c311900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b2e70 con 0x558d5c312df0 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b0740 con 0x558d5c3124d0 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.575+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81ae590 con 0x558d5c31ed80 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c3113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c3113c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42302/0 (socket says 172.21.15.5:42302) 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 -- 172.21.15.5:0/3396893052 learned_addr learned my addr 172.21.15.5:0/3396893052 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c311900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 -- 172.21.15.5:0/3396893052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 msgr2=0x558d5c311900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c311900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 -- 172.21.15.5:0/3396893052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 msgr2=0x558d5c31aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.582 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 -- 172.21.15.5:0/3396893052 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d5c310d80 con 0x558d5c312df0 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c311900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73be7fc640 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c3113c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f73b0025a90 tx=0x7f73b0010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e407dbacefb28166 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.576+0000 7f73bd7fa640 1 -- 172.21.15.5:0/3396893052 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b002b070 con 0x558d5c312df0 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73bd7fa640 1 -- 172.21.15.5:0/3396893052 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b0025c10 con 0x558d5c312df0 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73bd7fa640 1 -- 172.21.15.5:0/3396893052 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b0005620 con 0x558d5c312df0 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3396893052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 msgr2=0x558d5c3113c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c3113c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f73b0025a90 tx=0x7f73b0010430 comp rx=0 tx=0).stop 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3396893052 shutdown_connections 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c311900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c3113c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3396893052 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c31aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3396893052 >> 172.21.15.5:0/3396893052 conn(0x558d5c310300 msgr2=0x558d5c31a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:35.583 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.577+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3396893052 shutdown_connections 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3396893052 wait complete. 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 -- start start 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 Processor -- start 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c326b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c327060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81aec00 con 0x558d5c312df0 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81b0070 con 0x558d5c3124d0 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f73c81af2d0 con 0x558d5c31ed80 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.578+0000 7f73cfd4d740 10 client.0 _ll_register_callbacks cb 0x7f73b000a720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c327060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c327060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42312/0 (socket says 172.21.15.5:42312) 2024-09-10T22:18:35.584 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 -- 172.21.15.5:0/3617328684 learned_addr learned my addr 172.21.15.5:0/3617328684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c326b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 -- 172.21.15.5:0/3617328684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 msgr2=0x558d5c321ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 -- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 msgr2=0x558d5c326b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c326b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 -- 172.21.15.5:0/3617328684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5c327890 con 0x558d5c312df0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73be7fc640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c327060 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f73b0010d20 tx=0x7f73b000a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338c8c13524f3050 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73a6ffd640 1 -- 172.21.15.5:0/3617328684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b002b040 con 0x558d5c312df0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73a6ffd640 1 -- 172.21.15.5:0/3617328684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f73b000fb10 con 0x558d5c312df0 2024-09-10T22:18:35.585 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.579+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73b0025c10 con 0x558d5c312df0 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73a6ffd640 1 -- 172.21.15.5:0/3617328684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f73b000fd10 con 0x558d5c312df0 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 10 client.15777 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d5c39bf50 con 0x558d5c312df0 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73a6ffd640 1 -- 172.21.15.5:0/3617328684 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73b0025c10 con 0x558d5c312df0 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73a6ffd640 1 -- 172.21.15.5:0/3617328684 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f73b0037070 con 0x558d5c312df0 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 10 client.15777 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 20 client.15777 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c39c650 0x558d5c39ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:35.587 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 4 client.15777 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d5c310060 con 0x558d5c39c650 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.580+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c39c650 0x558d5c39ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73a6ffd640 10 client.15777 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73c77fe640 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c39c650 0x558d5c39ea70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c96f5593b2fc963f server_cookie=8c8ddc3ab8b5f420 in_seq=0 out_seq=0 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73a6ffd640 1 -- 172.21.15.5:0/3617328684 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d5c310060 con 0x558d5c39c650 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73a6ffd640 10 client.15777 handle_command_reply: tid=0 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 client.15777 shutdown 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 msgr2=0x558d5c327060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c327060 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f73b0010d20 tx=0x7f73b000a6b0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 shutdown_connections 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x558d5c39c650 0x558d5c39ea70 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x558d5c31ed80 0x558d5c321ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.588 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x558d5c312df0 0x558d5c327060 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73a6ffd640 0 client.15777 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 --2- 172.21.15.5:0/3617328684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x558d5c3124d0 0x558d5c326b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 >> 172.21.15.5:0/3617328684 conn(0x558d5c310300 msgr2=0x558d5c311350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 shutdown_connections 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.581+0000 7f73cfd4d740 1 -- 172.21.15.5:0/3617328684 wait complete. 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cfd4d740 20 client.15777 trim_cache size 0 max 16384 2024-09-10T22:18:35.589 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f73b40b52e0 msgr2=0x7f73b40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f73b40b52e0 0x7f73b40b77a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73b80e36f0 tx=0x7f73b80eb550 comp rx=0 tx=0).stop 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 msgr2=0x7f73c819b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 0x7f73c819b520 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f73b800c890 tx=0x7f73b800cd50 comp rx=0 tx=0).stop 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 shutdown_connections 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f73b40b52e0 0x7f73b40b77a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f73c810f3e0 0x7f73c81a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f73c8075f40 0x7f73c819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 --2- 172.21.15.5:0/2968586435 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f73c8075540 0x7f73c819b520 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:35.590 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 >> 172.21.15.5:0/2968586435 conn(0x7f73c80fe830 msgr2=0x7f73c80ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 shutdown_connections 2024-09-10T22:18:35.591 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:35.582+0000 7f73cd978640 1 -- 172.21.15.5:0/2968586435 wait complete. 2024-09-10T22:18:35.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:35 smithi189 ceph-mon[35784]: pgmap v398: 97 pgs: 97 active+clean; 198 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 16 op/s 2024-09-10T22:18:35.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:35 smithi052 ceph-mon[34997]: pgmap v398: 97 pgs: 97 active+clean; 198 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 16 op/s 2024-09-10T22:18:37.283 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-10T22:18:37.284 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-10T22:18:37.563 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:37.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:37 smithi005 ceph-mon[31115]: pgmap v399: 97 pgs: 97 active+clean; 230 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-09-10T22:18:37.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:37 smithi189 ceph-mon[35784]: pgmap v399: 97 pgs: 97 active+clean; 230 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-09-10T22:18:37.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:37 smithi052 ceph-mon[34997]: pgmap v399: 97 pgs: 97 active+clean; 230 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 27 MiB/s wr, 21 op/s 2024-09-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 -- 172.21.15.5:0/379988528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc1076a0 msgr2=0x7f49cc107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 --2- 172.21.15.5:0/379988528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc1076a0 0x7f49cc107ae0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009900 tx=0x7f49bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 -- 172.21.15.5:0/379988528 shutdown_connections 2024-09-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 --2- 172.21.15.5:0/379988528 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc108020 0x7f49cc10e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 --2- 172.21.15.5:0/379988528 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc1076a0 0x7f49cc107ae0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.071 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 --2- 172.21.15.5:0/379988528 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49cc101c90 0x7f49cc102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.058+0000 7f49d3f58640 1 -- 172.21.15.5:0/379988528 >> 172.21.15.5:0/379988528 conn(0x7f49cc0fd700 msgr2=0x7f49cc0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.059+0000 7f49d3f58640 1 -- 172.21.15.5:0/379988528 shutdown_connections 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.059+0000 7f49d3f58640 1 -- 172.21.15.5:0/379988528 wait complete. 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.059+0000 7f49d3f58640 1 Processor -- start 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.059+0000 7f49d3f58640 1 -- start start 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d3f58640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49cc101c90 0x7f49cc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d3f58640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc1076a0 0x7f49cc199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d3f58640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 0x7f49cc19ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d3f58640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc111ce0 con 0x7f49cc108020 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d3f58640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc111b60 con 0x7f49cc101c90 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d3f58640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc111e60 con 0x7f49cc1076a0 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 0x7f49cc19ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 0x7f49cc19ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42330/0 (socket says 172.21.15.5:42330) 2024-09-10T22:18:38.072 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 -- 172.21.15.5:0/3904550181 learned_addr learned my addr 172.21.15.5:0/3904550181 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49cc101c90 0x7f49cc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d14f3640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc1076a0 0x7f49cc199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 -- 172.21.15.5:0/3904550181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc1076a0 msgr2=0x7f49cc199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc1076a0 0x7f49cc199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 -- 172.21.15.5:0/3904550181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49cc101c90 msgr2=0x7f49cc199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49cc101c90 0x7f49cc199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 -- 172.21.15.5:0/3904550181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49cc19f3c0 con 0x7f49cc108020 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.060+0000 7f49d24f5640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 0x7f49cc19ebf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009fd0 tx=0x7f49c400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.061+0000 7f49c2ffd640 1 -- 172.21.15.5:0/3904550181 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4017070 con 0x7f49cc108020 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.061+0000 7f49c2ffd640 1 -- 172.21.15.5:0/3904550181 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c4003e20 con 0x7f49cc108020 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.061+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49cc19f6b0 con 0x7f49cc108020 2024-09-10T22:18:38.073 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.061+0000 7f49c2ffd640 1 -- 172.21.15.5:0/3904550181 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c4010460 con 0x7f49cc108020 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.061+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49cc1a5d70 con 0x7f49cc108020 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.063+0000 7f49d632d740 1 Processor -- start 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.063+0000 7f49c2ffd640 1 -- 172.21.15.5:0/3904550181 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f49c4010640 con 0x7f49cc108020 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 -- start start 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641d1763e60 con 0x5641d17f9790 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641d1753290 con 0x5641d17ed800 2024-09-10T22:18:38.074 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d632d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5641d17570a0 con 0x5641d17ecee0 2024-09-10T22:18:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d14f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d14f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17fbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42338/0 (socket says 172.21.15.5:42338) 2024-09-10T22:18:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d14f3640 1 -- 172.21.15.5:0/2519615289 learned_addr learned my addr 172.21.15.5:0/2519615289 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:38.075 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49d14f3640 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.064+0000 7f49c2ffd640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f49b80b5360 0x7f49b80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d24f5640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f49b80b5360 0x7f49b80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2519615289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 msgr2=0x5641d17ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2519615289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 msgr2=0x5641d17fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2519615289 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d14b1930 con 0x5641d17ed800 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49c2ffd640 1 -- 172.21.15.5:0/3904550181 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f49c40e57b0 con 0x7f49cc108020 2024-09-10T22:18:38.077 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f9250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009c20 tx=0x7f49c8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e25ab1eb5746693f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49d24f5640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f49b80b5360 0x7f49b80b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49c40a8620 tx=0x7f49c40092a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49b7fff640 1 -- 172.21.15.5:0/2519615289 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8004050 con 0x5641d17ed800 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49b7fff640 1 -- 172.21.15.5:0/2519615289 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c80054d0 con 0x5641d17ed800 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.065+0000 7f49b7fff640 1 -- 172.21.15.5:0/2519615289 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c8004c60 con 0x5641d17ed800 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 -- 172.21.15.5:0/2519615289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 msgr2=0x5641d17f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f9250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009c20 tx=0x7f49c8011810 comp rx=0 tx=0).stop 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 -- 172.21.15.5:0/2519615289 shutdown_connections 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f9250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 --2- 172.21.15.5:0/2519615289 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 -- 172.21.15.5:0/2519615289 >> 172.21.15.5:0/2519615289 conn(0x5641d17ead10 msgr2=0x5641d17ebeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 -- 172.21.15.5:0/2519615289 shutdown_connections 2024-09-10T22:18:38.078 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 -- 172.21.15.5:0/2519615289 wait complete. 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 -- start start 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.066+0000 7f49d632d740 1 Processor -- start 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17f6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5641d15b4890 con 0x5641d17f9790 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5641d16edd40 con 0x5641d17ed800 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5641d17fc440 con 0x5641d17ecee0 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d632d740 10 client.0 _ll_register_callbacks cb 0x5641d1751c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42344/0 (socket says 172.21.15.5:42344) 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 -- 172.21.15.5:0/4167660634 learned_addr learned my addr 172.21.15.5:0/4167660634 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.079 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 -- 172.21.15.5:0/4167660634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 msgr2=0x5641d17f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 -- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 msgr2=0x5641d17f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.067+0000 7f49d14f3640 1 -- 172.21.15.5:0/4167660634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d1805820 con 0x5641d17f9790 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.068+0000 7f49d14f3640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17f7190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f49bc000c00 tx=0x7f49bc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466dd64610671113 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.068+0000 7f49b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.068+0000 7f49b57fa640 1 -- 172.21.15.5:0/4167660634 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc035040 con 0x5641d17f9790 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.068+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c80054d0 con 0x5641d17f9790 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.068+0000 7f49b57fa640 1 -- 172.21.15.5:0/4167660634 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f49bc004330 con 0x5641d17f9790 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49b57fa640 1 -- 172.21.15.5:0/4167660634 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49bc0035f0 con 0x5641d17f9790 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 10 client.15789 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:38.080 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641d18081b0 con 0x5641d17f9790 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49b57fa640 1 -- 172.21.15.5:0/4167660634 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c80054d0 con 0x5641d17f9790 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49b57fa640 1 -- 172.21.15.5:0/4167660634 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49bc03d6c0 con 0x5641d17f9790 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 10 client.15789 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 10 client.15789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 20 client.15789 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d1809670 0x5641d180ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 4 client.15789 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.069+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d1765db0 con 0x5641d1809670 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.070+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d1809670 0x5641d180ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.070+0000 7f49b57fa640 10 client.15789 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.070+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d1809670 0x5641d180ba60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd94c6edeed1210b server_cookie=ebf6e5ab8ce8670 in_seq=0 out_seq=0 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49b57fa640 1 -- 172.21.15.5:0/4167660634 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641d1765db0 con 0x5641d1809670 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49b57fa640 10 client.15789 handle_command_reply: tid=0 2024-09-10T22:18:38.081 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 client.15789 shutdown 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 msgr2=0x5641d17f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17f7190 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f49bc000c00 tx=0x7f49bc02a410 comp rx=0 tx=0).stop 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 shutdown_connections 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d1809670 0x5641d180ba60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17f9790 0x5641d17f7190 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ed800 0x5641d17f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49b57fa640 0 client.15789 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 --2- 172.21.15.5:0/4167660634 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ecee0 0x5641d17f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 >> 172.21.15.5:0/4167660634 conn(0x5641d17ead10 msgr2=0x5641d17e9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 shutdown_connections 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 1 -- 172.21.15.5:0/4167660634 wait complete. 2024-09-10T22:18:38.082 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.071+0000 7f49d632d740 20 client.15789 trim_cache size 0 max 16384 2024-09-10T22:18:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.089+0000 7f49d632d740 1 Processor -- start 2024-09-10T22:18:38.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.089+0000 7f49d632d740 1 -- start start 2024-09-10T22:18:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d632d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ecee0 0x5641d17f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d632d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 0x5641d17f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d632d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17f9790 0x5641d17f3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d632d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1aebc0 con 0x5641d17ed800 2024-09-10T22:18:38.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d632d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1ac490 con 0x5641d17ecee0 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d632d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1aa300 con 0x5641d17f9790 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 0x5641d17f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 0x5641d17f5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42346/0 (socket says 172.21.15.5:42346) 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2428170853 learned_addr learned my addr 172.21.15.5:0/2428170853 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d14f3640 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ecee0 0x5641d17f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d14f3640 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17f9790 0x5641d17f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2428170853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17f9790 msgr2=0x5641d17f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17f9790 0x5641d17f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2428170853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ecee0 msgr2=0x5641d17f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ecee0 0x5641d17f83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.090+0000 7f49d1cf4640 1 -- 172.21.15.5:0/2428170853 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d180c090 con 0x5641d17ed800 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.091+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 0x5641d17f5fa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009c20 tx=0x7f49c8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e1e921fb9d3094 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.091+0000 7f49b77fe640 1 -- 172.21.15.5:0/2428170853 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c80097a0 con 0x5641d17ed800 2024-09-10T22:18:38.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.091+0000 7f49b77fe640 1 -- 172.21.15.5:0/2428170853 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c8004610 con 0x5641d17ed800 2024-09-10T22:18:38.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.091+0000 7f49b77fe640 1 -- 172.21.15.5:0/2428170853 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c80054e0 con 0x5641d17ed800 2024-09-10T22:18:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.091+0000 7f49d632d740 1 -- 172.21.15.5:0/2428170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 msgr2=0x5641d17f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 0x5641d17f5fa0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009c20 tx=0x7f49c8011810 comp rx=0 tx=0).stop 2024-09-10T22:18:38.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 -- 172.21.15.5:0/2428170853 shutdown_connections 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17f9790 0x5641d17f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ed800 0x5641d17f5fa0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 --2- 172.21.15.5:0/2428170853 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17ecee0 0x5641d17f83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 -- 172.21.15.5:0/2428170853 >> 172.21.15.5:0/2428170853 conn(0x5641d17ead10 msgr2=0x5641d17f6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 -- 172.21.15.5:0/2428170853 shutdown_connections 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 -- 172.21.15.5:0/2428170853 wait complete. 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 -- start start 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.092+0000 7f49d632d740 1 Processor -- start 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 0x5641d1801b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ed800 0x5641d1802110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17f9790 0x5641d17fe2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1aa950 con 0x5641d17ecee0 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1abdc0 con 0x5641d17f9790 2024-09-10T22:18:38.099 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f49cc1ab020 con 0x5641d17ed800 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d632d740 10 client.0 _ll_register_callbacks cb 0x7f49bc005850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 0x5641d1801b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 0x5641d1801b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42350/0 (socket says 172.21.15.5:42350) 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 -- 172.21.15.5:0/3084680755 learned_addr learned my addr 172.21.15.5:0/3084680755 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17f9790 0x5641d17fe2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ed800 0x5641d1802110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 -- 172.21.15.5:0/3084680755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ed800 msgr2=0x5641d1802110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ed800 0x5641d1802110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 -- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17f9790 msgr2=0x5641d17fe2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17f9790 0x5641d17fe2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 -- 172.21.15.5:0/3084680755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d17f75b0 con 0x5641d17ecee0 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ed800 0x5641d1802110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:38.100 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49d14f3640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 0x5641d1801b90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f49bc02ac00 tx=0x7f49bc0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7c5be2f2fb2d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.093+0000 7f49b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49b57fa640 1 -- 172.21.15.5:0/3084680755 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc035040 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49b57fa640 1 -- 172.21.15.5:0/3084680755 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f49bc03d860 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49c8004610 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49b57fa640 1 -- 172.21.15.5:0/3084680755 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49bc031ac0 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 10 client.15795 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5641d1877090 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49b57fa640 1 -- 172.21.15.5:0/3084680755 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49c8004610 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49b57fa640 1 -- 172.21.15.5:0/3084680755 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49bc004870 con 0x5641d17ecee0 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 10 client.15795 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 20 client.15795 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.094+0000 7f49d632d740 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d18777b0 0x5641d1879bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:38.101 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.095+0000 7f49d632d740 4 client.15795 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-10T22:18:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.095+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5641d1761860 con 0x5641d18777b0 2024-09-10T22:18:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.095+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d18777b0 0x5641d1879bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.095+0000 7f49b57fa640 10 client.15795 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:38.102 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.095+0000 7f49d1cf4640 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d18777b0 0x5641d1879bd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db01fa5151c2cb server_cookie=685f84400c4aadce in_seq=0 out_seq=0 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49b57fa640 1 -- 172.21.15.5:0/3084680755 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5641d1761860 con 0x5641d18777b0 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49b57fa640 10 client.15795 handle_command_reply: tid=0 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 client.15795 shutdown 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 msgr2=0x5641d1801b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 0x5641d1801b90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f49bc02ac00 tx=0x7f49bc0095a0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 shutdown_connections 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5641d18777b0 0x5641d1879bd0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5641d17f9790 0x5641d17fe2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49b57fa640 0 client.15795 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5641d17ed800 0x5641d1802110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.103 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 --2- 172.21.15.5:0/3084680755 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5641d17ecee0 0x5641d1801b90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 >> 172.21.15.5:0/3084680755 conn(0x5641d17ead10 msgr2=0x5641d17e9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 shutdown_connections 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 1 -- 172.21.15.5:0/3084680755 wait complete. 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.097+0000 7f49d632d740 20 client.15795 trim_cache size 0 max 16384 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stdout: "return_code": 0, 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_tag": "2fa26f4a-4cae-4217-b147-84a07cb3abd9", 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": "asynchronous" 2024-09-10T22:18:38.104 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:18:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f49b80b5360 msgr2=0x7f49b80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f49b80b5360 0x7f49b80b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f49c40a8620 tx=0x7f49c40092a0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 msgr2=0x7f49cc19ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 0x7f49cc19ebf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009fd0 tx=0x7f49c400b260 comp rx=0 tx=0).stop 2024-09-10T22:18:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 shutdown_connections 2024-09-10T22:18:38.105 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f49b80b5360 0x7f49b80b7820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f49cc108020 0x7f49cc19ebf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f49cc1076a0 0x7f49cc199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 --2- 172.21.15.5:0/3904550181 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f49cc101c90 0x7f49cc199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 >> 172.21.15.5:0/3904550181 conn(0x7f49cc0fd700 msgr2=0x7f49cc06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 shutdown_connections 2024-09-10T22:18:38.106 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:38.098+0000 7f49d3f58640 1 -- 172.21.15.5:0/3904550181 wait complete. 2024-09-10T22:18:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:38 smithi189 ceph-mon[35784]: scrub queued for path: / 2024-09-10T22:18:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:38 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:38 smithi189 ceph-mon[35784]: scrub summary: active paths [/] 2024-09-10T22:18:38.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:38 smithi189 ceph-mon[35784]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:38 smithi052 ceph-mon[34997]: scrub queued for path: / 2024-09-10T22:18:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:38 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:38 smithi052 ceph-mon[34997]: scrub summary: active paths [/] 2024-09-10T22:18:38.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:38 smithi052 ceph-mon[34997]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:38.817 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:38 smithi005 ceph-mon[31115]: scrub queued for path: / 2024-09-10T22:18:38.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:38 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:38.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:38 smithi005 ceph-mon[31115]: scrub summary: active paths [/] 2024-09-10T22:18:38.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:38 smithi005 ceph-mon[31115]: scrub summary: idle+waiting paths [/] 2024-09-10T22:18:38.851 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:18:39.120 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:18:39.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:39 smithi005 ceph-mon[31115]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 20 op/s 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 -- 172.21.15.5:0/3570611922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e01087f0 msgr2=0x7f63e0108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 --2- 172.21.15.5:0/3570611922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e01087f0 0x7f63e0108c30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009900 tx=0x7f63d402a410 comp rx=0 tx=0).stop 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 -- 172.21.15.5:0/3570611922 shutdown_connections 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 --2- 172.21.15.5:0/3570611922 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e0109170 0x7f63e010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 --2- 172.21.15.5:0/3570611922 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e01087f0 0x7f63e0108c30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 --2- 172.21.15.5:0/3570611922 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 0x7f63e01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.638 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 -- 172.21.15.5:0/3570611922 >> 172.21.15.5:0/3570611922 conn(0x7f63e00fe870 msgr2=0x7f63e0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 -- 172.21.15.5:0/3570611922 shutdown_connections 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.633+0000 7f63e65d1640 1 -- 172.21.15.5:0/3570611922 wait complete. 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 Processor -- start 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 -- start start 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 0x7f63e0199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e01087f0 0x7f63e01998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 0x7f63e019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112e30 con 0x7f63e0109170 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112cb0 con 0x7f63e01087f0 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.634+0000 7f63e65d1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63e0112fb0 con 0x7f63e0102de0 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63e4b6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 0x7f63e019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63e4b6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 0x7f63e019ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42372/0 (socket says 172.21.15.5:42372) 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63e4b6e640 1 -- 172.21.15.5:0/906575301 learned_addr learned my addr 172.21.15.5:0/906575301 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:39.639 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 0x7f63e0199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63df7fe640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e01087f0 0x7f63e01998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 -- 172.21.15.5:0/906575301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e01087f0 msgr2=0x7f63e01998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e01087f0 0x7f63e01998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 -- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 msgr2=0x7f63e019ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 0x7f63e019ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 -- 172.21.15.5:0/906575301 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e019f410 con 0x7f63e0102de0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 0x7f63e019ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.635+0000 7f63dffff640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 0x7f63e0199360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d720 tx=0x7f63d000dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.636+0000 7f63dd7fa640 1 -- 172.21.15.5:0/906575301 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d0017070 con 0x7f63e0102de0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.636+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e019f700 con 0x7f63e0102de0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.636+0000 7f63dd7fa640 1 -- 172.21.15.5:0/906575301 <== mon.1 v2:172.21.15.189:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d000de30 con 0x7f63e0102de0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.636+0000 7f63dd7fa640 1 -- 172.21.15.5:0/906575301 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d00047a0 con 0x7f63e0102de0 2024-09-10T22:18:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.636+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e0075380 con 0x7f63e0102de0 2024-09-10T22:18:39.641 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.638+0000 7f63dd7fa640 1 -- 172.21.15.5:0/906575301 <== mon.1 v2:172.21.15.189:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f63d00099d0 con 0x7f63e0102de0 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 Processor -- start 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 -- start start 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4ef860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4efda0 0x55ee6f4fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4fe120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f465e50 con 0x55ee6f4ef480 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f455280 con 0x55ee6f4fbd30 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e89a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f459090 con 0x55ee6f4efda0 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e4b6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e4b6e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4ef860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42384/0 (socket says 172.21.15.5:42384) 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63e4b6e640 1 -- 172.21.15.5:0/1691100712 learned_addr learned my addr 172.21.15.5:0/1691100712 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63dffff640 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4efda0 0x55ee6f4fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63df7fe640 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4fe120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.643 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.639+0000 7f63dd7fa640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f63c80b52e0 0x7f63c80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 -- 172.21.15.5:0/1691100712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4efda0 msgr2=0x55ee6f4fb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4efda0 0x55ee6f4fb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 -- 172.21.15.5:0/1691100712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 msgr2=0x55ee6f4fe120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4fe120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 -- 172.21.15.5:0/1691100712 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6f1b3650 con 0x55ee6f4ef480 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63df7fe640 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:39.644 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f63c80b52e0 0x7f63c80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63dd7fa640 1 -- 172.21.15.5:0/906575301 <== mon.1 v2:172.21.15.189:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f63d00e57d0 con 0x7f63e0102de0 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4ef860 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f63d80118e0 tx=0x7f63d8011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928c8f2849e57d13 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63c67fc640 1 -- 172.21.15.5:0/1691100712 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8014c00 con 0x55ee6f4ef480 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63c67fc640 1 -- 172.21.15.5:0/1691100712 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d8014da0 con 0x55ee6f4ef480 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.640+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f63c80b52e0 0x7f63c80b77a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f63d8022000 tx=0x7f63d801f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.641+0000 7f63e89a6740 1 -- 172.21.15.5:0/1691100712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 msgr2=0x55ee6f4ef860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.641+0000 7f63e89a6740 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4ef860 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f63d80118e0 tx=0x7f63d8011da0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 -- 172.21.15.5:0/1691100712 shutdown_connections 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4fe120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4efda0 0x55ee6f4fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 --2- 172.21.15.5:0/1691100712 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4ef860 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 -- 172.21.15.5:0/1691100712 >> 172.21.15.5:0/1691100712 conn(0x55ee6f4ed2b0 msgr2=0x55ee6f4ee450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 -- 172.21.15.5:0/1691100712 shutdown_connections 2024-09-10T22:18:39.645 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 -- 172.21.15.5:0/1691100712 wait complete. 2024-09-10T22:18:39.646 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 -- start start 2024-09-10T22:18:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.642+0000 7f63e89a6740 1 Processor -- start 2024-09-10T22:18:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4fb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f2b6700 con 0x55ee6f4ef480 2024-09-10T22:18:39.649 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f3f0110 con 0x55ee6f4efda0 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f4fea00 con 0x55ee6f4fbd30 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e89a6740 10 client.0 _ll_register_callbacks cb 0x55ee6f409990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63dffff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4fb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:47918/0 (socket says 172.21.15.5:47918) 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 -- 172.21.15.5:0/3911379825 learned_addr learned my addr 172.21.15.5:0/3911379825 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 -- 172.21.15.5:0/3911379825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 msgr2=0x55ee6f4f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 -- 172.21.15.5:0/3911379825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 msgr2=0x55ee6f4fb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4fb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63df7fe640 1 -- 172.21.15.5:0/3911379825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6f41dc40 con 0x55ee6f4efda0 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.643+0000 7f63dffff640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:18:39.650 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63df7fe640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f89e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009900 tx=0x7f63d40314a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d5d7b55f3235ab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63bf7fe640 1 -- 172.21.15.5:0/3911379825 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4035040 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d8014da0 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63bf7fe640 1 -- 172.21.15.5:0/3911379825 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f63d4031810 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63bf7fe640 1 -- 172.21.15.5:0/3911379825 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63d4004040 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63e89a6740 10 client.25376 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee6f50a350 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.644+0000 7f63bf7fe640 1 -- 172.21.15.5:0/3911379825 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d8014da0 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63bf7fe640 1 -- 172.21.15.5:0/3911379825 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f63d4004850 con 0x55ee6f4efda0 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63e89a6740 10 client.25376 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63e89a6740 10 client.25376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63e89a6740 20 client.25376 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63e89a6740 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f50b810 0x55ee6f50dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63e89a6740 4 client.25376 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:39.651 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee6f467da0 con 0x55ee6f50b810 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63dffff640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f50b810 0x55ee6f50dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63dffff640 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f50b810 0x55ee6f50dc50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cad151a03d49d8c7 server_cookie=f03ab309fa99a771 in_seq=0 out_seq=0 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.645+0000 7f63bf7fe640 10 client.25376 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63bf7fe640 1 -- 172.21.15.5:0/3911379825 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ee6f467da0 con 0x55ee6f50b810 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63bf7fe640 10 client.25376 handle_command_reply: tid=0 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 client.25376 shutdown 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 msgr2=0x55ee6f4f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f89e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009900 tx=0x7f63d40314a0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 shutdown_connections 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f50b810 0x55ee6f50dc50 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f89e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 --2- 172.21.15.5:0/3911379825 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4ef480 0x55ee6f4fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.652 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 >> 172.21.15.5:0/3911379825 conn(0x55ee6f4ed2b0 msgr2=0x55ee6f4f2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.646+0000 7f63bf7fe640 0 client.25376 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.647+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 shutdown_connections 2024-09-10T22:18:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.647+0000 7f63e89a6740 1 -- 172.21.15.5:0/3911379825 wait complete. 2024-09-10T22:18:39.653 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.647+0000 7f63e89a6740 20 client.25376 trim_cache size 0 max 16384 2024-09-10T22:18:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 Processor -- start 2024-09-10T22:18:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 -- start start 2024-09-10T22:18:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4ef480 0x55ee6f507c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b2d30 con 0x55ee6f4efda0 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01b0600 con 0x55ee6f4fbd30 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e89a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01ae450 con 0x55ee6f4ef480 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42392/0 (socket says 172.21.15.5:42392) 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 -- 172.21.15.5:0/4240215684 learned_addr learned my addr 172.21.15.5:0/4240215684 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63dffff640 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4ef480 0x55ee6f507c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 -- 172.21.15.5:0/4240215684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4ef480 msgr2=0x55ee6f507c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4ef480 0x55ee6f507c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 -- 172.21.15.5:0/4240215684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 msgr2=0x55ee6f4f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.665+0000 7f63df7fe640 1 -- 172.21.15.5:0/4240215684 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6f4f6ee0 con 0x55ee6f4efda0 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.666+0000 7f63dffff640 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4ef480 0x55ee6f507c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.666+0000 7f63df7fe640 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f3c60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f63d402a930 tx=0x7f63d4003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b56af6842ed3d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.666+0000 7f63c5ffb640 1 -- 172.21.15.5:0/4240215684 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4035030 con 0x55ee6f4efda0 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.666+0000 7f63c5ffb640 1 -- 172.21.15.5:0/4240215684 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d4055020 con 0x55ee6f4efda0 2024-09-10T22:18:39.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.666+0000 7f63c5ffb640 1 -- 172.21.15.5:0/4240215684 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4003d60 con 0x55ee6f4efda0 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 -- 172.21.15.5:0/4240215684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 msgr2=0x55ee6f4f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f3c60 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f63d402a930 tx=0x7f63d4003780 comp rx=0 tx=0).stop 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 -- 172.21.15.5:0/4240215684 shutdown_connections 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4f3c60 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4240215684 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4ef480 0x55ee6f507c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 -- 172.21.15.5:0/4240215684 >> 172.21.15.5:0/4240215684 conn(0x55ee6f4ed2b0 msgr2=0x55ee6f4f89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 -- 172.21.15.5:0/4240215684 shutdown_connections 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 -- 172.21.15.5:0/4240215684 wait complete. 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 -- start start 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.667+0000 7f63e89a6740 1 Processor -- start 2024-09-10T22:18:39.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4ef480 0x55ee6f5041e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4ff6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01aeac0 con 0x55ee6f4efda0 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01aff30 con 0x55ee6f4ef480 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f63e01af190 con 0x55ee6f4fbd30 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e89a6740 10 client.0 _ll_register_callbacks cb 0x7f63d4032c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4ff6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4ff6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:42402/0 (socket says 172.21.15.5:42402) 2024-09-10T22:18:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 -- 172.21.15.5:0/4285449740 learned_addr learned my addr 172.21.15.5:0/4285449740 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63e4b6e640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63dffff640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4ef480 0x55ee6f5041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 -- 172.21.15.5:0/4285449740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 msgr2=0x55ee6f4ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4ffbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 -- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4ef480 msgr2=0x55ee6f5041e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4ef480 0x55ee6f5041e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 -- 172.21.15.5:0/4285449740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6f5001b0 con 0x55ee6f4efda0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63df7fe640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4ff6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f63d4004de0 tx=0x7f63d4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e983aed9e28ddaae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.668+0000 7f63bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63bf7fe640 1 -- 172.21.15.5:0/4285449740 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d4035040 con 0x55ee6f4efda0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63bf7fe640 1 -- 172.21.15.5:0/4285449740 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f63d4003cf0 con 0x55ee6f4efda0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d4055020 con 0x55ee6f4efda0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63bf7fe640 1 -- 172.21.15.5:0/4285449740 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63d40038d0 con 0x55ee6f4efda0 2024-09-10T22:18:39.676 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 10 client.15813 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ee6f5784e0 con 0x55ee6f4efda0 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63bf7fe640 1 -- 172.21.15.5:0/4285449740 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63d4055020 con 0x55ee6f4efda0 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63bf7fe640 1 -- 172.21.15.5:0/4285449740 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f63d40315a0 con 0x55ee6f4efda0 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 10 client.15813 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 10 client.15813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 20 client.15813 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f578b50 0x55ee6f57af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 4 client.15813 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.669+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ee6f463850 con 0x55ee6f578b50 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.670+0000 7f63dffff640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f578b50 0x55ee6f57af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.670+0000 7f63dffff640 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f578b50 0x55ee6f57af70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247c173c8bc355b6 server_cookie=28745cd93d268e85 in_seq=0 out_seq=0 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.670+0000 7f63bf7fe640 10 client.15813 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:39.677 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63bf7fe640 1 -- 172.21.15.5:0/4285449740 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x55ee6f463850 con 0x55ee6f578b50 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63bf7fe640 10 client.15813 handle_command_reply: tid=0 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 client.15813 shutdown 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 msgr2=0x55ee6f4ff6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4ff6b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f63d4004de0 tx=0x7f63d4005fd0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 shutdown_connections 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x55ee6f578b50 0x55ee6f57af70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55ee6f4fbd30 0x55ee6f4ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55ee6f4efda0 0x55ee6f4ff6b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 --2- 172.21.15.5:0/4285449740 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55ee6f4ef480 0x55ee6f5041e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63bf7fe640 0 client.15813 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:39.678 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 >> 172.21.15.5:0/4285449740 conn(0x55ee6f4ed2b0 msgr2=0x55ee6f4f8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 shutdown_connections 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 1 -- 172.21.15.5:0/4285449740 wait complete. 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.671+0000 7f63e89a6740 20 client.15813 trim_cache size 0 max 16384 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": { 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "2fa26f4a-4cae-4217-b147-84a07cb3abd9": { 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tag": "2fa26f4a-4cae-4217-b147-84a07cb3abd9", 2024-09-10T22:18:39.679 INFO:teuthology.orchestra.run.smithi005.stdout: "options": "recursive,force" 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "2fa26f4a-4cae-4217-b147-84a07cb3abd9": { 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:18:38.096194+0000", 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "f77c5dc5-804e-4f38-a87c-99a8b446d95b": { 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:18:25.822342+0000", 2024-09-10T22:18:39.680 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "c3f491a8-f960-4d70-807d-4784191d67d0": { 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:43.094860+0000", 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:39.681 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:18:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:18:39.682 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:18:39.683 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f63c80b52e0 msgr2=0x7f63c80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f63c80b52e0 0x7f63c80b77a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f63d8022000 tx=0x7f63d801f000 comp rx=0 tx=0).stop 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 msgr2=0x7f63e0199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 0x7f63e0199360 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63d000d720 tx=0x7f63d000dbe0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 shutdown_connections 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f63c80b52e0 0x7f63c80b77a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f63e0109170 0x7f63e019ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f63e01087f0 0x7f63e01998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 --2- 172.21.15.5:0/906575301 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f63e0102de0 0x7f63e0199360 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 >> 172.21.15.5:0/906575301 conn(0x7f63e00fe870 msgr2=0x7f63e0100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 shutdown_connections 2024-09-10T22:18:39.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:18:39.672+0000 7f63e65d1640 1 -- 172.21.15.5:0/906575301 wait complete. 2024-09-10T22:18:39.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:39 smithi189 ceph-mon[35784]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 20 op/s 2024-09-10T22:18:39.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:39 smithi052 ceph-mon[34997]: pgmap v400: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 20 op/s 2024-09-10T22:18:40.481 INFO:tasks.cephfs.filesystem:scrub status for tag:2fa26f4a-4cae-4217-b147-84a07cb3abd9 - {'path': '/', 'tag': '2fa26f4a-4cae-4217-b147-84a07cb3abd9', 'options': 'recursive,force'} 2024-09-10T22:18:41.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:41 smithi189 ceph-mon[35784]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 19 op/s 2024-09-10T22:18:41.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:41 smithi052 ceph-mon[34997]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 19 op/s 2024-09-10T22:18:41.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:41 smithi005 ceph-mon[31115]: pgmap v401: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 19 op/s 2024-09-10T22:18:42.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:42 smithi189 ceph-mon[35784]: scrub summary: idle 2024-09-10T22:18:42.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:42 smithi052 ceph-mon[34997]: scrub summary: idle 2024-09-10T22:18:42.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:42 smithi005 ceph-mon[31115]: scrub summary: idle 2024-09-10T22:18:43.696 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:43 smithi189 ceph-mon[35784]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 20 op/s 2024-09-10T22:18:43.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:43 smithi052 ceph-mon[34997]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 20 op/s 2024-09-10T22:18:43.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:43 smithi005 ceph-mon[31115]: pgmap v402: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 20 MiB/s wr, 20 op/s 2024-09-10T22:18:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 -- 172.21.15.5:0/484068230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 msgr2=0x7fa7ec075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 --2- 172.21.15.5:0/484068230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec075560 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009900 tx=0x7fa7dc02a410 comp rx=0 tx=0).stop 2024-09-10T22:18:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 -- 172.21.15.5:0/484068230 shutdown_connections 2024-09-10T22:18:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 --2- 172.21.15.5:0/484068230 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec10a930 0x7fa7ec10cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.412 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 --2- 172.21.15.5:0/484068230 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7ec075aa0 0x7fa7ec075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 --2- 172.21.15.5:0/484068230 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec075560 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 -- 172.21.15.5:0/484068230 >> 172.21.15.5:0/484068230 conn(0x7fa7ec0fe250 msgr2=0x7fa7ec100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 -- 172.21.15.5:0/484068230 shutdown_connections 2024-09-10T22:18:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.410+0000 7fa7f15df640 1 -- 172.21.15.5:0/484068230 wait complete. 2024-09-10T22:18:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 Processor -- start 2024-09-10T22:18:45.413 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 -- start start 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7ec075aa0 0x7fa7ec19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec10a930 0x7fa7ec19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec110850 con 0x7fa7ec076f10 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1106d0 con 0x7fa7ec10a930 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7f15df640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1109d0 con 0x7fa7ec075aa0 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.411+0000 7fa7ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39932/0 (socket says 172.21.15.5:39932) 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/772874040 learned_addr learned my addr 172.21.15.5:0/772874040 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:45.415 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7ec075aa0 0x7fa7ec19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec10a930 0x7fa7ec19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/772874040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7ec075aa0 msgr2=0x7fa7ec19b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7ec075aa0 0x7fa7ec19b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/772874040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec10a930 msgr2=0x7fa7ec19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec10a930 0x7fa7ec19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/772874040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ec19cb70 con 0x7fa7ec076f10 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec19b680 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000e9f0 tx=0x7fa7e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7d3fff640 1 -- 172.21.15.5:0/772874040 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000cd80 con 0x7fa7ec076f10 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ec19ce60 con 0x7fa7ec076f10 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7d3fff640 1 -- 172.21.15.5:0/772874040 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7e00054d0 con 0x7fa7ec076f10 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7d3fff640 1 -- 172.21.15.5:0/772874040 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0010690 con 0x7fa7ec076f10 2024-09-10T22:18:45.416 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.412+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ec1a3530 con 0x7fa7ec076f10 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 Processor -- start 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 -- start start 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7d3fff640 1 -- 172.21.15.5:0/772874040 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fa7e0004e90 con 0x7fa7ec076f10 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 0x563cbd6acc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563cbd61c6f0 con 0x563cbd6aa860 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563cbd60bb20 con 0x563cbd6afbd0 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7f448e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563cbd60f930 con 0x563cbd6ad190 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 0x563cbd6acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 0x563cbd6acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39940/0 (socket says 172.21.15.5:39940) 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.415+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/1121935271 learned_addr learned my addr 172.21.15.5:0/1121935271 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:45.423 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/1121935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 msgr2=0x563cbd6af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/1121935271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 msgr2=0x563cbd6b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/1121935271 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd5d1530 con 0x563cbd6aa860 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 0x563cbd6acc50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009f90 tx=0x7fa7e40118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4082e5a3215a12e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7d3fff640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7d40b52e0 0x7fa7d40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7d17fa640 1 -- 172.21.15.5:0/1121935271 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4004d20 con 0x563cbd6aa860 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7d40b52e0 0x7fa7d40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7d17fa640 1 -- 172.21.15.5:0/1121935271 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7e4004050 con 0x563cbd6aa860 2024-09-10T22:18:45.424 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7d17fa640 1 -- 172.21.15.5:0/1121935271 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4005260 con 0x563cbd6aa860 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.416+0000 7fa7d3fff640 1 -- 172.21.15.5:0/772874040 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fa7e00e5fb0 con 0x7fa7ec076f10 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7d40b52e0 0x7fa7d40b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc031500 tx=0x7fa7dc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 -- 172.21.15.5:0/1121935271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 msgr2=0x563cbd6acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 0x563cbd6acc50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009f90 tx=0x7fa7e40118d0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 -- 172.21.15.5:0/1121935271 shutdown_connections 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 --2- 172.21.15.5:0/1121935271 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6aa860 0x563cbd6acc50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 -- 172.21.15.5:0/1121935271 >> 172.21.15.5:0/1121935271 conn(0x563cbd6a59b0 msgr2=0x563cbd6a6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 -- 172.21.15.5:0/1121935271 shutdown_connections 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.417+0000 7fa7f448e740 1 -- 172.21.15.5:0/1121935271 wait complete. 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 -- start start 2024-09-10T22:18:45.425 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 Processor -- start 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6b4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x563cbd543ab0 con 0x563cbd6ad190 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x563cbd5b1730 con 0x563cbd6afbd0 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x563cbd6b2bb0 con 0x563cbd6aa860 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7f448e740 10 client.0 _ll_register_callbacks cb 0x563cbd6056b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39946/0 (socket says 172.21.15.5:39946) 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2989930721 learned_addr learned my addr 172.21.15.5:0/2989930721 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:45.426 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2989930721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 msgr2=0x563cbd6b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 msgr2=0x563cbd6b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.418+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2989930721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cbd36d790 con 0x563cbd6ad190 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6b4530 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c6a0 tx=0x7fa7e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7372549de05b0e56 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2989930721 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00abf10 con 0x563cbd6ad190 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2989930721 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fa7e00b58a0 con 0x563cbd6ad190 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e4004050 con 0x563cbd6ad190 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2989930721 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7e00e82d0 con 0x563cbd6ad190 2024-09-10T22:18:45.427 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 10 client.15825 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563cbd3e6620 con 0x563cbd6ad190 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2989930721 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7e4004050 con 0x563cbd6ad190 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2989930721 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7e00a80f0 con 0x563cbd6ad190 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 10 client.15825 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 20 client.15825 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd6bf740 0x563cbd6c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 4 client.15825 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.419+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563cbd61e640 con 0x563cbd6bf740 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.420+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd6bf740 0x563cbd6c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.420+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd6bf740 0x563cbd6c1b30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f49340080c9c5d server_cookie=ade95d43b0313f97 in_seq=0 out_seq=0 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.420+0000 7fa7ceff5640 10 client.15825 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2989930721 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563cbd61e640 con 0x563cbd6bf740 2024-09-10T22:18:45.428 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7ceff5640 10 client.15825 handle_command_reply: tid=0 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 client.15825 shutdown 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 msgr2=0x563cbd6b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6b4530 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000c6a0 tx=0x7fa7e00048f0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 shutdown_connections 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd6bf740 0x563cbd6c1b30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7ceff5640 0 client.15825 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6b4530 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2989930721 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 >> 172.21.15.5:0/2989930721 conn(0x563cbd6a59b0 msgr2=0x563cbd6a4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 shutdown_connections 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 1 -- 172.21.15.5:0/2989930721 wait complete. 2024-09-10T22:18:45.429 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.421+0000 7fa7f448e740 20 client.15825 trim_cache size 0 max 16384 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 Processor -- start 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 -- start start 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6aa860 0x563cbd6a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1ae9b0 con 0x563cbd6afbd0 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1ac280 con 0x563cbd6aa860 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7f448e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1aa0f0 con 0x563cbd6ad190 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7eb7fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39952/0 (socket says 172.21.15.5:39952) 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.436+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/40388574 learned_addr learned my addr 172.21.15.5:0/40388574 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:45.439 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6aa860 0x563cbd6a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/40388574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 msgr2=0x563cbd6a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/40388574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6aa860 msgr2=0x563cbd6a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6aa860 0x563cbd6a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eb7fe640 1 -- 172.21.15.5:0/40388574 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cbd6b5470 con 0x563cbd6afbd0 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6aa860 0x563cbd6a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2fb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4011dd0 tx=0x7fa7e4003c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30477edb8a95b2c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7d0ff9640 1 -- 172.21.15.5:0/40388574 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4005040 con 0x563cbd6afbd0 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7d0ff9640 1 -- 172.21.15.5:0/40388574 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7e4005690 con 0x563cbd6afbd0 2024-09-10T22:18:45.440 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.437+0000 7fa7d0ff9640 1 -- 172.21.15.5:0/40388574 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400fc00 con 0x563cbd6afbd0 2024-09-10T22:18:45.443 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 -- 172.21.15.5:0/40388574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 msgr2=0x563cbd6b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2fb0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4011dd0 tx=0x7fa7e4003c70 comp rx=0 tx=0).stop 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 -- 172.21.15.5:0/40388574 shutdown_connections 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6afbd0 0x563cbd6b2fb0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6ad190 0x563cbd6a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 --2- 172.21.15.5:0/40388574 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6aa860 0x563cbd6a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 -- 172.21.15.5:0/40388574 >> 172.21.15.5:0/40388574 conn(0x563cbd6a59b0 msgr2=0x563cbd6a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 -- 172.21.15.5:0/40388574 shutdown_connections 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 -- 172.21.15.5:0/40388574 wait complete. 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 -- start start 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.438+0000 7fa7f448e740 1 Processor -- start 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6bb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6bbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.444 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6ba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1aa740 con 0x563cbd6ad190 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1abbb0 con 0x563cbd6afbd0 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ec1aae10 con 0x563cbd6aa860 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7f448e740 10 client.0 _ll_register_callbacks cb 0x7fa7e000e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6bbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6bbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39960/0 (socket says 172.21.15.5:39960) 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2011410522 learned_addr learned my addr 172.21.15.5:0/2011410522 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7eb7fe640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6ba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2011410522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 msgr2=0x563cbd6bb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6bb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 msgr2=0x563cbd6ba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:18:45.445 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6ba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 -- 172.21.15.5:0/2011410522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cbd6ba9f0 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ea7fc640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6bbb20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00a84c0 tx=0x7fa7e00e93d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b2b0f89436ac51 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ceff5640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.439+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2011410522 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00ac570 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2011410522 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fa7e00aba00 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7e4005690 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2011410522 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa7e0005680 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 10 client.15831 fetch_fsmap learned FSMap version 25 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563cbd6b9880 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2011410522 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7e4005690 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2011410522 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa7e00adad0 con 0x563cbd6ad190 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 10 client.15831 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-10T22:18:45.446 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 20 client.15831 populate_metadata read hostname 'smithi005' 2024-09-10T22:18:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd72cb30 0x563cbd72ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:18:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 4 client.15831 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-10T22:18:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563cbd61a0f0 con 0x563cbd72cb30 2024-09-10T22:18:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.440+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd72cb30 0x563cbd72ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:18:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.441+0000 7fa7eaffd640 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd72cb30 0x563cbd72ef50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fde15f3136dfaf5d server_cookie=b701300881ef04dd in_seq=0 out_seq=0 2024-09-10T22:18:45.447 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.441+0000 7fa7ceff5640 10 client.15831 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7ceff5640 1 -- 172.21.15.5:0/2011410522 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563cbd61a0f0 con 0x563cbd72cb30 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7ceff5640 10 client.15831 handle_command_reply: tid=0 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 client.15831 shutdown 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 msgr2=0x563cbd6bbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6bbb20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa7e00a84c0 tx=0x7fa7e00e93d0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 shutdown_connections 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x563cbd72cb30 0x563cbd72ef50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x563cbd6afbd0 0x563cbd6ba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.453 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7ceff5640 0 client.15831 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x563cbd6ad190 0x563cbd6bbb20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 --2- 172.21.15.5:0/2011410522 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x563cbd6aa860 0x563cbd6bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 >> 172.21.15.5:0/2011410522 conn(0x563cbd6a59b0 msgr2=0x563cbd6a9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 shutdown_connections 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 1 -- 172.21.15.5:0/2011410522 wait complete. 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.451+0000 7fa7f448e740 20 client.15831 trim_cache size 0 max 16384 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:{ 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "message": "", 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout: "return_code": 0 2024-09-10T22:18:45.454 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stdout:} 2024-09-10T22:18:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7d40b52e0 msgr2=0x7fa7d40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7d40b52e0 0x7fa7d40b77a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc031500 tx=0x7fa7dc005a20 comp rx=0 tx=0).stop 2024-09-10T22:18:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 msgr2=0x7fa7ec19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:18:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec19b680 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000e9f0 tx=0x7fa7e000edf0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 shutdown_connections 2024-09-10T22:18:45.455 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fa7d40b52e0 0x7fa7d40b77a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fa7ec10a930 0x7fa7ec19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fa7ec076f10 0x7fa7ec19b680 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 --2- 172.21.15.5:0/772874040 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fa7ec075aa0 0x7fa7ec19b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:18:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 >> 172.21.15.5:0/772874040 conn(0x7fa7ec0fe250 msgr2=0x7fa7ec106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:18:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 shutdown_connections 2024-09-10T22:18:45.456 INFO:teuthology.task.background_exec.ubuntu@smithi005.front.sepia.ceph.com.smithi005.stderr:2024-09-10T22:18:45.452+0000 7fa7f15df640 1 -- 172.21.15.5:0/772874040 wait complete. 2024-09-10T22:18:45.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:45 smithi189 ceph-mon[35784]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 16 op/s 2024-09-10T22:18:45.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:45 smithi052 ceph-mon[34997]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 16 op/s 2024-09-10T22:18:45.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:45 smithi005 ceph-mon[31115]: pgmap v403: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 16 op/s 2024-09-10T22:18:47.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:47 smithi052 ceph-mon[34997]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-10T22:18:47.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:47 smithi005 ceph-mon[31115]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-10T22:18:47.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:47 smithi189 ceph-mon[35784]: pgmap v404: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 16 op/s 2024-09-10T22:18:49.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:49 smithi052 ceph-mon[34997]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-09-10T22:18:49.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:49 smithi005 ceph-mon[31115]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-09-10T22:18:49.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:49 smithi189 ceph-mon[35784]: pgmap v405: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-09-10T22:18:51.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:51 smithi052 ceph-mon[34997]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:51.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:51 smithi005 ceph-mon[31115]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:51 smithi189 ceph-mon[35784]: pgmap v406: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:53.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:53 smithi052 ceph-mon[34997]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 864 KiB/s wr, 14 op/s 2024-09-10T22:18:53.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:53 smithi005 ceph-mon[31115]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 864 KiB/s wr, 14 op/s 2024-09-10T22:18:53.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:53 smithi189 ceph-mon[35784]: pgmap v407: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 864 KiB/s wr, 14 op/s 2024-09-10T22:18:55.551 INFO:tasks.workunit.client.0.smithi005.stdout:setting up random write file 2024-09-10T22:18:55.551 INFO:tasks.workunit.client.0.smithi005.stdout:done setting up random write file 2024-09-10T22:18:55.551 INFO:tasks.workunit.client.0.smithi005.stdout:starting fsync run 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0076s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0055s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-10T22:18:55.552 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0051s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0053s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0039s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-10T22:18:55.553 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0064s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0047s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0050s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-10T22:18:55.554 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0063s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0064s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0043s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0046s 2024-09-10T22:18:55.555 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0050s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0582s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0048s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0044s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0045s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0048s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0054s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0052s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-10T22:18:55.556 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0049s 2024-09-10T22:18:55.557 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0003s fsync time: 0.0047s 2024-09-10T22:18:55.557 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0042s 2024-09-10T22:18:55.557 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0047s 2024-09-10T22:18:55.557 INFO:tasks.workunit.client.0.smithi005.stdout:write time: 0.0002s fsync time: 0.0044s 2024-09-10T22:18:55.557 INFO:tasks.workunit.client.0.smithi005.stdout:run done 61 fsyncs total, killing random writer 2024-09-10T22:18:55.557 INFO:tasks.workunit.client.0.smithi005.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T22:18:55.558 INFO:tasks.workunit.client.0.smithi005.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-10T22:18:55.558 INFO:tasks.workunit.client.0.smithi005.stderr:+ whereis lsof 2024-09-10T22:18:55.581 INFO:tasks.workunit.client.0.smithi005.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2024-09-10T22:18:55.581 INFO:tasks.workunit.client.0.smithi005.stderr:+ lsof 2024-09-10T22:18:55.594 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/02505279aef4aac421e48ca82618038a2c184fdc480f209b684c7ddeb91f17c3/merged 2024-09-10T22:18:55.594 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.595 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/7e13c462e016ba03062af080ce830dc9082bebc46f73360b167de13216e70ea7/merged 2024-09-10T22:18:55.595 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.595 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/86fa65c513c742208d99108333f93d558a995184625394fb6f8b87a14cae67f3/merged 2024-09-10T22:18:55.595 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.600 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/5d323e5f47a606bdb00a07be381aa559232974642e894e4fbffa466381bfd671/merged 2024-09-10T22:18:55.600 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.600 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/e94144235efda654656eb9a7644b7b4541e217ca0ae74b11dee9911b9b15a511/merged 2024-09-10T22:18:55.600 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/64c5429cd62f4b64a1e0351c6d28d0c4e477c3ec0fdc1b72fb78ca41dbe84e7f/merged 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/91e2111ef2b6e6faf75c4d78d95dc27245ba5846e42811bb17d4a027d6182695/merged 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/503bf7f363e8dbf0fc26eb5585b15683ddabdf267aff04cf0c6775e291b26a92/merged 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/55544b7ebff7baf72b558e44805d8c71cdd1bacc1739f77619396cedf39660e4/merged 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr:lsof: WARNING: can't stat() overlay file system /var/lib/containers/storage/overlay/e40dfb6705c1f842634d55d0472419686cfff06f3bce3404e7c8ded9e32ed511/merged 2024-09-10T22:18:55.601 INFO:tasks.workunit.client.0.smithi005.stderr: Output information may be incomplete. 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2024-09-10T22:18:55.654 INFO:tasks.workunit.client.0.smithi005.stdout:pool_work 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:pool_work 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:pool_work 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:pool_work 3 root NOFD /proc/3/fd (opendir: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 4 root NOFD /proc/4/fd (opendir: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 5 root cwd unknown /proc/5/cwd (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 5 root rtd unknown /proc/5/root (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 5 root txt unknown /proc/5/exe (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 5 root NOFD /proc/5/fd (opendir: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2024-09-10T22:18:55.655 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 6 root NOFD /proc/6/fd (opendir: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 7 root cwd unknown /proc/7/cwd (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 7 root rtd unknown /proc/7/root (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 7 root txt unknown /proc/7/exe (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 7 root NOFD /proc/7/fd (opendir: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 9 root NOFD /proc/9/fd (opendir: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2024-09-10T22:18:55.656 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 11 root NOFD /proc/11/fd (opendir: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 13 root NOFD /proc/13/fd (opendir: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 14 root NOFD /proc/14/fd (opendir: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_tasks 15 root NOFD /proc/15/fd (opendir: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2024-09-10T22:18:55.657 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 16 root NOFD /proc/16/fd (opendir: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:pr/ttyS1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:pr/ttyS1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:pr/ttyS1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:pr/ttyS1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_preem 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_preem 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_preem 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:rcu_preem 18 root NOFD /proc/18/fd (opendir: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2024-09-10T22:18:55.658 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 20 root NOFD /proc/20/fd (opendir: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 21 root cwd unknown /proc/21/cwd (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 21 root rtd unknown /proc/21/root (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 21 root txt unknown /proc/21/exe (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 21 root NOFD /proc/21/fd (opendir: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/0 22 root NOFD /proc/22/fd (opendir: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2024-09-10T22:18:55.659 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/1 23 root NOFD /proc/23/fd (opendir: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 24 root NOFD /proc/24/fd (opendir: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2024-09-10T22:18:55.660 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 28 root NOFD /proc/28/fd (opendir: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/2 29 root NOFD /proc/29/fd (opendir: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 30 root NOFD /proc/30/fd (opendir: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2024-09-10T22:18:55.661 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 34 root NOFD /proc/34/fd (opendir: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/3 35 root NOFD /proc/35/fd (opendir: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 36 root NOFD /proc/36/fd (opendir: Permission denied) 2024-09-10T22:18:55.662 INFO:tasks.workunit.client.0.smithi005.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 40 root NOFD /proc/40/fd (opendir: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2024-09-10T22:18:55.663 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/4 41 root NOFD /proc/41/fd (opendir: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 42 root NOFD /proc/42/fd (opendir: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2024-09-10T22:18:55.664 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 46 root NOFD /proc/46/fd (opendir: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/5 47 root NOFD /proc/47/fd (opendir: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 48 root NOFD /proc/48/fd (opendir: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2024-09-10T22:18:55.665 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 52 root NOFD /proc/52/fd (opendir: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/6 53 root NOFD /proc/53/fd (opendir: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 54 root NOFD /proc/54/fd (opendir: Permission denied) 2024-09-10T22:18:55.666 INFO:tasks.workunit.client.0.smithi005.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 58 root NOFD /proc/58/fd (opendir: Permission denied) 2024-09-10T22:18:55.667 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 59 root cwd unknown /proc/59/cwd (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 59 root rtd unknown /proc/59/root (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 59 root txt unknown /proc/59/exe (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:cpuhp/7 59 root NOFD /proc/59/fd (opendir: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 60 root cwd unknown /proc/60/cwd (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 60 root rtd unknown /proc/60/root (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 60 root txt unknown /proc/60/exe (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:idle_inje 60 root NOFD /proc/60/fd (opendir: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:migration 61 root cwd unknown /proc/61/cwd (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:migration 61 root rtd unknown /proc/61/root (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:migration 61 root txt unknown /proc/61/exe (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:migration 61 root NOFD /proc/61/fd (opendir: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 62 root cwd unknown /proc/62/cwd (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 62 root rtd unknown /proc/62/root (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 62 root txt unknown /proc/62/exe (readlink: Permission denied) 2024-09-10T22:18:55.668 INFO:tasks.workunit.client.0.smithi005.stdout:ksoftirqd 62 root NOFD /proc/62/fd (opendir: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 64 root cwd unknown /proc/64/cwd (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 64 root rtd unknown /proc/64/root (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 64 root txt unknown /proc/64/exe (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 64 root NOFD /proc/64/fd (opendir: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 66 root NOFD /proc/66/fd (opendir: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 67 root NOFD /proc/67/fd (opendir: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2024-09-10T22:18:55.669 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 70 root NOFD /proc/70/fd (opendir: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kdevtmpfs 72 root NOFD /proc/72/fd (opendir: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 73 root NOFD /proc/73/fd (opendir: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2024-09-10T22:18:55.670 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:kauditd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 75 root NOFD /proc/75/fd (opendir: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:khungtask 76 root NOFD /proc/76/fd (opendir: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:oom_reape 77 root NOFD /proc/77/fd (opendir: Permission denied) 2024-09-10T22:18:55.671 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 78 root NOFD /proc/78/fd (opendir: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:kcompactd 79 root NOFD /proc/79/fd (opendir: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:ksmd 80 root NOFD /proc/80/fd (opendir: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2024-09-10T22:18:55.672 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:khugepage 82 root NOFD /proc/82/fd (opendir: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 83 root NOFD /proc/83/fd (opendir: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84 root NOFD /proc/84/fd (opendir: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 85 root NOFD /proc/85/fd (opendir: Permission denied) 2024-09-10T22:18:55.673 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 86 root cwd unknown /proc/86/cwd (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 86 root rtd unknown /proc/86/root (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 86 root txt unknown /proc/86/exe (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 86 root NOFD /proc/86/fd (opendir: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 87 root cwd unknown /proc/87/cwd (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 87 root rtd unknown /proc/87/root (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 87 root txt unknown /proc/87/exe (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 87 root NOFD /proc/87/fd (opendir: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 88 root cwd unknown /proc/88/cwd (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 88 root rtd unknown /proc/88/root (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 88 root txt unknown /proc/88/exe (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 88 root NOFD /proc/88/fd (opendir: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 89 root cwd unknown /proc/89/cwd (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 89 root rtd unknown /proc/89/root (readlink: Permission denied) 2024-09-10T22:18:55.674 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 89 root txt unknown /proc/89/exe (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 89 root NOFD /proc/89/fd (opendir: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 90 root cwd unknown /proc/90/cwd (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 90 root rtd unknown /proc/90/root (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 90 root txt unknown /proc/90/exe (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 90 root NOFD /proc/90/fd (opendir: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:watchdogd 91 root NOFD /proc/91/fd (opendir: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 93 root cwd unknown /proc/93/cwd (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 93 root rtd unknown /proc/93/root (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 93 root txt unknown /proc/93/exe (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 93 root NOFD /proc/93/fd (opendir: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 95 root cwd unknown /proc/95/cwd (readlink: Permission denied) 2024-09-10T22:18:55.675 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 95 root rtd unknown /proc/95/root (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 95 root txt unknown /proc/95/exe (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kswapd0 95 root NOFD /proc/95/fd (opendir: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 101 root cwd unknown /proc/101/cwd (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 101 root rtd unknown /proc/101/root (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 101 root txt unknown /proc/101/exe (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 101 root NOFD /proc/101/fd (opendir: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 111 root cwd unknown /proc/111/cwd (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 111 root rtd unknown /proc/111/root (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 111 root txt unknown /proc/111/exe (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 111 root NOFD /proc/111/fd (opendir: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 112 root cwd unknown /proc/112/cwd (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 112 root rtd unknown /proc/112/root (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 112 root txt unknown /proc/112/exe (readlink: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 112 root NOFD /proc/112/fd (opendir: Permission denied) 2024-09-10T22:18:55.676 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 113 root cwd unknown /proc/113/cwd (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 113 root rtd unknown /proc/113/root (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 113 root txt unknown /proc/113/exe (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 113 root NOFD /proc/113/fd (opendir: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 116 root cwd unknown /proc/116/cwd (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 116 root rtd unknown /proc/116/root (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 116 root txt unknown /proc/116/exe (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 116 root NOFD /proc/116/fd (opendir: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 117 root cwd unknown /proc/117/cwd (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 117 root rtd unknown /proc/117/root (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 117 root txt unknown /proc/117/exe (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 117 root NOFD /proc/117/fd (opendir: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 118 root cwd unknown /proc/118/cwd (readlink: Permission denied) 2024-09-10T22:18:55.677 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 118 root rtd unknown /proc/118/root (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 118 root txt unknown /proc/118/exe (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 118 root NOFD /proc/118/fd (opendir: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 127 root cwd unknown /proc/127/cwd (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 127 root rtd unknown /proc/127/root (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 127 root txt unknown /proc/127/exe (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 127 root NOFD /proc/127/fd (opendir: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 239 root cwd unknown /proc/239/cwd (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 239 root rtd unknown /proc/239/root (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 239 root txt unknown /proc/239/exe (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 239 root NOFD /proc/239/fd (opendir: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 240 root cwd unknown /proc/240/cwd (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 240 root rtd unknown /proc/240/root (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 240 root txt unknown /proc/240/exe (readlink: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 240 root NOFD /proc/240/fd (opendir: Permission denied) 2024-09-10T22:18:55.678 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 242 root cwd unknown /proc/242/cwd (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 242 root rtd unknown /proc/242/root (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 242 root txt unknown /proc/242/exe (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 242 root NOFD /proc/242/fd (opendir: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 280 root cwd unknown /proc/280/cwd (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 280 root rtd unknown /proc/280/root (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 280 root txt unknown /proc/280/exe (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 280 root NOFD /proc/280/fd (opendir: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 282 root cwd unknown /proc/282/cwd (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 282 root rtd unknown /proc/282/root (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 282 root txt unknown /proc/282/exe (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 282 root NOFD /proc/282/fd (opendir: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 285 root cwd unknown /proc/285/cwd (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 285 root rtd unknown /proc/285/root (readlink: Permission denied) 2024-09-10T22:18:55.679 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 285 root txt unknown /proc/285/exe (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 285 root NOFD /proc/285/fd (opendir: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 287 root cwd unknown /proc/287/cwd (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 287 root rtd unknown /proc/287/root (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 287 root txt unknown /proc/287/exe (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 287 root NOFD /proc/287/fd (opendir: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 427 root cwd unknown /proc/427/cwd (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 427 root rtd unknown /proc/427/root (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 427 root txt unknown /proc/427/exe (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 427 root NOFD /proc/427/fd (opendir: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 435 root cwd unknown /proc/435/cwd (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 435 root rtd unknown /proc/435/root (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 435 root txt unknown /proc/435/exe (readlink: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 435 root NOFD /proc/435/fd (opendir: Permission denied) 2024-09-10T22:18:55.680 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 438 root cwd unknown /proc/438/cwd (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 438 root rtd unknown /proc/438/root (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 438 root txt unknown /proc/438/exe (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 438 root NOFD /proc/438/fd (opendir: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 440 root cwd unknown /proc/440/cwd (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 440 root rtd unknown /proc/440/root (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 440 root txt unknown /proc/440/exe (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 440 root NOFD /proc/440/fd (opendir: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 441 root cwd unknown /proc/441/cwd (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 441 root rtd unknown /proc/441/root (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 441 root txt unknown /proc/441/exe (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 441 root NOFD /proc/441/fd (opendir: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 442 root cwd unknown /proc/442/cwd (readlink: Permission denied) 2024-09-10T22:18:55.681 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 442 root rtd unknown /proc/442/root (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 442 root txt unknown /proc/442/exe (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 442 root NOFD /proc/442/fd (opendir: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 450 root cwd unknown /proc/450/cwd (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 450 root rtd unknown /proc/450/root (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 450 root txt unknown /proc/450/exe (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_0 450 root NOFD /proc/450/fd (opendir: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 451 root cwd unknown /proc/451/cwd (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 451 root rtd unknown /proc/451/root (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 451 root txt unknown /proc/451/exe (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 451 root NOFD /proc/451/fd (opendir: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 452 root cwd unknown /proc/452/cwd (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 452 root rtd unknown /proc/452/root (readlink: Permission denied) 2024-09-10T22:18:55.682 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 452 root txt unknown /proc/452/exe (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_1 452 root NOFD /proc/452/fd (opendir: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 453 root cwd unknown /proc/453/cwd (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 453 root rtd unknown /proc/453/root (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 453 root txt unknown /proc/453/exe (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 453 root NOFD /proc/453/fd (opendir: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_2 454 root NOFD /proc/454/fd (opendir: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 455 root cwd unknown /proc/455/cwd (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 455 root rtd unknown /proc/455/root (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 455 root txt unknown /proc/455/exe (readlink: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 455 root NOFD /proc/455/fd (opendir: Permission denied) 2024-09-10T22:18:55.683 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 456 root cwd unknown /proc/456/cwd (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 456 root rtd unknown /proc/456/root (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 456 root txt unknown /proc/456/exe (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_3 456 root NOFD /proc/456/fd (opendir: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 457 root cwd unknown /proc/457/cwd (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 457 root rtd unknown /proc/457/root (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 457 root txt unknown /proc/457/exe (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 457 root NOFD /proc/457/fd (opendir: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 458 root cwd unknown /proc/458/cwd (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 458 root rtd unknown /proc/458/root (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 458 root txt unknown /proc/458/exe (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_4 458 root NOFD /proc/458/fd (opendir: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 459 root cwd unknown /proc/459/cwd (readlink: Permission denied) 2024-09-10T22:18:55.684 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 459 root rtd unknown /proc/459/root (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 459 root txt unknown /proc/459/exe (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 459 root NOFD /proc/459/fd (opendir: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 460 root cwd unknown /proc/460/cwd (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 460 root rtd unknown /proc/460/root (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 460 root txt unknown /proc/460/exe (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_5 460 root NOFD /proc/460/fd (opendir: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 461 root cwd unknown /proc/461/cwd (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 461 root rtd unknown /proc/461/root (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 461 root txt unknown /proc/461/exe (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 461 root NOFD /proc/461/fd (opendir: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 462 root cwd unknown /proc/462/cwd (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 462 root rtd unknown /proc/462/root (readlink: Permission denied) 2024-09-10T22:18:55.685 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 462 root txt unknown /proc/462/exe (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_6 462 root NOFD /proc/462/fd (opendir: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 463 root cwd unknown /proc/463/cwd (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 463 root rtd unknown /proc/463/root (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 463 root txt unknown /proc/463/exe (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 463 root NOFD /proc/463/fd (opendir: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_7 464 root NOFD /proc/464/fd (opendir: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 465 root cwd unknown /proc/465/cwd (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 465 root rtd unknown /proc/465/root (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 465 root txt unknown /proc/465/exe (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 465 root NOFD /proc/465/fd (opendir: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 466 root cwd unknown /proc/466/cwd (readlink: Permission denied) 2024-09-10T22:18:55.686 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 466 root rtd unknown /proc/466/root (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 466 root txt unknown /proc/466/exe (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_8 466 root NOFD /proc/466/fd (opendir: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 467 root cwd unknown /proc/467/cwd (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 467 root rtd unknown /proc/467/root (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 467 root txt unknown /proc/467/exe (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 467 root NOFD /proc/467/fd (opendir: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 468 root cwd unknown /proc/468/cwd (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 468 root rtd unknown /proc/468/root (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 468 root txt unknown /proc/468/exe (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:scsi_eh_9 468 root NOFD /proc/468/fd (opendir: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 469 root cwd unknown /proc/469/cwd (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 469 root rtd unknown /proc/469/root (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 469 root txt unknown /proc/469/exe (readlink: Permission denied) 2024-09-10T22:18:55.687 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 469 root NOFD /proc/469/fd (opendir: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 471 root cwd unknown /proc/471/cwd (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 471 root rtd unknown /proc/471/root (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 471 root txt unknown /proc/471/exe (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 471 root NOFD /proc/471/fd (opendir: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 497 root cwd unknown /proc/497/cwd (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 497 root rtd unknown /proc/497/root (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 497 root txt unknown /proc/497/exe (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:jbd2/sda1 497 root NOFD /proc/497/fd (opendir: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 498 root cwd unknown /proc/498/cwd (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 498 root rtd unknown /proc/498/root (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 498 root txt unknown /proc/498/exe (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 498 root NOFD /proc/498/fd (opendir: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 574 root cwd unknown /proc/574/cwd (readlink: Permission denied) 2024-09-10T22:18:55.688 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 574 root rtd unknown /proc/574/root (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 574 root txt unknown /proc/574/exe (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-j 574 root NOFD /proc/574/fd (opendir: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 580 root cwd unknown /proc/580/cwd (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 580 root rtd unknown /proc/580/root (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 580 root txt unknown /proc/580/exe (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:ext4lazyi 580 root NOFD /proc/580/fd (opendir: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 589 root cwd unknown /proc/589/cwd (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 589 root rtd unknown /proc/589/root (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 589 root txt unknown /proc/589/exe (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-u 589 root NOFD /proc/589/fd (opendir: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 639 root cwd unknown /proc/639/cwd (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 639 root rtd unknown /proc/639/root (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 639 root txt unknown /proc/639/exe (readlink: Permission denied) 2024-09-10T22:18:55.689 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 639 root NOFD /proc/639/fd (opendir: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 647 root cwd unknown /proc/647/cwd (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 647 root rtd unknown /proc/647/root (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 647 root txt unknown /proc/647/exe (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:kipmi0 647 root NOFD /proc/647/fd (opendir: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 658 rpc cwd unknown /proc/658/cwd (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 658 rpc rtd unknown /proc/658/root (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 658 rpc txt unknown /proc/658/exe (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:rpcbind 658 rpc NOFD /proc/658/fd (opendir: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 root cwd unknown /proc/665/cwd (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 root rtd unknown /proc/665/root (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 root txt unknown /proc/665/exe (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 root NOFD /proc/665/fd (opendir: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 666 auditd root cwd unknown /proc/665/task/666/cwd (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 666 auditd root rtd unknown /proc/665/task/666/root (readlink: Permission denied) 2024-09-10T22:18:55.690 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 666 auditd root txt unknown /proc/665/task/666/exe (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 666 auditd root NOFD /proc/665/task/666/fd (opendir: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 668 auditd root cwd unknown /proc/665/task/668/cwd (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 668 auditd root rtd unknown /proc/665/task/668/root (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 668 auditd root txt unknown /proc/665/task/668/exe (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:auditd 665 668 auditd root NOFD /proc/665/task/668/fd (opendir: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 667 root cwd unknown /proc/667/cwd (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 667 root rtd unknown /proc/667/root (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 667 root txt unknown /proc/667/exe (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:sedispatc 667 root NOFD /proc/667/fd (opendir: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 675 root NOFD /proc/675/fd (opendir: Permission denied) 2024-09-10T22:18:55.691 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 676 root cwd unknown /proc/676/cwd (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 676 root rtd unknown /proc/676/root (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 676 root txt unknown /proc/676/exe (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 676 root NOFD /proc/676/fd (opendir: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 715 dbus cwd unknown /proc/715/cwd (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 715 dbus rtd unknown /proc/715/root (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 715 dbus txt unknown /proc/715/exe (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 715 dbus NOFD /proc/715/fd (opendir: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 716 dbus cwd unknown /proc/716/cwd (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 716 dbus rtd unknown /proc/716/root (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 716 dbus txt unknown /proc/716/exe (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:dbus-brok 716 dbus NOFD /proc/716/fd (opendir: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 root cwd unknown /proc/717/cwd (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 root rtd unknown /proc/717/root (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 root txt unknown /proc/717/exe (readlink: Permission denied) 2024-09-10T22:18:55.692 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 root NOFD /proc/717/fd (opendir: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 734 gmain root cwd unknown /proc/717/task/734/cwd (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 734 gmain root rtd unknown /proc/717/task/734/root (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 734 gmain root txt unknown /proc/717/task/734/exe (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 734 gmain root NOFD /proc/717/task/734/fd (opendir: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 735 gdbus root cwd unknown /proc/717/task/735/cwd (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 735 gdbus root rtd unknown /proc/717/task/735/root (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 735 gdbus root txt unknown /proc/717/task/735/exe (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:NetworkMa 717 735 gdbus root NOFD /proc/717/task/735/fd (opendir: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 root cwd unknown /proc/720/cwd (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 root rtd unknown /proc/720/root (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 root txt unknown /proc/720/exe (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 root NOFD /proc/720/fd (opendir: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 727 gmain root cwd unknown /proc/720/task/727/cwd (readlink: Permission denied) 2024-09-10T22:18:55.693 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 727 gmain root rtd unknown /proc/720/task/727/root (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 727 gmain root txt unknown /proc/720/task/727/exe (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:irqbalanc 720 727 gmain root NOFD /proc/720/task/727/fd (opendir: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 721 libstoragemgmt cwd unknown /proc/721/cwd (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 721 libstoragemgmt rtd unknown /proc/721/root (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 721 libstoragemgmt txt unknown /proc/721/exe (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:lsmd 721 libstoragemgmt NOFD /proc/721/fd (opendir: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 722 root cwd unknown /proc/722/cwd (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 722 root rtd unknown /proc/722/root (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 722 root txt unknown /proc/722/exe (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:mcelog 722 root NOFD /proc/722/fd (opendir: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 723 root cwd unknown /proc/723/cwd (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 723 root rtd unknown /proc/723/root (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 723 root txt unknown /proc/723/exe (readlink: Permission denied) 2024-09-10T22:18:55.694 INFO:tasks.workunit.client.0.smithi005.stdout:smartd 723 root NOFD /proc/723/fd (opendir: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 725 root cwd unknown /proc/725/cwd (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 725 root rtd unknown /proc/725/root (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 725 root txt unknown /proc/725/exe (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:systemd-l 725 root NOFD /proc/725/fd (opendir: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 788 root cwd unknown /proc/788/cwd (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 788 root rtd unknown /proc/788/root (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 788 root txt unknown /proc/788/exe (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 788 root NOFD /proc/788/fd (opendir: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 root cwd unknown /proc/792/cwd (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 root rtd unknown /proc/792/root (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 root txt unknown /proc/792/exe (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 root NOFD /proc/792/fd (opendir: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 793 gssproxy root cwd unknown /proc/792/task/793/cwd (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 793 gssproxy root rtd unknown /proc/792/task/793/root (readlink: Permission denied) 2024-09-10T22:18:55.695 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 793 gssproxy root txt unknown /proc/792/task/793/exe (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 793 gssproxy root NOFD /proc/792/task/793/fd (opendir: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 794 gssproxy root cwd unknown /proc/792/task/794/cwd (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 794 gssproxy root rtd unknown /proc/792/task/794/root (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 794 gssproxy root txt unknown /proc/792/task/794/exe (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 794 gssproxy root NOFD /proc/792/task/794/fd (opendir: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 795 gssproxy root cwd unknown /proc/792/task/795/cwd (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 795 gssproxy root rtd unknown /proc/792/task/795/root (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 795 gssproxy root txt unknown /proc/792/task/795/exe (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 795 gssproxy root NOFD /proc/792/task/795/fd (opendir: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 796 gssproxy root cwd unknown /proc/792/task/796/cwd (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 796 gssproxy root rtd unknown /proc/792/task/796/root (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 796 gssproxy root txt unknown /proc/792/task/796/exe (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 796 gssproxy root NOFD /proc/792/task/796/fd (opendir: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 797 gssproxy root cwd unknown /proc/792/task/797/cwd (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 797 gssproxy root rtd unknown /proc/792/task/797/root (readlink: Permission denied) 2024-09-10T22:18:55.696 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 797 gssproxy root txt unknown /proc/792/task/797/exe (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:gssproxy 792 797 gssproxy root NOFD /proc/792/task/797/fd (opendir: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:atd 799 root cwd unknown /proc/799/cwd (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:atd 799 root rtd unknown /proc/799/root (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:atd 799 root txt unknown /proc/799/exe (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:atd 799 root NOFD /proc/799/fd (opendir: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:crond 800 root cwd unknown /proc/800/cwd (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:crond 800 root rtd unknown /proc/800/root (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:crond 800 root txt unknown /proc/800/exe (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:crond 800 root NOFD /proc/800/fd (opendir: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 826 nrpe cwd unknown /proc/826/cwd (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 826 nrpe rtd unknown /proc/826/root (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 826 nrpe txt unknown /proc/826/exe (readlink: Permission denied) 2024-09-10T22:18:55.697 INFO:tasks.workunit.client.0.smithi005.stdout:nrpe 826 nrpe NOFD /proc/826/fd (opendir: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1205 root cwd unknown /proc/1205/cwd (readlink: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1205 root rtd unknown /proc/1205/root (readlink: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1205 root txt unknown /proc/1205/exe (readlink: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1205 root NOFD /proc/1205/fd (opendir: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1207 root cwd unknown /proc/1207/cwd (readlink: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1207 root rtd unknown /proc/1207/root (readlink: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1207 root txt unknown /proc/1207/exe (readlink: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:agetty 1207 root NOFD /proc/1207/fd (opendir: Permission denied) 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu cwd DIR 8,1 4096 2 / 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu txt REG 8,1 98208 22394 /usr/lib/systemd/systemd 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 21219 2231 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 600667 655 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 44784 11373 /usr/lib64/libffi.so.8.1.0 2024-09-10T22:18:55.698 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 153600 11397 /usr/lib64/libgpg-error.so.0.32.0 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 912440 11215 /usr/lib64/libm.so.6 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 178728 11282 /usr/lib64/liblzma.so.5.2.5 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 1714208 11376 /usr/lib64/libp11-kit.so.0.3.1 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu DEL REG 8,1 11595 /usr/lib64/libcrypto.so.3.2.2 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 28552 11392 /usr/lib64/libattr.so.1.1.2501 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 882376 11287 /usr/lib64/libzstd.so.1.5.1 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 32528 11311 /usr/lib64/libcap-ng.so.0.0.0 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 40520 12544 /usr/lib64/libeconf.so.0.4.1 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 144120 11455 /usr/lib64/liblz4.so.1.9.3 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 1304864 11471 /usr/lib64/libgcrypt.so.20.4.0 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 201808 11284 /usr/lib64/libcrypt.so.2.0.0 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 291496 11744 /usr/lib64/libmount.so.1.1.0 2024-09-10T22:18:55.699 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 3826840 50305 /usr/lib64/systemd/libsystemd-shared-252.so 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 229424 11714 /usr/lib64/libblkid.so.1.1.0 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 2162040 50302 /usr/lib64/systemd/libsystemd-core-252.so 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 36296 11290 /usr/lib64/libcap.so.2.48 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 40496 11393 /usr/lib64/libacl.so.1.1.2301 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 107528 11768 /usr/lib64/libkmod.so.2.3.6 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 163464 11315 /usr/lib64/libaudit.so.1.0.0 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 69592 12553 /usr/lib64/libpam.so.0.85.1 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 127680 11560 /usr/lib64/libseccomp.so.2.5.2 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 108136 14698 /usr/lib64/libgcc_s-11-20240719.so.1 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 1u unix 0x0000000000000000 0t0 26771 type=STREAM (CONNECTED) 2024-09-10T22:18:55.700 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 2u unix 0x0000000000000000 0t0 26771 type=STREAM (CONNECTED) 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 3u unix 0x0000000000000000 0t0 26799 type=DGRAM (CONNECTED) 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 4u a_inode 0,14 0 2081 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 5u a_inode 0,14 0 2081 [signalfd] 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 6r a_inode 0,14 0 2081 inotify 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 7r DIR 0,25 0 3417 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 8u a_inode 0,14 0 2081 [timerfd] 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 9u a_inode 0,14 0 2081 [eventpoll:10,13] 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 10r REG 0,20 0 26788 /proc/4849/mountinfo 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 11r a_inode 0,14 0 2081 inotify 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 12u unix 0x0000000000000000 0t0 26827 /run/user/1000/bus type=STREAM (LISTEN) 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 13r a_inode 0,14 0 2081 inotify 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 14r REG 0,20 0 4026532068 /proc/swaps 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 15u netlink 0t0 26809 KOBJECT_UEVENT 2024-09-10T22:18:55.701 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 16u unix 0x0000000000000000 0t0 26814 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 17u unix 0x0000000000000000 0t0 26815 type=DGRAM (CONNECTED) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 18u unix 0x0000000000000000 0t0 26816 type=DGRAM (CONNECTED) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 19u unix 0x0000000000000000 0t0 26817 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 20u unix 0x0000000000000000 0t0 26819 type=STREAM (CONNECTED) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 4849 ubuntu 21u a_inode 0,14 0 2081 [timerfd] 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 4851 ubuntu cwd unknown /proc/4851/cwd (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 4851 ubuntu rtd unknown /proc/4851/root (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 4851 ubuntu txt unknown /proc/4851/exe (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 4851 ubuntu NOFD /proc/4851/fd (opendir: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 root cwd unknown /proc/5095/cwd (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 root rtd unknown /proc/5095/root (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 root txt unknown /proc/5095/exe (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 root NOFD /proc/5095/fd (opendir: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5097 in:imjour root cwd unknown /proc/5095/task/5097/cwd (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5097 in:imjour root rtd unknown /proc/5095/task/5097/root (readlink: Permission denied) 2024-09-10T22:18:55.702 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5097 in:imjour root txt unknown /proc/5095/task/5097/exe (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5097 in:imjour root NOFD /proc/5095/task/5097/fd (opendir: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5098 rs:main root cwd unknown /proc/5095/task/5098/cwd (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5098 rs:main root rtd unknown /proc/5095/task/5098/root (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5098 rs:main root txt unknown /proc/5095/task/5098/exe (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:rsyslogd 5095 5098 rs:main root NOFD /proc/5095/task/5098/fd (opendir: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:anacron 13320 root cwd unknown /proc/13320/cwd (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:anacron 13320 root rtd unknown /proc/13320/root (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:anacron 13320 root txt unknown /proc/13320/exe (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:anacron 13320 root NOFD /proc/13320/fd (opendir: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 18279 root cwd unknown /proc/18279/cwd (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 18279 root rtd unknown /proc/18279/root (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 18279 root txt unknown /proc/18279/exe (readlink: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 18279 root NOFD /proc/18279/fd (opendir: Permission denied) 2024-09-10T22:18:55.703 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 18616 root cwd unknown /proc/18616/cwd (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 18616 root rtd unknown /proc/18616/root (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 18616 root txt unknown /proc/18616/exe (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 18616 root NOFD /proc/18616/fd (opendir: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 polkitd cwd unknown /proc/19179/cwd (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 polkitd rtd unknown /proc/19179/root (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 polkitd txt unknown /proc/19179/exe (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 polkitd NOFD /proc/19179/fd (opendir: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19181 gmain polkitd cwd unknown /proc/19179/task/19181/cwd (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19181 gmain polkitd rtd unknown /proc/19179/task/19181/root (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19181 gmain polkitd txt unknown /proc/19179/task/19181/exe (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19181 gmain polkitd NOFD /proc/19179/task/19181/fd (opendir: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19182 gdbus polkitd cwd unknown /proc/19179/task/19182/cwd (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19182 gdbus polkitd rtd unknown /proc/19179/task/19182/root (readlink: Permission denied) 2024-09-10T22:18:55.704 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19182 gdbus polkitd txt unknown /proc/19179/task/19182/exe (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19182 gdbus polkitd NOFD /proc/19179/task/19182/fd (opendir: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19183 JS\x20Hel polkitd cwd unknown /proc/19179/task/19183/cwd (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19183 JS\x20Hel polkitd rtd unknown /proc/19179/task/19183/root (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19183 JS\x20Hel polkitd txt unknown /proc/19179/task/19183/exe (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19183 JS\x20Hel polkitd NOFD /proc/19179/task/19183/fd (opendir: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19184 JS\x20Hel polkitd cwd unknown /proc/19179/task/19184/cwd (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19184 JS\x20Hel polkitd rtd unknown /proc/19179/task/19184/root (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19184 JS\x20Hel polkitd txt unknown /proc/19179/task/19184/exe (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19184 JS\x20Hel polkitd NOFD /proc/19179/task/19184/fd (opendir: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19185 JS\x20Hel polkitd cwd unknown /proc/19179/task/19185/cwd (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19185 JS\x20Hel polkitd rtd unknown /proc/19179/task/19185/root (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19185 JS\x20Hel polkitd txt unknown /proc/19179/task/19185/exe (readlink: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19185 JS\x20Hel polkitd NOFD /proc/19179/task/19185/fd (opendir: Permission denied) 2024-09-10T22:18:55.705 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19186 JS\x20Hel polkitd cwd unknown /proc/19179/task/19186/cwd (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19186 JS\x20Hel polkitd rtd unknown /proc/19179/task/19186/root (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19186 JS\x20Hel polkitd txt unknown /proc/19179/task/19186/exe (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19186 JS\x20Hel polkitd NOFD /proc/19179/task/19186/fd (opendir: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19187 JS\x20Hel polkitd cwd unknown /proc/19179/task/19187/cwd (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19187 JS\x20Hel polkitd rtd unknown /proc/19179/task/19187/root (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19187 JS\x20Hel polkitd txt unknown /proc/19179/task/19187/exe (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19187 JS\x20Hel polkitd NOFD /proc/19179/task/19187/fd (opendir: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19188 JS\x20Hel polkitd cwd unknown /proc/19179/task/19188/cwd (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19188 JS\x20Hel polkitd rtd unknown /proc/19179/task/19188/root (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19188 JS\x20Hel polkitd txt unknown /proc/19179/task/19188/exe (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19188 JS\x20Hel polkitd NOFD /proc/19179/task/19188/fd (opendir: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19189 JS\x20Hel polkitd cwd unknown /proc/19179/task/19189/cwd (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19189 JS\x20Hel polkitd rtd unknown /proc/19179/task/19189/root (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19189 JS\x20Hel polkitd txt unknown /proc/19179/task/19189/exe (readlink: Permission denied) 2024-09-10T22:18:55.706 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19189 JS\x20Hel polkitd NOFD /proc/19179/task/19189/fd (opendir: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19190 JS\x20Hel polkitd cwd unknown /proc/19179/task/19190/cwd (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19190 JS\x20Hel polkitd rtd unknown /proc/19179/task/19190/root (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19190 JS\x20Hel polkitd txt unknown /proc/19179/task/19190/exe (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19190 JS\x20Hel polkitd NOFD /proc/19179/task/19190/fd (opendir: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19191 polkitd polkitd cwd unknown /proc/19179/task/19191/cwd (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19191 polkitd polkitd rtd unknown /proc/19179/task/19191/root (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19191 polkitd polkitd txt unknown /proc/19179/task/19191/exe (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:polkitd 19179 19191 polkitd polkitd NOFD /proc/19179/task/19191/fd (opendir: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21086 root cwd unknown /proc/21086/cwd (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21086 root rtd unknown /proc/21086/root (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21086 root txt unknown /proc/21086/exe (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21086 root NOFD /proc/21086/fd (opendir: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21115 root cwd unknown /proc/21115/cwd (readlink: Permission denied) 2024-09-10T22:18:55.707 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21115 root rtd unknown /proc/21115/root (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21115 root txt unknown /proc/21115/exe (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21115 root NOFD /proc/21115/fd (opendir: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21144 root cwd unknown /proc/21144/cwd (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21144 root rtd unknown /proc/21144/root (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21144 root txt unknown /proc/21144/exe (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21144 root NOFD /proc/21144/fd (opendir: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21173 root cwd unknown /proc/21173/cwd (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21173 root rtd unknown /proc/21173/root (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21173 root txt unknown /proc/21173/exe (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21173 root NOFD /proc/21173/fd (opendir: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21202 root cwd unknown /proc/21202/cwd (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21202 root rtd unknown /proc/21202/root (readlink: Permission denied) 2024-09-10T22:18:55.708 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21202 root txt unknown /proc/21202/exe (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21202 root NOFD /proc/21202/fd (opendir: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21366 root cwd unknown /proc/21366/cwd (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21366 root rtd unknown /proc/21366/root (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21366 root txt unknown /proc/21366/exe (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21366 root NOFD /proc/21366/fd (opendir: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21367 root cwd unknown /proc/21367/cwd (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21367 root rtd unknown /proc/21367/root (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21367 root txt unknown /proc/21367/exe (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21367 root NOFD /proc/21367/fd (opendir: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21368 root cwd unknown /proc/21368/cwd (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21368 root rtd unknown /proc/21368/root (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21368 root txt unknown /proc/21368/exe (readlink: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21368 root NOFD /proc/21368/fd (opendir: Permission denied) 2024-09-10T22:18:55.709 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21369 root cwd unknown /proc/21369/cwd (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21369 root rtd unknown /proc/21369/root (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21369 root txt unknown /proc/21369/exe (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21369 root NOFD /proc/21369/fd (opendir: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21370 root cwd unknown /proc/21370/cwd (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21370 root rtd unknown /proc/21370/root (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21370 root txt unknown /proc/21370/exe (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21370 root NOFD /proc/21370/fd (opendir: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21371 root cwd unknown /proc/21371/cwd (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21371 root rtd unknown /proc/21371/root (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21371 root txt unknown /proc/21371/exe (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21371 root NOFD /proc/21371/fd (opendir: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21372 root cwd unknown /proc/21372/cwd (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21372 root rtd unknown /proc/21372/root (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21372 root txt unknown /proc/21372/exe (readlink: Permission denied) 2024-09-10T22:18:55.710 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21372 root NOFD /proc/21372/fd (opendir: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21373 root cwd unknown /proc/21373/cwd (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21373 root rtd unknown /proc/21373/root (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21373 root txt unknown /proc/21373/exe (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21373 root NOFD /proc/21373/fd (opendir: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21374 root cwd unknown /proc/21374/cwd (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21374 root rtd unknown /proc/21374/root (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21374 root txt unknown /proc/21374/exe (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 21374 root NOFD /proc/21374/fd (opendir: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 21375 root cwd unknown /proc/21375/cwd (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 21375 root rtd unknown /proc/21375/root (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 21375 root txt unknown /proc/21375/exe (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:xfsaild/d 21375 root NOFD /proc/21375/fd (opendir: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22307 root cwd unknown /proc/22307/cwd (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22307 root rtd unknown /proc/22307/root (readlink: Permission denied) 2024-09-10T22:18:55.711 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22307 root txt unknown /proc/22307/exe (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22307 root NOFD /proc/22307/fd (opendir: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22310 ubuntu cwd unknown /proc/22310/cwd (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22310 ubuntu rtd unknown /proc/22310/root (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22310 ubuntu txt unknown /proc/22310/exe (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 22310 ubuntu NOFD /proc/22310/fd (opendir: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 22370 chrony cwd unknown /proc/22370/cwd (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 22370 chrony rtd unknown /proc/22370/root (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 22370 chrony txt unknown /proc/22370/exe (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:chronyd 22370 chrony NOFD /proc/22370/fd (opendir: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 22672 root cwd unknown /proc/22672/cwd (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 22672 root rtd unknown /proc/22672/root (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 22672 root txt unknown /proc/22672/exe (readlink: Permission denied) 2024-09-10T22:18:55.712 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 22672 root NOFD /proc/22672/fd (opendir: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 22680 ceph cwd unknown /proc/22680/cwd (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 22680 ceph rtd unknown /proc/22680/root (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 22680 ceph txt unknown /proc/22680/exe (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-cras 22680 ceph NOFD /proc/22680/fd (opendir: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23205 root cwd unknown /proc/23205/cwd (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23205 root rtd unknown /proc/23205/root (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23205 root txt unknown /proc/23205/exe (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 23205 root NOFD /proc/23205/fd (opendir: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24387 root cwd unknown /proc/24387/cwd (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24387 root rtd unknown /proc/24387/root (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24387 root txt unknown /proc/24387/exe (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24387 root NOFD /proc/24387/fd (opendir: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24388 root cwd unknown /proc/24388/cwd (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24388 root rtd unknown /proc/24388/root (readlink: Permission denied) 2024-09-10T22:18:55.713 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24388 root txt unknown /proc/24388/exe (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24388 root NOFD /proc/24388/fd (opendir: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24389 root cwd unknown /proc/24389/cwd (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24389 root rtd unknown /proc/24389/root (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24389 root txt unknown /proc/24389/exe (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 24389 root NOFD /proc/24389/fd (opendir: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 24590 root cwd unknown /proc/24590/cwd (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 24590 root rtd unknown /proc/24590/root (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 24590 root txt unknown /proc/24590/exe (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 24590 root NOFD /proc/24590/fd (opendir: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 29711 root cwd unknown /proc/29711/cwd (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 29711 root rtd unknown /proc/29711/root (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 29711 root txt unknown /proc/29711/exe (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 29711 root NOFD /proc/29711/fd (opendir: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 30057 root cwd unknown /proc/30057/cwd (readlink: Permission denied) 2024-09-10T22:18:55.714 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 30057 root rtd unknown /proc/30057/root (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 30057 root txt unknown /proc/30057/exe (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 30057 root NOFD /proc/30057/fd (opendir: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30110 root cwd unknown /proc/30110/cwd (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30110 root rtd unknown /proc/30110/root (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30110 root txt unknown /proc/30110/exe (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30110 root NOFD /proc/30110/fd (opendir: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30127 root cwd unknown /proc/30127/cwd (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30127 root rtd unknown /proc/30127/root (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30127 root txt unknown /proc/30127/exe (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30127 root NOFD /proc/30127/fd (opendir: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30128 root cwd unknown /proc/30128/cwd (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30128 root rtd unknown /proc/30128/root (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30128 root txt unknown /proc/30128/exe (readlink: Permission denied) 2024-09-10T22:18:55.715 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 30128 root NOFD /proc/30128/fd (opendir: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30145 root cwd unknown /proc/30145/cwd (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30145 root rtd unknown /proc/30145/root (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30145 root txt unknown /proc/30145/exe (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 30145 root NOFD /proc/30145/fd (opendir: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 30412 root cwd unknown /proc/30412/cwd (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 30412 root rtd unknown /proc/30412/root (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 30412 root txt unknown /proc/30412/exe (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 30412 root NOFD /proc/30412/fd (opendir: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 30444 root cwd unknown /proc/30444/cwd (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 30444 root rtd unknown /proc/30444/root (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 30444 root txt unknown /proc/30444/exe (readlink: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 30444 root NOFD /proc/30444/fd (opendir: Permission denied) 2024-09-10T22:18:55.716 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31111 root cwd unknown /proc/31111/cwd (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31111 root rtd unknown /proc/31111/root (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31111 root txt unknown /proc/31111/exe (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31111 root NOFD /proc/31111/fd (opendir: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31113 root cwd unknown /proc/31113/cwd (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31113 root rtd unknown /proc/31113/root (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31113 root txt unknown /proc/31113/exe (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31113 root NOFD /proc/31113/fd (opendir: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 ceph cwd unknown /proc/31115/cwd (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 ceph rtd unknown /proc/31115/root (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 ceph txt unknown /proc/31115/exe (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 ceph NOFD /proc/31115/fd (opendir: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31116 log ceph cwd unknown /proc/31115/task/31116/cwd (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31116 log ceph rtd unknown /proc/31115/task/31116/root (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31116 log ceph txt unknown /proc/31115/task/31116/exe (readlink: Permission denied) 2024-09-10T22:18:55.717 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31116 log ceph NOFD /proc/31115/task/31116/fd (opendir: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31117 service ceph cwd unknown /proc/31115/task/31117/cwd (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31117 service ceph rtd unknown /proc/31115/task/31117/root (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31117 service ceph txt unknown /proc/31115/task/31117/exe (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31117 service ceph NOFD /proc/31115/task/31117/fd (opendir: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31118 admin_soc ceph cwd unknown /proc/31115/task/31118/cwd (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31118 admin_soc ceph rtd unknown /proc/31115/task/31118/root (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31118 admin_soc ceph txt unknown /proc/31115/task/31118/exe (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31118 admin_soc ceph NOFD /proc/31115/task/31118/fd (opendir: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31119 signal_ha ceph cwd unknown /proc/31115/task/31119/cwd (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31119 signal_ha ceph rtd unknown /proc/31115/task/31119/root (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31119 signal_ha ceph txt unknown /proc/31115/task/31119/exe (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31119 signal_ha ceph NOFD /proc/31115/task/31119/fd (opendir: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31120 rocksdb:l ceph cwd unknown /proc/31115/task/31120/cwd (readlink: Permission denied) 2024-09-10T22:18:55.718 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31120 rocksdb:l ceph rtd unknown /proc/31115/task/31120/root (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31120 rocksdb:l ceph txt unknown /proc/31115/task/31120/exe (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31120 rocksdb:l ceph NOFD /proc/31115/task/31120/fd (opendir: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31121 rocksdb:h ceph cwd unknown /proc/31115/task/31121/cwd (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31121 rocksdb:h ceph rtd unknown /proc/31115/task/31121/root (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31121 rocksdb:h ceph txt unknown /proc/31115/task/31121/exe (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31121 rocksdb:h ceph NOFD /proc/31115/task/31121/fd (opendir: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31137 ceph-mon ceph cwd unknown /proc/31115/task/31137/cwd (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31137 ceph-mon ceph rtd unknown /proc/31115/task/31137/root (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31137 ceph-mon ceph txt unknown /proc/31115/task/31137/exe (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31137 ceph-mon ceph NOFD /proc/31115/task/31137/fd (opendir: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31138 fn_monsto ceph cwd unknown /proc/31115/task/31138/cwd (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31138 fn_monsto ceph rtd unknown /proc/31115/task/31138/root (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31138 fn_monsto ceph txt unknown /proc/31115/task/31138/exe (readlink: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31138 fn_monsto ceph NOFD /proc/31115/task/31138/fd (opendir: Permission denied) 2024-09-10T22:18:55.719 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31139 msgr-work ceph cwd unknown /proc/31115/task/31139/cwd (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31139 msgr-work ceph rtd unknown /proc/31115/task/31139/root (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31139 msgr-work ceph txt unknown /proc/31115/task/31139/exe (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31139 msgr-work ceph NOFD /proc/31115/task/31139/fd (opendir: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31140 msgr-work ceph cwd unknown /proc/31115/task/31140/cwd (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31140 msgr-work ceph rtd unknown /proc/31115/task/31140/root (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31140 msgr-work ceph txt unknown /proc/31115/task/31140/exe (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31140 msgr-work ceph NOFD /proc/31115/task/31140/fd (opendir: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31141 msgr-work ceph cwd unknown /proc/31115/task/31141/cwd (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31141 msgr-work ceph rtd unknown /proc/31115/task/31141/root (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31141 msgr-work ceph txt unknown /proc/31115/task/31141/exe (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31141 msgr-work ceph NOFD /proc/31115/task/31141/fd (opendir: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31142 OpHistory ceph cwd unknown /proc/31115/task/31142/cwd (readlink: Permission denied) 2024-09-10T22:18:55.720 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31142 OpHistory ceph rtd unknown /proc/31115/task/31142/root (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31142 OpHistory ceph txt unknown /proc/31115/task/31142/exe (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31142 OpHistory ceph NOFD /proc/31115/task/31142/fd (opendir: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31143 fin ceph cwd unknown /proc/31115/task/31143/cwd (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31143 fin ceph rtd unknown /proc/31115/task/31143/root (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31143 fin ceph txt unknown /proc/31115/task/31143/exe (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31143 fin ceph NOFD /proc/31115/task/31143/fd (opendir: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31144 safe_time ceph cwd unknown /proc/31115/task/31144/cwd (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31144 safe_time ceph rtd unknown /proc/31115/task/31144/root (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31144 safe_time ceph txt unknown /proc/31115/task/31144/exe (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31144 safe_time ceph NOFD /proc/31115/task/31144/fd (opendir: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31145 cpu_tp ceph cwd unknown /proc/31115/task/31145/cwd (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31145 cpu_tp ceph rtd unknown /proc/31115/task/31145/root (readlink: Permission denied) 2024-09-10T22:18:55.721 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31145 cpu_tp ceph txt unknown /proc/31115/task/31145/exe (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31145 cpu_tp ceph NOFD /proc/31115/task/31145/fd (opendir: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31146 cpu_tp ceph cwd unknown /proc/31115/task/31146/cwd (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31146 cpu_tp ceph rtd unknown /proc/31115/task/31146/root (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31146 cpu_tp ceph txt unknown /proc/31115/task/31146/exe (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31146 cpu_tp ceph NOFD /proc/31115/task/31146/fd (opendir: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31147 cpu_tp ceph cwd unknown /proc/31115/task/31147/cwd (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31147 cpu_tp ceph rtd unknown /proc/31115/task/31147/root (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31147 cpu_tp ceph txt unknown /proc/31115/task/31147/exe (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31147 cpu_tp ceph NOFD /proc/31115/task/31147/fd (opendir: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31148 cpu_tp ceph cwd unknown /proc/31115/task/31148/cwd (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31148 cpu_tp ceph rtd unknown /proc/31115/task/31148/root (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31148 cpu_tp ceph txt unknown /proc/31115/task/31148/exe (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31148 cpu_tp ceph NOFD /proc/31115/task/31148/fd (opendir: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31149 ms_dispat ceph cwd unknown /proc/31115/task/31149/cwd (readlink: Permission denied) 2024-09-10T22:18:55.722 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31149 ms_dispat ceph rtd unknown /proc/31115/task/31149/root (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31149 ms_dispat ceph txt unknown /proc/31115/task/31149/exe (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31149 ms_dispat ceph NOFD /proc/31115/task/31149/fd (opendir: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31150 ms_local ceph cwd unknown /proc/31115/task/31150/cwd (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31150 ms_local ceph rtd unknown /proc/31115/task/31150/root (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31150 ms_local ceph txt unknown /proc/31115/task/31150/exe (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31150 ms_local ceph NOFD /proc/31115/task/31150/fd (opendir: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31151 safe_time ceph cwd unknown /proc/31115/task/31151/cwd (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31151 safe_time ceph rtd unknown /proc/31115/task/31151/root (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31151 safe_time ceph txt unknown /proc/31115/task/31151/exe (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31151 safe_time ceph NOFD /proc/31115/task/31151/fd (opendir: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31152 ms_dispat ceph cwd unknown /proc/31115/task/31152/cwd (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31152 ms_dispat ceph rtd unknown /proc/31115/task/31152/root (readlink: Permission denied) 2024-09-10T22:18:55.723 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31152 ms_dispat ceph txt unknown /proc/31115/task/31152/exe (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31152 ms_dispat ceph NOFD /proc/31115/task/31152/fd (opendir: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31153 ms_local ceph cwd unknown /proc/31115/task/31153/cwd (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31153 ms_local ceph rtd unknown /proc/31115/task/31153/root (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31153 ms_local ceph txt unknown /proc/31115/task/31153/exe (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 31153 ms_local ceph NOFD /proc/31115/task/31153/fd (opendir: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 71432 rstore_co ceph cwd unknown /proc/31115/task/71432/cwd (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 71432 rstore_co ceph rtd unknown /proc/31115/task/71432/root (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 71432 rstore_co ceph txt unknown /proc/31115/task/71432/exe (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mon 31115 71432 rstore_co ceph NOFD /proc/31115/task/71432/fd (opendir: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31343 root cwd unknown /proc/31343/cwd (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31343 root rtd unknown /proc/31343/root (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31343 root txt unknown /proc/31343/exe (readlink: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 31343 root NOFD /proc/31343/fd (opendir: Permission denied) 2024-09-10T22:18:55.724 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31345 root cwd unknown /proc/31345/cwd (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31345 root rtd unknown /proc/31345/root (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31345 root txt unknown /proc/31345/exe (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 31345 root NOFD /proc/31345/fd (opendir: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 ceph cwd unknown /proc/31347/cwd (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 ceph rtd unknown /proc/31347/root (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 ceph txt unknown /proc/31347/exe (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 ceph NOFD /proc/31347/fd (opendir: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33685 log ceph cwd unknown /proc/31347/task/33685/cwd (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33685 log ceph rtd unknown /proc/31347/task/33685/root (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33685 log ceph txt unknown /proc/31347/task/33685/exe (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33685 log ceph NOFD /proc/31347/task/33685/fd (opendir: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33687 msgr-work ceph cwd unknown /proc/31347/task/33687/cwd (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33687 msgr-work ceph rtd unknown /proc/31347/task/33687/root (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33687 msgr-work ceph txt unknown /proc/31347/task/33687/exe (readlink: Permission denied) 2024-09-10T22:18:55.725 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33687 msgr-work ceph NOFD /proc/31347/task/33687/fd (opendir: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33688 msgr-work ceph cwd unknown /proc/31347/task/33688/cwd (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33688 msgr-work ceph rtd unknown /proc/31347/task/33688/root (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33688 msgr-work ceph txt unknown /proc/31347/task/33688/exe (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33688 msgr-work ceph NOFD /proc/31347/task/33688/fd (opendir: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33689 msgr-work ceph cwd unknown /proc/31347/task/33689/cwd (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33689 msgr-work ceph rtd unknown /proc/31347/task/33689/root (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33689 msgr-work ceph txt unknown /proc/31347/task/33689/exe (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33689 msgr-work ceph NOFD /proc/31347/task/33689/fd (opendir: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33693 service ceph cwd unknown /proc/31347/task/33693/cwd (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33693 service ceph rtd unknown /proc/31347/task/33693/root (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33693 service ceph txt unknown /proc/31347/task/33693/exe (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33693 service ceph NOFD /proc/31347/task/33693/fd (opendir: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33694 admin_soc ceph cwd unknown /proc/31347/task/33694/cwd (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33694 admin_soc ceph rtd unknown /proc/31347/task/33694/root (readlink: Permission denied) 2024-09-10T22:18:55.726 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33694 admin_soc ceph txt unknown /proc/31347/task/33694/exe (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33694 admin_soc ceph NOFD /proc/31347/task/33694/fd (opendir: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33695 ceph_time ceph cwd unknown /proc/31347/task/33695/cwd (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33695 ceph_time ceph rtd unknown /proc/31347/task/33695/root (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33695 ceph_time ceph txt unknown /proc/31347/task/33695/exe (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33695 ceph_time ceph NOFD /proc/31347/task/33695/fd (opendir: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33696 fn_anonym ceph cwd unknown /proc/31347/task/33696/cwd (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33696 fn_anonym ceph rtd unknown /proc/31347/task/33696/root (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33696 fn_anonym ceph txt unknown /proc/31347/task/33696/exe (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33696 fn_anonym ceph NOFD /proc/31347/task/33696/fd (opendir: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33697 signal_ha ceph cwd unknown /proc/31347/task/33697/cwd (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33697 signal_ha ceph rtd unknown /proc/31347/task/33697/root (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33697 signal_ha ceph txt unknown /proc/31347/task/33697/exe (readlink: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33697 signal_ha ceph NOFD /proc/31347/task/33697/fd (opendir: Permission denied) 2024-09-10T22:18:55.727 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33698 mgrsb-fin ceph cwd unknown /proc/31347/task/33698/cwd (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33698 mgrsb-fin ceph rtd unknown /proc/31347/task/33698/root (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33698 mgrsb-fin ceph txt unknown /proc/31347/task/33698/exe (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33698 mgrsb-fin ceph NOFD /proc/31347/task/33698/fd (opendir: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33699 ms_dispat ceph cwd unknown /proc/31347/task/33699/cwd (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33699 ms_dispat ceph rtd unknown /proc/31347/task/33699/root (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33699 ms_dispat ceph txt unknown /proc/31347/task/33699/exe (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33699 ms_dispat ceph NOFD /proc/31347/task/33699/fd (opendir: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33700 ms_local ceph cwd unknown /proc/31347/task/33700/cwd (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33700 ms_local ceph rtd unknown /proc/31347/task/33700/root (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33700 ms_local ceph txt unknown /proc/31347/task/33700/exe (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33700 ms_local ceph NOFD /proc/31347/task/33700/fd (opendir: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33701 io_contex ceph cwd unknown /proc/31347/task/33701/cwd (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33701 io_contex ceph rtd unknown /proc/31347/task/33701/root (readlink: Permission denied) 2024-09-10T22:18:55.728 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33701 io_contex ceph txt unknown /proc/31347/task/33701/exe (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33701 io_contex ceph NOFD /proc/31347/task/33701/fd (opendir: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33702 io_contex ceph cwd unknown /proc/31347/task/33702/cwd (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33702 io_contex ceph rtd unknown /proc/31347/task/33702/root (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33702 io_contex ceph txt unknown /proc/31347/task/33702/exe (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33702 io_contex ceph NOFD /proc/31347/task/33702/fd (opendir: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33703 safe_time ceph cwd unknown /proc/31347/task/33703/cwd (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33703 safe_time ceph rtd unknown /proc/31347/task/33703/root (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33703 safe_time ceph txt unknown /proc/31347/task/33703/exe (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33703 safe_time ceph NOFD /proc/31347/task/33703/fd (opendir: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33704 safe_time ceph cwd unknown /proc/31347/task/33704/cwd (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33704 safe_time ceph rtd unknown /proc/31347/task/33704/root (readlink: Permission denied) 2024-09-10T22:18:55.729 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33704 safe_time ceph txt unknown /proc/31347/task/33704/exe (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33704 safe_time ceph NOFD /proc/31347/task/33704/fd (opendir: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33705 safe_time ceph cwd unknown /proc/31347/task/33705/cwd (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33705 safe_time ceph rtd unknown /proc/31347/task/33705/root (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33705 safe_time ceph txt unknown /proc/31347/task/33705/exe (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33705 safe_time ceph NOFD /proc/31347/task/33705/fd (opendir: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33706 fn_anonym ceph cwd unknown /proc/31347/task/33706/cwd (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33706 fn_anonym ceph rtd unknown /proc/31347/task/33706/root (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33706 fn_anonym ceph txt unknown /proc/31347/task/33706/exe (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33706 fn_anonym ceph NOFD /proc/31347/task/33706/fd (opendir: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33707 flusher ceph cwd unknown /proc/31347/task/33707/cwd (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33707 flusher ceph rtd unknown /proc/31347/task/33707/root (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33707 flusher ceph txt unknown /proc/31347/task/33707/exe (readlink: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33707 flusher ceph NOFD /proc/31347/task/33707/fd (opendir: Permission denied) 2024-09-10T22:18:55.730 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33708 safe_time ceph cwd unknown /proc/31347/task/33708/cwd (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33708 safe_time ceph rtd unknown /proc/31347/task/33708/root (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33708 safe_time ceph txt unknown /proc/31347/task/33708/exe (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33708 safe_time ceph NOFD /proc/31347/task/33708/fd (opendir: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33820 OpHistory ceph cwd unknown /proc/31347/task/33820/cwd (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33820 OpHistory ceph rtd unknown /proc/31347/task/33820/root (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33820 OpHistory ceph txt unknown /proc/31347/task/33820/exe (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33820 OpHistory ceph NOFD /proc/31347/task/33820/fd (opendir: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33821 mgr-fin ceph cwd unknown /proc/31347/task/33821/cwd (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33821 mgr-fin ceph rtd unknown /proc/31347/task/33821/root (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33821 mgr-fin ceph txt unknown /proc/31347/task/33821/exe (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33821 mgr-fin ceph NOFD /proc/31347/task/33821/fd (opendir: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33822 ms_dispat ceph cwd unknown /proc/31347/task/33822/cwd (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33822 ms_dispat ceph rtd unknown /proc/31347/task/33822/root (readlink: Permission denied) 2024-09-10T22:18:55.731 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33822 ms_dispat ceph txt unknown /proc/31347/task/33822/exe (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33822 ms_dispat ceph NOFD /proc/31347/task/33822/fd (opendir: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33823 ms_local ceph cwd unknown /proc/31347/task/33823/cwd (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33823 ms_local ceph rtd unknown /proc/31347/task/33823/root (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33823 ms_local ceph txt unknown /proc/31347/task/33823/exe (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33823 ms_local ceph NOFD /proc/31347/task/33823/fd (opendir: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33824 safe_time ceph cwd unknown /proc/31347/task/33824/cwd (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33824 safe_time ceph rtd unknown /proc/31347/task/33824/root (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33824 safe_time ceph txt unknown /proc/31347/task/33824/exe (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33824 safe_time ceph NOFD /proc/31347/task/33824/fd (opendir: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33825 cmdfin ceph cwd unknown /proc/31347/task/33825/cwd (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33825 cmdfin ceph rtd unknown /proc/31347/task/33825/root (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33825 cmdfin ceph txt unknown /proc/31347/task/33825/exe (readlink: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33825 cmdfin ceph NOFD /proc/31347/task/33825/fd (opendir: Permission denied) 2024-09-10T22:18:55.732 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33829 io_contex ceph cwd unknown /proc/31347/task/33829/cwd (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33829 io_contex ceph rtd unknown /proc/31347/task/33829/root (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33829 io_contex ceph txt unknown /proc/31347/task/33829/exe (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33829 io_contex ceph NOFD /proc/31347/task/33829/fd (opendir: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33830 io_contex ceph cwd unknown /proc/31347/task/33830/cwd (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33830 io_contex ceph rtd unknown /proc/31347/task/33830/root (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33830 io_contex ceph txt unknown /proc/31347/task/33830/exe (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33830 io_contex ceph NOFD /proc/31347/task/33830/fd (opendir: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33831 ceph_time ceph cwd unknown /proc/31347/task/33831/cwd (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33831 ceph_time ceph rtd unknown /proc/31347/task/33831/root (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33831 ceph_time ceph txt unknown /proc/31347/task/33831/exe (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33831 ceph_time ceph NOFD /proc/31347/task/33831/fd (opendir: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33832 ms_dispat ceph cwd unknown /proc/31347/task/33832/cwd (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33832 ms_dispat ceph rtd unknown /proc/31347/task/33832/root (readlink: Permission denied) 2024-09-10T22:18:55.733 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33832 ms_dispat ceph txt unknown /proc/31347/task/33832/exe (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33832 ms_dispat ceph NOFD /proc/31347/task/33832/fd (opendir: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33833 ms_local ceph cwd unknown /proc/31347/task/33833/cwd (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33833 ms_local ceph rtd unknown /proc/31347/task/33833/root (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33833 ms_local ceph txt unknown /proc/31347/task/33833/exe (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33833 ms_local ceph NOFD /proc/31347/task/33833/fd (opendir: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33834 safe_time ceph cwd unknown /proc/31347/task/33834/cwd (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33834 safe_time ceph rtd unknown /proc/31347/task/33834/root (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33834 safe_time ceph txt unknown /proc/31347/task/33834/exe (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33834 safe_time ceph NOFD /proc/31347/task/33834/fd (opendir: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33835 safe_time ceph cwd unknown /proc/31347/task/33835/cwd (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33835 safe_time ceph rtd unknown /proc/31347/task/33835/root (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33835 safe_time ceph txt unknown /proc/31347/task/33835/exe (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33835 safe_time ceph NOFD /proc/31347/task/33835/fd (opendir: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33836 balancer ceph cwd unknown /proc/31347/task/33836/cwd (readlink: Permission denied) 2024-09-10T22:18:55.734 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33836 balancer ceph rtd unknown /proc/31347/task/33836/root (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33836 balancer ceph txt unknown /proc/31347/task/33836/exe (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33836 balancer ceph NOFD /proc/31347/task/33836/fd (opendir: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33837 m-fin-bal ceph cwd unknown /proc/31347/task/33837/cwd (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33837 m-fin-bal ceph rtd unknown /proc/31347/task/33837/root (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33837 m-fin-bal ceph txt unknown /proc/31347/task/33837/exe (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33837 m-fin-bal ceph NOFD /proc/31347/task/33837/fd (opendir: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33838 mgr-fin ceph cwd unknown /proc/31347/task/33838/cwd (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33838 mgr-fin ceph rtd unknown /proc/31347/task/33838/root (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33838 mgr-fin ceph txt unknown /proc/31347/task/33838/exe (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33838 mgr-fin ceph NOFD /proc/31347/task/33838/fd (opendir: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33839 mgr-fin ceph cwd unknown /proc/31347/task/33839/cwd (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33839 mgr-fin ceph rtd unknown /proc/31347/task/33839/root (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33839 mgr-fin ceph txt unknown /proc/31347/task/33839/exe (readlink: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33839 mgr-fin ceph NOFD /proc/31347/task/33839/fd (opendir: Permission denied) 2024-09-10T22:18:55.735 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33840 mgr-fin ceph cwd unknown /proc/31347/task/33840/cwd (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33840 mgr-fin ceph rtd unknown /proc/31347/task/33840/root (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33840 mgr-fin ceph txt unknown /proc/31347/task/33840/exe (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33840 mgr-fin ceph NOFD /proc/31347/task/33840/fd (opendir: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33841 mgr-fin ceph cwd unknown /proc/31347/task/33841/cwd (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33841 mgr-fin ceph rtd unknown /proc/31347/task/33841/root (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33841 mgr-fin ceph txt unknown /proc/31347/task/33841/exe (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33841 mgr-fin ceph NOFD /proc/31347/task/33841/fd (opendir: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33842 mgr-fin ceph cwd unknown /proc/31347/task/33842/cwd (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33842 mgr-fin ceph rtd unknown /proc/31347/task/33842/root (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33842 mgr-fin ceph txt unknown /proc/31347/task/33842/exe (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33842 mgr-fin ceph NOFD /proc/31347/task/33842/fd (opendir: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33843 mgr-fin ceph cwd unknown /proc/31347/task/33843/cwd (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33843 mgr-fin ceph rtd unknown /proc/31347/task/33843/root (readlink: Permission denied) 2024-09-10T22:18:55.736 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33843 mgr-fin ceph txt unknown /proc/31347/task/33843/exe (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33843 mgr-fin ceph NOFD /proc/31347/task/33843/fd (opendir: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33844 mgr-fin ceph cwd unknown /proc/31347/task/33844/cwd (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33844 mgr-fin ceph rtd unknown /proc/31347/task/33844/root (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33844 mgr-fin ceph txt unknown /proc/31347/task/33844/exe (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33844 mgr-fin ceph NOFD /proc/31347/task/33844/fd (opendir: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33845 mgr-fin ceph cwd unknown /proc/31347/task/33845/cwd (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33845 mgr-fin ceph rtd unknown /proc/31347/task/33845/root (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33845 mgr-fin ceph txt unknown /proc/31347/task/33845/exe (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33845 mgr-fin ceph NOFD /proc/31347/task/33845/fd (opendir: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33846 mgr-fin ceph cwd unknown /proc/31347/task/33846/cwd (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33846 mgr-fin ceph rtd unknown /proc/31347/task/33846/root (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33846 mgr-fin ceph txt unknown /proc/31347/task/33846/exe (readlink: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33846 mgr-fin ceph NOFD /proc/31347/task/33846/fd (opendir: Permission denied) 2024-09-10T22:18:55.737 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33847 mgr-fin ceph cwd unknown /proc/31347/task/33847/cwd (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33847 mgr-fin ceph rtd unknown /proc/31347/task/33847/root (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33847 mgr-fin ceph txt unknown /proc/31347/task/33847/exe (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33847 mgr-fin ceph NOFD /proc/31347/task/33847/fd (opendir: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33848 mgr-fin ceph cwd unknown /proc/31347/task/33848/cwd (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33848 mgr-fin ceph rtd unknown /proc/31347/task/33848/root (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33848 mgr-fin ceph txt unknown /proc/31347/task/33848/exe (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33848 mgr-fin ceph NOFD /proc/31347/task/33848/fd (opendir: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33849 mgr-fin ceph cwd unknown /proc/31347/task/33849/cwd (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33849 mgr-fin ceph rtd unknown /proc/31347/task/33849/root (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33849 mgr-fin ceph txt unknown /proc/31347/task/33849/exe (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33849 mgr-fin ceph NOFD /proc/31347/task/33849/fd (opendir: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33850 mgr-fin ceph cwd unknown /proc/31347/task/33850/cwd (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33850 mgr-fin ceph rtd unknown /proc/31347/task/33850/root (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33850 mgr-fin ceph txt unknown /proc/31347/task/33850/exe (readlink: Permission denied) 2024-09-10T22:18:55.738 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33850 mgr-fin ceph NOFD /proc/31347/task/33850/fd (opendir: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33851 mgr-fin ceph cwd unknown /proc/31347/task/33851/cwd (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33851 mgr-fin ceph rtd unknown /proc/31347/task/33851/root (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33851 mgr-fin ceph txt unknown /proc/31347/task/33851/exe (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33851 mgr-fin ceph NOFD /proc/31347/task/33851/fd (opendir: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33852 mgr-fin ceph cwd unknown /proc/31347/task/33852/cwd (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33852 mgr-fin ceph rtd unknown /proc/31347/task/33852/root (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33852 mgr-fin ceph txt unknown /proc/31347/task/33852/exe (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33852 mgr-fin ceph NOFD /proc/31347/task/33852/fd (opendir: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33853 cephadm ceph cwd unknown /proc/31347/task/33853/cwd (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33853 cephadm ceph rtd unknown /proc/31347/task/33853/root (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33853 cephadm ceph txt unknown /proc/31347/task/33853/exe (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33853 cephadm ceph NOFD /proc/31347/task/33853/fd (opendir: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33854 m-fin-cep ceph cwd unknown /proc/31347/task/33854/cwd (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33854 m-fin-cep ceph rtd unknown /proc/31347/task/33854/root (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33854 m-fin-cep ceph txt unknown /proc/31347/task/33854/exe (readlink: Permission denied) 2024-09-10T22:18:55.739 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33854 m-fin-cep ceph NOFD /proc/31347/task/33854/fd (opendir: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33855 mgr-fin ceph cwd unknown /proc/31347/task/33855/cwd (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33855 mgr-fin ceph rtd unknown /proc/31347/task/33855/root (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33855 mgr-fin ceph txt unknown /proc/31347/task/33855/exe (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33855 mgr-fin ceph NOFD /proc/31347/task/33855/fd (opendir: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33856 mgr-fin ceph cwd unknown /proc/31347/task/33856/cwd (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33856 mgr-fin ceph rtd unknown /proc/31347/task/33856/root (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33856 mgr-fin ceph txt unknown /proc/31347/task/33856/exe (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33856 mgr-fin ceph NOFD /proc/31347/task/33856/fd (opendir: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33857 mgr-fin ceph cwd unknown /proc/31347/task/33857/cwd (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33857 mgr-fin ceph rtd unknown /proc/31347/task/33857/root (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33857 mgr-fin ceph txt unknown /proc/31347/task/33857/exe (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33857 mgr-fin ceph NOFD /proc/31347/task/33857/fd (opendir: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33858 crash ceph cwd unknown /proc/31347/task/33858/cwd (readlink: Permission denied) 2024-09-10T22:18:55.740 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33858 crash ceph rtd unknown /proc/31347/task/33858/root (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33858 crash ceph txt unknown /proc/31347/task/33858/exe (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33858 crash ceph NOFD /proc/31347/task/33858/fd (opendir: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33859 m-fin-cra ceph cwd unknown /proc/31347/task/33859/cwd (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33859 m-fin-cra ceph rtd unknown /proc/31347/task/33859/root (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33859 m-fin-cra ceph txt unknown /proc/31347/task/33859/exe (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33859 m-fin-cra ceph NOFD /proc/31347/task/33859/fd (opendir: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33860 mgr-fin ceph cwd unknown /proc/31347/task/33860/cwd (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33860 mgr-fin ceph rtd unknown /proc/31347/task/33860/root (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33860 mgr-fin ceph txt unknown /proc/31347/task/33860/exe (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33860 mgr-fin ceph NOFD /proc/31347/task/33860/fd (opendir: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33861 cephadm ceph cwd unknown /proc/31347/task/33861/cwd (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33861 cephadm ceph rtd unknown /proc/31347/task/33861/root (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33861 cephadm ceph txt unknown /proc/31347/task/33861/exe (readlink: Permission denied) 2024-09-10T22:18:55.741 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33861 cephadm ceph NOFD /proc/31347/task/33861/fd (opendir: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33862 mgr-fin ceph cwd unknown /proc/31347/task/33862/cwd (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33862 mgr-fin ceph rtd unknown /proc/31347/task/33862/root (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33862 mgr-fin ceph txt unknown /proc/31347/task/33862/exe (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33862 mgr-fin ceph NOFD /proc/31347/task/33862/fd (opendir: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33863 dashboard ceph cwd unknown /proc/31347/task/33863/cwd (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33863 dashboard ceph rtd unknown /proc/31347/task/33863/root (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33863 dashboard ceph txt unknown /proc/31347/task/33863/exe (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33863 dashboard ceph NOFD /proc/31347/task/33863/fd (opendir: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33864 m-fin-das ceph cwd unknown /proc/31347/task/33864/cwd (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33864 m-fin-das ceph rtd unknown /proc/31347/task/33864/root (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33864 m-fin-das ceph txt unknown /proc/31347/task/33864/exe (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33864 m-fin-das ceph NOFD /proc/31347/task/33864/fd (opendir: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33865 mgr-fin ceph cwd unknown /proc/31347/task/33865/cwd (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33865 mgr-fin ceph rtd unknown /proc/31347/task/33865/root (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33865 mgr-fin ceph txt unknown /proc/31347/task/33865/exe (readlink: Permission denied) 2024-09-10T22:18:55.742 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33865 mgr-fin ceph NOFD /proc/31347/task/33865/fd (opendir: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33866 mgr-fin ceph cwd unknown /proc/31347/task/33866/cwd (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33866 mgr-fin ceph rtd unknown /proc/31347/task/33866/root (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33866 mgr-fin ceph txt unknown /proc/31347/task/33866/exe (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33866 mgr-fin ceph NOFD /proc/31347/task/33866/fd (opendir: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33867 mgr-fin ceph cwd unknown /proc/31347/task/33867/cwd (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33867 mgr-fin ceph rtd unknown /proc/31347/task/33867/root (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33867 mgr-fin ceph txt unknown /proc/31347/task/33867/exe (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33867 mgr-fin ceph NOFD /proc/31347/task/33867/fd (opendir: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33868 mgr-fin ceph cwd unknown /proc/31347/task/33868/cwd (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33868 mgr-fin ceph rtd unknown /proc/31347/task/33868/root (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33868 mgr-fin ceph txt unknown /proc/31347/task/33868/exe (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33868 mgr-fin ceph NOFD /proc/31347/task/33868/fd (opendir: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33869 devicehea ceph cwd unknown /proc/31347/task/33869/cwd (readlink: Permission denied) 2024-09-10T22:18:55.743 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33869 devicehea ceph rtd unknown /proc/31347/task/33869/root (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33869 devicehea ceph txt unknown /proc/31347/task/33869/exe (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33869 devicehea ceph NOFD /proc/31347/task/33869/fd (opendir: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33870 m-fin-dev ceph cwd unknown /proc/31347/task/33870/cwd (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33870 m-fin-dev ceph rtd unknown /proc/31347/task/33870/root (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33870 m-fin-dev ceph txt unknown /proc/31347/task/33870/exe (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33870 m-fin-dev ceph NOFD /proc/31347/task/33870/fd (opendir: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33871 mgr-fin ceph cwd unknown /proc/31347/task/33871/cwd (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33871 mgr-fin ceph rtd unknown /proc/31347/task/33871/root (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33871 mgr-fin ceph txt unknown /proc/31347/task/33871/exe (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33871 mgr-fin ceph NOFD /proc/31347/task/33871/fd (opendir: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33873 m-fin-ios ceph cwd unknown /proc/31347/task/33873/cwd (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33873 m-fin-ios ceph rtd unknown /proc/31347/task/33873/root (readlink: Permission denied) 2024-09-10T22:18:55.744 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33873 m-fin-ios ceph txt unknown /proc/31347/task/33873/exe (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33873 m-fin-ios ceph NOFD /proc/31347/task/33873/fd (opendir: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33875 mgr-fin ceph cwd unknown /proc/31347/task/33875/cwd (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33875 mgr-fin ceph rtd unknown /proc/31347/task/33875/root (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33875 mgr-fin ceph txt unknown /proc/31347/task/33875/exe (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33875 mgr-fin ceph NOFD /proc/31347/task/33875/fd (opendir: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33876 m-fin-nfs ceph cwd unknown /proc/31347/task/33876/cwd (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33876 m-fin-nfs ceph rtd unknown /proc/31347/task/33876/root (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33876 m-fin-nfs ceph txt unknown /proc/31347/task/33876/exe (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33876 m-fin-nfs ceph NOFD /proc/31347/task/33876/fd (opendir: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33877 mgr-fin ceph cwd unknown /proc/31347/task/33877/cwd (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33877 mgr-fin ceph rtd unknown /proc/31347/task/33877/root (readlink: Permission denied) 2024-09-10T22:18:55.745 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33877 mgr-fin ceph txt unknown /proc/31347/task/33877/exe (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33877 mgr-fin ceph NOFD /proc/31347/task/33877/fd (opendir: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33878 mgr-fin ceph cwd unknown /proc/31347/task/33878/cwd (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33878 mgr-fin ceph rtd unknown /proc/31347/task/33878/root (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33878 mgr-fin ceph txt unknown /proc/31347/task/33878/exe (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33878 mgr-fin ceph NOFD /proc/31347/task/33878/fd (opendir: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33879 cephadm ceph cwd unknown /proc/31347/task/33879/cwd (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33879 cephadm ceph rtd unknown /proc/31347/task/33879/root (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33879 cephadm ceph txt unknown /proc/31347/task/33879/exe (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33879 cephadm ceph NOFD /proc/31347/task/33879/fd (opendir: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33881 m-fin-orc ceph cwd unknown /proc/31347/task/33881/cwd (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33881 m-fin-orc ceph rtd unknown /proc/31347/task/33881/root (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33881 m-fin-orc ceph txt unknown /proc/31347/task/33881/exe (readlink: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33881 m-fin-orc ceph NOFD /proc/31347/task/33881/fd (opendir: Permission denied) 2024-09-10T22:18:55.746 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33882 pg_autosc ceph cwd unknown /proc/31347/task/33882/cwd (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33882 pg_autosc ceph rtd unknown /proc/31347/task/33882/root (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33882 pg_autosc ceph txt unknown /proc/31347/task/33882/exe (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33882 pg_autosc ceph NOFD /proc/31347/task/33882/fd (opendir: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33883 m-fin-pg_ ceph cwd unknown /proc/31347/task/33883/cwd (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33883 m-fin-pg_ ceph rtd unknown /proc/31347/task/33883/root (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33883 m-fin-pg_ ceph txt unknown /proc/31347/task/33883/exe (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33883 m-fin-pg_ ceph NOFD /proc/31347/task/33883/fd (opendir: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33884 progress ceph cwd unknown /proc/31347/task/33884/cwd (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33884 progress ceph rtd unknown /proc/31347/task/33884/root (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33884 progress ceph txt unknown /proc/31347/task/33884/exe (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33884 progress ceph NOFD /proc/31347/task/33884/fd (opendir: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33885 m-fin-pro ceph cwd unknown /proc/31347/task/33885/cwd (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33885 m-fin-pro ceph rtd unknown /proc/31347/task/33885/root (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33885 m-fin-pro ceph txt unknown /proc/31347/task/33885/exe (readlink: Permission denied) 2024-09-10T22:18:55.747 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33885 m-fin-pro ceph NOFD /proc/31347/task/33885/fd (opendir: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33889 io_contex ceph cwd unknown /proc/31347/task/33889/cwd (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33889 io_contex ceph rtd unknown /proc/31347/task/33889/root (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33889 io_contex ceph txt unknown /proc/31347/task/33889/exe (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33889 io_contex ceph NOFD /proc/31347/task/33889/fd (opendir: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33890 io_contex ceph cwd unknown /proc/31347/task/33890/cwd (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33890 io_contex ceph rtd unknown /proc/31347/task/33890/root (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33890 io_contex ceph txt unknown /proc/31347/task/33890/exe (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33890 io_contex ceph NOFD /proc/31347/task/33890/fd (opendir: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33891 ceph_time ceph cwd unknown /proc/31347/task/33891/cwd (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33891 ceph_time ceph rtd unknown /proc/31347/task/33891/root (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33891 ceph_time ceph txt unknown /proc/31347/task/33891/exe (readlink: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33891 ceph_time ceph NOFD /proc/31347/task/33891/fd (opendir: Permission denied) 2024-09-10T22:18:55.748 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33892 ms_dispat ceph cwd unknown /proc/31347/task/33892/cwd (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33892 ms_dispat ceph rtd unknown /proc/31347/task/33892/root (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33892 ms_dispat ceph txt unknown /proc/31347/task/33892/exe (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33892 ms_dispat ceph NOFD /proc/31347/task/33892/fd (opendir: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33893 ms_local ceph cwd unknown /proc/31347/task/33893/cwd (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33893 ms_local ceph rtd unknown /proc/31347/task/33893/root (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33893 ms_local ceph txt unknown /proc/31347/task/33893/exe (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33893 ms_local ceph NOFD /proc/31347/task/33893/fd (opendir: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33894 safe_time ceph cwd unknown /proc/31347/task/33894/cwd (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33894 safe_time ceph rtd unknown /proc/31347/task/33894/root (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33894 safe_time ceph txt unknown /proc/31347/task/33894/exe (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33894 safe_time ceph NOFD /proc/31347/task/33894/fd (opendir: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33895 safe_time ceph cwd unknown /proc/31347/task/33895/cwd (readlink: Permission denied) 2024-09-10T22:18:55.749 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33895 safe_time ceph rtd unknown /proc/31347/task/33895/root (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33895 safe_time ceph txt unknown /proc/31347/task/33895/exe (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33895 safe_time ceph NOFD /proc/31347/task/33895/fd (opendir: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33896 mgr-fin ceph cwd unknown /proc/31347/task/33896/cwd (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33896 mgr-fin ceph rtd unknown /proc/31347/task/33896/root (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33896 mgr-fin ceph txt unknown /proc/31347/task/33896/exe (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33896 mgr-fin ceph NOFD /proc/31347/task/33896/fd (opendir: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33898 m-fin-rbd ceph cwd unknown /proc/31347/task/33898/cwd (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33898 m-fin-rbd ceph rtd unknown /proc/31347/task/33898/root (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33898 m-fin-rbd ceph txt unknown /proc/31347/task/33898/exe (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33898 m-fin-rbd ceph NOFD /proc/31347/task/33898/fd (opendir: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33899 restful ceph cwd unknown /proc/31347/task/33899/cwd (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33899 restful ceph rtd unknown /proc/31347/task/33899/root (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33899 restful ceph txt unknown /proc/31347/task/33899/exe (readlink: Permission denied) 2024-09-10T22:18:55.750 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33899 restful ceph NOFD /proc/31347/task/33899/fd (opendir: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33900 m-fin-res ceph cwd unknown /proc/31347/task/33900/cwd (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33900 m-fin-res ceph rtd unknown /proc/31347/task/33900/root (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33900 m-fin-res ceph txt unknown /proc/31347/task/33900/exe (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33900 m-fin-res ceph NOFD /proc/31347/task/33900/fd (opendir: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33902 m-fin-sta ceph cwd unknown /proc/31347/task/33902/cwd (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33902 m-fin-sta ceph rtd unknown /proc/31347/task/33902/root (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33902 m-fin-sta ceph txt unknown /proc/31347/task/33902/exe (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33902 m-fin-sta ceph NOFD /proc/31347/task/33902/fd (opendir: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33903 telemetry ceph cwd unknown /proc/31347/task/33903/cwd (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33903 telemetry ceph rtd unknown /proc/31347/task/33903/root (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33903 telemetry ceph txt unknown /proc/31347/task/33903/exe (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33903 telemetry ceph NOFD /proc/31347/task/33903/fd (opendir: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33904 m-fin-tel ceph cwd unknown /proc/31347/task/33904/cwd (readlink: Permission denied) 2024-09-10T22:18:55.751 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33904 m-fin-tel ceph rtd unknown /proc/31347/task/33904/root (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33904 m-fin-tel ceph txt unknown /proc/31347/task/33904/exe (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33904 m-fin-tel ceph NOFD /proc/31347/task/33904/fd (opendir: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33905 mgr-fin ceph cwd unknown /proc/31347/task/33905/cwd (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33905 mgr-fin ceph rtd unknown /proc/31347/task/33905/root (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33905 mgr-fin ceph txt unknown /proc/31347/task/33905/exe (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33905 mgr-fin ceph NOFD /proc/31347/task/33905/fd (opendir: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33906 mgr-fin ceph cwd unknown /proc/31347/task/33906/cwd (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33906 mgr-fin ceph rtd unknown /proc/31347/task/33906/root (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33906 mgr-fin ceph txt unknown /proc/31347/task/33906/exe (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33906 mgr-fin ceph NOFD /proc/31347/task/33906/fd (opendir: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33907 mgr-fin ceph cwd unknown /proc/31347/task/33907/cwd (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33907 mgr-fin ceph rtd unknown /proc/31347/task/33907/root (readlink: Permission denied) 2024-09-10T22:18:55.752 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33907 mgr-fin ceph txt unknown /proc/31347/task/33907/exe (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33907 mgr-fin ceph NOFD /proc/31347/task/33907/fd (opendir: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33908 mgr-fin ceph cwd unknown /proc/31347/task/33908/cwd (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33908 mgr-fin ceph rtd unknown /proc/31347/task/33908/root (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33908 mgr-fin ceph txt unknown /proc/31347/task/33908/exe (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33908 mgr-fin ceph NOFD /proc/31347/task/33908/fd (opendir: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33912 mgr-fin ceph cwd unknown /proc/31347/task/33912/cwd (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33912 mgr-fin ceph rtd unknown /proc/31347/task/33912/root (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33912 mgr-fin ceph txt unknown /proc/31347/task/33912/exe (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33912 mgr-fin ceph NOFD /proc/31347/task/33912/fd (opendir: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33913 io_contex ceph cwd unknown /proc/31347/task/33913/cwd (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33913 io_contex ceph rtd unknown /proc/31347/task/33913/root (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33913 io_contex ceph txt unknown /proc/31347/task/33913/exe (readlink: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33913 io_contex ceph NOFD /proc/31347/task/33913/fd (opendir: Permission denied) 2024-09-10T22:18:55.753 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33914 io_contex ceph cwd unknown /proc/31347/task/33914/cwd (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33914 io_contex ceph rtd unknown /proc/31347/task/33914/root (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33914 io_contex ceph txt unknown /proc/31347/task/33914/exe (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33914 io_contex ceph NOFD /proc/31347/task/33914/fd (opendir: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33915 ceph_time ceph cwd unknown /proc/31347/task/33915/cwd (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33915 ceph_time ceph rtd unknown /proc/31347/task/33915/root (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33915 ceph_time ceph txt unknown /proc/31347/task/33915/exe (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33915 ceph_time ceph NOFD /proc/31347/task/33915/fd (opendir: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33916 ms_dispat ceph cwd unknown /proc/31347/task/33916/cwd (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33916 ms_dispat ceph rtd unknown /proc/31347/task/33916/root (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33916 ms_dispat ceph txt unknown /proc/31347/task/33916/exe (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33916 ms_dispat ceph NOFD /proc/31347/task/33916/fd (opendir: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33917 ms_local ceph cwd unknown /proc/31347/task/33917/cwd (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33917 ms_local ceph rtd unknown /proc/31347/task/33917/root (readlink: Permission denied) 2024-09-10T22:18:55.754 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33917 ms_local ceph txt unknown /proc/31347/task/33917/exe (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33917 ms_local ceph NOFD /proc/31347/task/33917/fd (opendir: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33918 safe_time ceph cwd unknown /proc/31347/task/33918/cwd (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33918 safe_time ceph rtd unknown /proc/31347/task/33918/root (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33918 safe_time ceph txt unknown /proc/31347/task/33918/exe (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33918 safe_time ceph NOFD /proc/31347/task/33918/fd (opendir: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33919 safe_time ceph cwd unknown /proc/31347/task/33919/cwd (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33919 safe_time ceph rtd unknown /proc/31347/task/33919/root (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33919 safe_time ceph txt unknown /proc/31347/task/33919/exe (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33919 safe_time ceph NOFD /proc/31347/task/33919/fd (opendir: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33920 mgr-fin ceph cwd unknown /proc/31347/task/33920/cwd (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33920 mgr-fin ceph rtd unknown /proc/31347/task/33920/root (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33920 mgr-fin ceph txt unknown /proc/31347/task/33920/exe (readlink: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33920 mgr-fin ceph NOFD /proc/31347/task/33920/fd (opendir: Permission denied) 2024-09-10T22:18:55.755 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33921 mgr-fin ceph cwd unknown /proc/31347/task/33921/cwd (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33921 mgr-fin ceph rtd unknown /proc/31347/task/33921/root (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33921 mgr-fin ceph txt unknown /proc/31347/task/33921/exe (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33921 mgr-fin ceph NOFD /proc/31347/task/33921/fd (opendir: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33922 mgr-fin ceph cwd unknown /proc/31347/task/33922/cwd (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33922 mgr-fin ceph rtd unknown /proc/31347/task/33922/root (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33922 mgr-fin ceph txt unknown /proc/31347/task/33922/exe (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33922 mgr-fin ceph NOFD /proc/31347/task/33922/fd (opendir: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33923 mgr-fin ceph cwd unknown /proc/31347/task/33923/cwd (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33923 mgr-fin ceph rtd unknown /proc/31347/task/33923/root (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33923 mgr-fin ceph txt unknown /proc/31347/task/33923/exe (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33923 mgr-fin ceph NOFD /proc/31347/task/33923/fd (opendir: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33924 mgr-fin ceph cwd unknown /proc/31347/task/33924/cwd (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33924 mgr-fin ceph rtd unknown /proc/31347/task/33924/root (readlink: Permission denied) 2024-09-10T22:18:55.756 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33924 mgr-fin ceph txt unknown /proc/31347/task/33924/exe (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33924 mgr-fin ceph NOFD /proc/31347/task/33924/fd (opendir: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33925 mgr-fin ceph cwd unknown /proc/31347/task/33925/cwd (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33925 mgr-fin ceph rtd unknown /proc/31347/task/33925/root (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33925 mgr-fin ceph txt unknown /proc/31347/task/33925/exe (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33925 mgr-fin ceph NOFD /proc/31347/task/33925/fd (opendir: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33926 mgr-fin ceph cwd unknown /proc/31347/task/33926/cwd (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33926 mgr-fin ceph rtd unknown /proc/31347/task/33926/root (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33926 mgr-fin ceph txt unknown /proc/31347/task/33926/exe (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33926 mgr-fin ceph NOFD /proc/31347/task/33926/fd (opendir: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33927 mgr-fin ceph cwd unknown /proc/31347/task/33927/cwd (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33927 mgr-fin ceph rtd unknown /proc/31347/task/33927/root (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33927 mgr-fin ceph txt unknown /proc/31347/task/33927/exe (readlink: Permission denied) 2024-09-10T22:18:55.757 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33927 mgr-fin ceph NOFD /proc/31347/task/33927/fd (opendir: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33928 mgr-fin ceph cwd unknown /proc/31347/task/33928/cwd (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33928 mgr-fin ceph rtd unknown /proc/31347/task/33928/root (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33928 mgr-fin ceph txt unknown /proc/31347/task/33928/exe (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33928 mgr-fin ceph NOFD /proc/31347/task/33928/fd (opendir: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33929 mgr-fin ceph cwd unknown /proc/31347/task/33929/cwd (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33929 mgr-fin ceph rtd unknown /proc/31347/task/33929/root (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33929 mgr-fin ceph txt unknown /proc/31347/task/33929/exe (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33929 mgr-fin ceph NOFD /proc/31347/task/33929/fd (opendir: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33930 mgr-fin ceph cwd unknown /proc/31347/task/33930/cwd (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33930 mgr-fin ceph rtd unknown /proc/31347/task/33930/root (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33930 mgr-fin ceph txt unknown /proc/31347/task/33930/exe (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33930 mgr-fin ceph NOFD /proc/31347/task/33930/fd (opendir: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33931 mgr-fin ceph cwd unknown /proc/31347/task/33931/cwd (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33931 mgr-fin ceph rtd unknown /proc/31347/task/33931/root (readlink: Permission denied) 2024-09-10T22:18:55.758 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33931 mgr-fin ceph txt unknown /proc/31347/task/33931/exe (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33931 mgr-fin ceph NOFD /proc/31347/task/33931/fd (opendir: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33933 m-fin-vol ceph cwd unknown /proc/31347/task/33933/cwd (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33933 m-fin-vol ceph rtd unknown /proc/31347/task/33933/root (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33933 m-fin-vol ceph txt unknown /proc/31347/task/33933/exe (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 33933 m-fin-vol ceph NOFD /proc/31347/task/33933/fd (opendir: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34071 mgr-fin ceph cwd unknown /proc/31347/task/34071/cwd (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34071 mgr-fin ceph rtd unknown /proc/31347/task/34071/root (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34071 mgr-fin ceph txt unknown /proc/31347/task/34071/exe (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34071 mgr-fin ceph NOFD /proc/31347/task/34071/fd (opendir: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34072 mgr-fin ceph cwd unknown /proc/31347/task/34072/cwd (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34072 mgr-fin ceph rtd unknown /proc/31347/task/34072/root (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34072 mgr-fin ceph txt unknown /proc/31347/task/34072/exe (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34072 mgr-fin ceph NOFD /proc/31347/task/34072/fd (opendir: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34073 mgr-fin ceph cwd unknown /proc/31347/task/34073/cwd (readlink: Permission denied) 2024-09-10T22:18:55.759 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34073 mgr-fin ceph rtd unknown /proc/31347/task/34073/root (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34073 mgr-fin ceph txt unknown /proc/31347/task/34073/exe (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34073 mgr-fin ceph NOFD /proc/31347/task/34073/fd (opendir: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34074 mgr-fin ceph cwd unknown /proc/31347/task/34074/cwd (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34074 mgr-fin ceph rtd unknown /proc/31347/task/34074/root (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34074 mgr-fin ceph txt unknown /proc/31347/task/34074/exe (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34074 mgr-fin ceph NOFD /proc/31347/task/34074/fd (opendir: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34075 mgr-fin ceph cwd unknown /proc/31347/task/34075/cwd (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34075 mgr-fin ceph rtd unknown /proc/31347/task/34075/root (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34075 mgr-fin ceph txt unknown /proc/31347/task/34075/exe (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34075 mgr-fin ceph NOFD /proc/31347/task/34075/fd (opendir: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34076 mgr-fin ceph cwd unknown /proc/31347/task/34076/cwd (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34076 mgr-fin ceph rtd unknown /proc/31347/task/34076/root (readlink: Permission denied) 2024-09-10T22:18:55.760 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34076 mgr-fin ceph txt unknown /proc/31347/task/34076/exe (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34076 mgr-fin ceph NOFD /proc/31347/task/34076/fd (opendir: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34077 mgr-fin ceph cwd unknown /proc/31347/task/34077/cwd (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34077 mgr-fin ceph rtd unknown /proc/31347/task/34077/root (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34077 mgr-fin ceph txt unknown /proc/31347/task/34077/exe (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34077 mgr-fin ceph NOFD /proc/31347/task/34077/fd (opendir: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34078 mgr-fin ceph cwd unknown /proc/31347/task/34078/cwd (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34078 mgr-fin ceph rtd unknown /proc/31347/task/34078/root (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34078 mgr-fin ceph txt unknown /proc/31347/task/34078/exe (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34078 mgr-fin ceph NOFD /proc/31347/task/34078/fd (opendir: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34079 mgr-fin ceph cwd unknown /proc/31347/task/34079/cwd (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34079 mgr-fin ceph rtd unknown /proc/31347/task/34079/root (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34079 mgr-fin ceph txt unknown /proc/31347/task/34079/exe (readlink: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34079 mgr-fin ceph NOFD /proc/31347/task/34079/fd (opendir: Permission denied) 2024-09-10T22:18:55.761 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34080 mgr-fin ceph cwd unknown /proc/31347/task/34080/cwd (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34080 mgr-fin ceph rtd unknown /proc/31347/task/34080/root (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34080 mgr-fin ceph txt unknown /proc/31347/task/34080/exe (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34080 mgr-fin ceph NOFD /proc/31347/task/34080/fd (opendir: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34081 mgr-fin ceph cwd unknown /proc/31347/task/34081/cwd (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34081 mgr-fin ceph rtd unknown /proc/31347/task/34081/root (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34081 mgr-fin ceph txt unknown /proc/31347/task/34081/exe (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34081 mgr-fin ceph NOFD /proc/31347/task/34081/fd (opendir: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34082 mgr-fin ceph cwd unknown /proc/31347/task/34082/cwd (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34082 mgr-fin ceph rtd unknown /proc/31347/task/34082/root (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34082 mgr-fin ceph txt unknown /proc/31347/task/34082/exe (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34082 mgr-fin ceph NOFD /proc/31347/task/34082/fd (opendir: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34083 mgr-fin ceph cwd unknown /proc/31347/task/34083/cwd (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34083 mgr-fin ceph rtd unknown /proc/31347/task/34083/root (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34083 mgr-fin ceph txt unknown /proc/31347/task/34083/exe (readlink: Permission denied) 2024-09-10T22:18:55.762 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34083 mgr-fin ceph NOFD /proc/31347/task/34083/fd (opendir: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34084 mgr-fin ceph cwd unknown /proc/31347/task/34084/cwd (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34084 mgr-fin ceph rtd unknown /proc/31347/task/34084/root (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34084 mgr-fin ceph txt unknown /proc/31347/task/34084/exe (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34084 mgr-fin ceph NOFD /proc/31347/task/34084/fd (opendir: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34085 mgr-fin ceph cwd unknown /proc/31347/task/34085/cwd (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34085 mgr-fin ceph rtd unknown /proc/31347/task/34085/root (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34085 mgr-fin ceph txt unknown /proc/31347/task/34085/exe (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34085 mgr-fin ceph NOFD /proc/31347/task/34085/fd (opendir: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34086 mgr-fin ceph cwd unknown /proc/31347/task/34086/cwd (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34086 mgr-fin ceph rtd unknown /proc/31347/task/34086/root (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34086 mgr-fin ceph txt unknown /proc/31347/task/34086/exe (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34086 mgr-fin ceph NOFD /proc/31347/task/34086/fd (opendir: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34087 mgr-fin ceph cwd unknown /proc/31347/task/34087/cwd (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34087 mgr-fin ceph rtd unknown /proc/31347/task/34087/root (readlink: Permission denied) 2024-09-10T22:18:55.763 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34087 mgr-fin ceph txt unknown /proc/31347/task/34087/exe (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34087 mgr-fin ceph NOFD /proc/31347/task/34087/fd (opendir: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34088 mgr-fin ceph cwd unknown /proc/31347/task/34088/cwd (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34088 mgr-fin ceph rtd unknown /proc/31347/task/34088/root (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34088 mgr-fin ceph txt unknown /proc/31347/task/34088/exe (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34088 mgr-fin ceph NOFD /proc/31347/task/34088/fd (opendir: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34089 mgr-fin ceph cwd unknown /proc/31347/task/34089/cwd (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34089 mgr-fin ceph rtd unknown /proc/31347/task/34089/root (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34089 mgr-fin ceph txt unknown /proc/31347/task/34089/exe (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34089 mgr-fin ceph NOFD /proc/31347/task/34089/fd (opendir: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34090 mgr-fin ceph cwd unknown /proc/31347/task/34090/cwd (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34090 mgr-fin ceph rtd unknown /proc/31347/task/34090/root (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34090 mgr-fin ceph txt unknown /proc/31347/task/34090/exe (readlink: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34090 mgr-fin ceph NOFD /proc/31347/task/34090/fd (opendir: Permission denied) 2024-09-10T22:18:55.764 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34091 mgr-fin ceph cwd unknown /proc/31347/task/34091/cwd (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34091 mgr-fin ceph rtd unknown /proc/31347/task/34091/root (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34091 mgr-fin ceph txt unknown /proc/31347/task/34091/exe (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34091 mgr-fin ceph NOFD /proc/31347/task/34091/fd (opendir: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34092 mgr-fin ceph cwd unknown /proc/31347/task/34092/cwd (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34092 mgr-fin ceph rtd unknown /proc/31347/task/34092/root (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34092 mgr-fin ceph txt unknown /proc/31347/task/34092/exe (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34092 mgr-fin ceph NOFD /proc/31347/task/34092/fd (opendir: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34814 dashboard ceph cwd unknown /proc/31347/task/34814/cwd (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34814 dashboard ceph rtd unknown /proc/31347/task/34814/root (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34814 dashboard ceph txt unknown /proc/31347/task/34814/exe (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34814 dashboard ceph NOFD /proc/31347/task/34814/fd (opendir: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34815 dashboard ceph cwd unknown /proc/31347/task/34815/cwd (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34815 dashboard ceph rtd unknown /proc/31347/task/34815/root (readlink: Permission denied) 2024-09-10T22:18:55.765 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34815 dashboard ceph txt unknown /proc/31347/task/34815/exe (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34815 dashboard ceph NOFD /proc/31347/task/34815/fd (opendir: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34816 dashboard ceph cwd unknown /proc/31347/task/34816/cwd (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34816 dashboard ceph rtd unknown /proc/31347/task/34816/root (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34816 dashboard ceph txt unknown /proc/31347/task/34816/exe (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34816 dashboard ceph NOFD /proc/31347/task/34816/fd (opendir: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34817 dashboard ceph cwd unknown /proc/31347/task/34817/cwd (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34817 dashboard ceph rtd unknown /proc/31347/task/34817/root (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34817 dashboard ceph txt unknown /proc/31347/task/34817/exe (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34817 dashboard ceph NOFD /proc/31347/task/34817/fd (opendir: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34818 dashboard ceph cwd unknown /proc/31347/task/34818/cwd (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34818 dashboard ceph rtd unknown /proc/31347/task/34818/root (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34818 dashboard ceph txt unknown /proc/31347/task/34818/exe (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34818 dashboard ceph NOFD /proc/31347/task/34818/fd (opendir: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34819 dashboard ceph cwd unknown /proc/31347/task/34819/cwd (readlink: Permission denied) 2024-09-10T22:18:55.766 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34819 dashboard ceph rtd unknown /proc/31347/task/34819/root (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34819 dashboard ceph txt unknown /proc/31347/task/34819/exe (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34819 dashboard ceph NOFD /proc/31347/task/34819/fd (opendir: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34820 dashboard ceph cwd unknown /proc/31347/task/34820/cwd (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34820 dashboard ceph rtd unknown /proc/31347/task/34820/root (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34820 dashboard ceph txt unknown /proc/31347/task/34820/exe (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34820 dashboard ceph NOFD /proc/31347/task/34820/fd (opendir: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34821 dashboard ceph cwd unknown /proc/31347/task/34821/cwd (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34821 dashboard ceph rtd unknown /proc/31347/task/34821/root (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34821 dashboard ceph txt unknown /proc/31347/task/34821/exe (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34821 dashboard ceph NOFD /proc/31347/task/34821/fd (opendir: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34822 dashboard ceph cwd unknown /proc/31347/task/34822/cwd (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34822 dashboard ceph rtd unknown /proc/31347/task/34822/root (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34822 dashboard ceph txt unknown /proc/31347/task/34822/exe (readlink: Permission denied) 2024-09-10T22:18:55.767 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34822 dashboard ceph NOFD /proc/31347/task/34822/fd (opendir: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34823 dashboard ceph cwd unknown /proc/31347/task/34823/cwd (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34823 dashboard ceph rtd unknown /proc/31347/task/34823/root (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34823 dashboard ceph txt unknown /proc/31347/task/34823/exe (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34823 dashboard ceph NOFD /proc/31347/task/34823/fd (opendir: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34824 dashboard ceph cwd unknown /proc/31347/task/34824/cwd (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34824 dashboard ceph rtd unknown /proc/31347/task/34824/root (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34824 dashboard ceph txt unknown /proc/31347/task/34824/exe (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34824 dashboard ceph NOFD /proc/31347/task/34824/fd (opendir: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34825 dashboard ceph cwd unknown /proc/31347/task/34825/cwd (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34825 dashboard ceph rtd unknown /proc/31347/task/34825/root (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34825 dashboard ceph txt unknown /proc/31347/task/34825/exe (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 34825 dashboard ceph NOFD /proc/31347/task/34825/fd (opendir: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52128 devicehea ceph cwd unknown /proc/31347/task/52128/cwd (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52128 devicehea ceph rtd unknown /proc/31347/task/52128/root (readlink: Permission denied) 2024-09-10T22:18:55.768 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52128 devicehea ceph txt unknown /proc/31347/task/52128/exe (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52128 devicehea ceph NOFD /proc/31347/task/52128/fd (opendir: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52134 io_contex ceph cwd unknown /proc/31347/task/52134/cwd (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52134 io_contex ceph rtd unknown /proc/31347/task/52134/root (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52134 io_contex ceph txt unknown /proc/31347/task/52134/exe (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52134 io_contex ceph NOFD /proc/31347/task/52134/fd (opendir: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52135 io_contex ceph cwd unknown /proc/31347/task/52135/cwd (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52135 io_contex ceph rtd unknown /proc/31347/task/52135/root (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52135 io_contex ceph txt unknown /proc/31347/task/52135/exe (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52135 io_contex ceph NOFD /proc/31347/task/52135/fd (opendir: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52136 ceph_time ceph cwd unknown /proc/31347/task/52136/cwd (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52136 ceph_time ceph rtd unknown /proc/31347/task/52136/root (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52136 ceph_time ceph txt unknown /proc/31347/task/52136/exe (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52136 ceph_time ceph NOFD /proc/31347/task/52136/fd (opendir: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52137 ms_dispat ceph cwd unknown /proc/31347/task/52137/cwd (readlink: Permission denied) 2024-09-10T22:18:55.769 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52137 ms_dispat ceph rtd unknown /proc/31347/task/52137/root (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52137 ms_dispat ceph txt unknown /proc/31347/task/52137/exe (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52137 ms_dispat ceph NOFD /proc/31347/task/52137/fd (opendir: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52138 ms_local ceph cwd unknown /proc/31347/task/52138/cwd (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52138 ms_local ceph rtd unknown /proc/31347/task/52138/root (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52138 ms_local ceph txt unknown /proc/31347/task/52138/exe (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52138 ms_local ceph NOFD /proc/31347/task/52138/fd (opendir: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52139 safe_time ceph cwd unknown /proc/31347/task/52139/cwd (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52139 safe_time ceph rtd unknown /proc/31347/task/52139/root (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52139 safe_time ceph txt unknown /proc/31347/task/52139/exe (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52139 safe_time ceph NOFD /proc/31347/task/52139/fd (opendir: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52140 safe_time ceph cwd unknown /proc/31347/task/52140/cwd (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52140 safe_time ceph rtd unknown /proc/31347/task/52140/root (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52140 safe_time ceph txt unknown /proc/31347/task/52140/exe (readlink: Permission denied) 2024-09-10T22:18:55.770 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mgr 31347 52140 safe_time ceph NOFD /proc/31347/task/52140/fd (opendir: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 31785 root cwd unknown /proc/31785/cwd (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 31785 root rtd unknown /proc/31785/root (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 31785 root txt unknown /proc/31785/exe (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 31785 root NOFD /proc/31785/fd (opendir: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 32304 root cwd unknown /proc/32304/cwd (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 32304 root rtd unknown /proc/32304/root (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 32304 root txt unknown /proc/32304/exe (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:systemd 32304 root NOFD /proc/32304/fd (opendir: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 32306 root cwd unknown /proc/32306/cwd (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 32306 root rtd unknown /proc/32306/root (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 32306 root txt unknown /proc/32306/exe (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:(sd-pam) 32306 root NOFD /proc/32306/fd (opendir: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33934 root cwd unknown /proc/33934/cwd (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33934 root rtd unknown /proc/33934/root (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33934 root txt unknown /proc/33934/exe (readlink: Permission denied) 2024-09-10T22:18:55.771 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33934 root NOFD /proc/33934/fd (opendir: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33937 root cwd unknown /proc/33937/cwd (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33937 root rtd unknown /proc/33937/root (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33937 root txt unknown /proc/33937/exe (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:sshd 33937 root NOFD /proc/33937/fd (opendir: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 47307 root cwd unknown /proc/47307/cwd (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 47307 root rtd unknown /proc/47307/root (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 47307 root txt unknown /proc/47307/exe (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 47307 root NOFD /proc/47307/fd (opendir: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 47309 root cwd unknown /proc/47309/cwd (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 47309 root rtd unknown /proc/47309/root (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 47309 root txt unknown /proc/47309/exe (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 47309 root NOFD /proc/47309/fd (opendir: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 ceph cwd unknown /proc/47311/cwd (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 ceph rtd unknown /proc/47311/root (readlink: Permission denied) 2024-09-10T22:18:55.772 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 ceph txt unknown /proc/47311/exe (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 ceph NOFD /proc/47311/fd (opendir: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47312 log ceph cwd unknown /proc/47311/task/47312/cwd (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47312 log ceph rtd unknown /proc/47311/task/47312/root (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47312 log ceph txt unknown /proc/47311/task/47312/exe (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47312 log ceph NOFD /proc/47311/task/47312/fd (opendir: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47314 msgr-work ceph cwd unknown /proc/47311/task/47314/cwd (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47314 msgr-work ceph rtd unknown /proc/47311/task/47314/root (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47314 msgr-work ceph txt unknown /proc/47311/task/47314/exe (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47314 msgr-work ceph NOFD /proc/47311/task/47314/fd (opendir: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47315 msgr-work ceph cwd unknown /proc/47311/task/47315/cwd (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47315 msgr-work ceph rtd unknown /proc/47311/task/47315/root (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47315 msgr-work ceph txt unknown /proc/47311/task/47315/exe (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47315 msgr-work ceph NOFD /proc/47311/task/47315/fd (opendir: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47316 msgr-work ceph cwd unknown /proc/47311/task/47316/cwd (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47316 msgr-work ceph rtd unknown /proc/47311/task/47316/root (readlink: Permission denied) 2024-09-10T22:18:55.773 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47316 msgr-work ceph txt unknown /proc/47311/task/47316/exe (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47316 msgr-work ceph NOFD /proc/47311/task/47316/fd (opendir: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47320 service ceph cwd unknown /proc/47311/task/47320/cwd (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47320 service ceph rtd unknown /proc/47311/task/47320/root (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47320 service ceph txt unknown /proc/47311/task/47320/exe (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47320 service ceph NOFD /proc/47311/task/47320/fd (opendir: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47321 admin_soc ceph cwd unknown /proc/47311/task/47321/cwd (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47321 admin_soc ceph rtd unknown /proc/47311/task/47321/root (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47321 admin_soc ceph txt unknown /proc/47311/task/47321/exe (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47321 admin_soc ceph NOFD /proc/47311/task/47321/fd (opendir: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47646 signal_ha ceph cwd unknown /proc/47311/task/47646/cwd (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47646 signal_ha ceph rtd unknown /proc/47311/task/47646/root (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47646 signal_ha ceph txt unknown /proc/47311/task/47646/exe (readlink: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47646 signal_ha ceph NOFD /proc/47311/task/47646/fd (opendir: Permission denied) 2024-09-10T22:18:55.774 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47647 io_contex ceph cwd unknown /proc/47311/task/47647/cwd (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47647 io_contex ceph rtd unknown /proc/47311/task/47647/root (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47647 io_contex ceph txt unknown /proc/47311/task/47647/exe (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47647 io_contex ceph NOFD /proc/47311/task/47647/fd (opendir: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47648 io_contex ceph cwd unknown /proc/47311/task/47648/cwd (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47648 io_contex ceph rtd unknown /proc/47311/task/47648/root (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47648 io_contex ceph txt unknown /proc/47311/task/47648/exe (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47648 io_contex ceph NOFD /proc/47311/task/47648/fd (opendir: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47656 OpHistory ceph cwd unknown /proc/47311/task/47656/cwd (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47656 OpHistory ceph rtd unknown /proc/47311/task/47656/root (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47656 OpHistory ceph txt unknown /proc/47311/task/47656/exe (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47656 OpHistory ceph NOFD /proc/47311/task/47656/fd (opendir: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47657 ceph_time ceph cwd unknown /proc/47311/task/47657/cwd (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47657 ceph_time ceph rtd unknown /proc/47311/task/47657/root (readlink: Permission denied) 2024-09-10T22:18:55.775 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47657 ceph_time ceph txt unknown /proc/47311/task/47657/exe (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47657 ceph_time ceph NOFD /proc/47311/task/47657/fd (opendir: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47809 ceph-osd ceph cwd unknown /proc/47311/task/47809/cwd (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47809 ceph-osd ceph rtd unknown /proc/47311/task/47809/root (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47809 ceph-osd ceph txt unknown /proc/47311/task/47809/exe (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47809 ceph-osd ceph NOFD /proc/47311/task/47809/fd (opendir: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47810 safe_time ceph cwd unknown /proc/47311/task/47810/cwd (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47810 safe_time ceph rtd unknown /proc/47311/task/47810/root (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47810 safe_time ceph txt unknown /proc/47311/task/47810/exe (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47810 safe_time ceph NOFD /proc/47311/task/47810/fd (opendir: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47811 safe_time ceph cwd unknown /proc/47311/task/47811/cwd (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47811 safe_time ceph rtd unknown /proc/47311/task/47811/root (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47811 safe_time ceph txt unknown /proc/47311/task/47811/exe (readlink: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47811 safe_time ceph NOFD /proc/47311/task/47811/fd (opendir: Permission denied) 2024-09-10T22:18:55.776 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47812 safe_time ceph cwd unknown /proc/47311/task/47812/cwd (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47812 safe_time ceph rtd unknown /proc/47311/task/47812/root (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47812 safe_time ceph txt unknown /proc/47311/task/47812/exe (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47812 safe_time ceph NOFD /proc/47311/task/47812/fd (opendir: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47813 safe_time ceph cwd unknown /proc/47311/task/47813/cwd (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47813 safe_time ceph rtd unknown /proc/47311/task/47813/root (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47813 safe_time ceph txt unknown /proc/47311/task/47813/exe (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47813 safe_time ceph NOFD /proc/47311/task/47813/fd (opendir: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47814 fn_anonym ceph cwd unknown /proc/47311/task/47814/cwd (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47814 fn_anonym ceph rtd unknown /proc/47311/task/47814/root (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47814 fn_anonym ceph txt unknown /proc/47311/task/47814/exe (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47814 fn_anonym ceph NOFD /proc/47311/task/47814/fd (opendir: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47923 rocksdb:l ceph cwd unknown /proc/47311/task/47923/cwd (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47923 rocksdb:l ceph rtd unknown /proc/47311/task/47923/root (readlink: Permission denied) 2024-09-10T22:18:55.777 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47923 rocksdb:l ceph txt unknown /proc/47311/task/47923/exe (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47923 rocksdb:l ceph NOFD /proc/47311/task/47923/fd (opendir: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47924 rocksdb:l ceph cwd unknown /proc/47311/task/47924/cwd (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47924 rocksdb:l ceph rtd unknown /proc/47311/task/47924/root (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47924 rocksdb:l ceph txt unknown /proc/47311/task/47924/exe (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47924 rocksdb:l ceph NOFD /proc/47311/task/47924/fd (opendir: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47925 rocksdb:l ceph cwd unknown /proc/47311/task/47925/cwd (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47925 rocksdb:l ceph rtd unknown /proc/47311/task/47925/root (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47925 rocksdb:l ceph txt unknown /proc/47311/task/47925/exe (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47925 rocksdb:l ceph NOFD /proc/47311/task/47925/fd (opendir: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47926 rocksdb:h ceph cwd unknown /proc/47311/task/47926/cwd (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47926 rocksdb:h ceph rtd unknown /proc/47311/task/47926/root (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47926 rocksdb:h ceph txt unknown /proc/47311/task/47926/exe (readlink: Permission denied) 2024-09-10T22:18:55.781 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 47926 rocksdb:h ceph NOFD /proc/47311/task/47926/fd (opendir: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48370 bstore_ai ceph cwd unknown /proc/47311/task/48370/cwd (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48370 bstore_ai ceph rtd unknown /proc/47311/task/48370/root (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48370 bstore_ai ceph txt unknown /proc/47311/task/48370/exe (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48370 bstore_ai ceph NOFD /proc/47311/task/48370/fd (opendir: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48558 bstore_ai ceph cwd unknown /proc/47311/task/48558/cwd (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48558 bstore_ai ceph rtd unknown /proc/47311/task/48558/root (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48558 bstore_ai ceph txt unknown /proc/47311/task/48558/exe (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48558 bstore_ai ceph NOFD /proc/47311/task/48558/fd (opendir: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48740 ceph-osd ceph cwd unknown /proc/47311/task/48740/cwd (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48740 ceph-osd ceph rtd unknown /proc/47311/task/48740/root (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48740 ceph-osd ceph txt unknown /proc/47311/task/48740/exe (readlink: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48740 ceph-osd ceph NOFD /proc/47311/task/48740/fd (opendir: Permission denied) 2024-09-10T22:18:55.782 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48741 cfin ceph cwd unknown /proc/47311/task/48741/cwd (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48741 cfin ceph rtd unknown /proc/47311/task/48741/root (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48741 cfin ceph txt unknown /proc/47311/task/48741/exe (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48741 cfin ceph NOFD /proc/47311/task/48741/fd (opendir: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48742 bstore_kv ceph cwd unknown /proc/47311/task/48742/cwd (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48742 bstore_kv ceph rtd unknown /proc/47311/task/48742/root (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48742 bstore_kv ceph txt unknown /proc/47311/task/48742/exe (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48742 bstore_kv ceph NOFD /proc/47311/task/48742/fd (opendir: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48743 bstore_kv ceph cwd unknown /proc/47311/task/48743/cwd (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48743 bstore_kv ceph rtd unknown /proc/47311/task/48743/root (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48743 bstore_kv ceph txt unknown /proc/47311/task/48743/exe (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48743 bstore_kv ceph NOFD /proc/47311/task/48743/fd (opendir: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48744 bstore_me ceph cwd unknown /proc/47311/task/48744/cwd (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48744 bstore_me ceph rtd unknown /proc/47311/task/48744/root (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48744 bstore_me ceph txt unknown /proc/47311/task/48744/exe (readlink: Permission denied) 2024-09-10T22:18:55.783 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48744 bstore_me ceph NOFD /proc/47311/task/48744/fd (opendir: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48745 ms_dispat ceph cwd unknown /proc/47311/task/48745/cwd (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48745 ms_dispat ceph rtd unknown /proc/47311/task/48745/root (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48745 ms_dispat ceph txt unknown /proc/47311/task/48745/exe (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48745 ms_dispat ceph NOFD /proc/47311/task/48745/fd (opendir: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48746 ms_local ceph cwd unknown /proc/47311/task/48746/cwd (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48746 ms_local ceph rtd unknown /proc/47311/task/48746/root (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48746 ms_local ceph txt unknown /proc/47311/task/48746/exe (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48746 ms_local ceph NOFD /proc/47311/task/48746/fd (opendir: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48747 safe_time ceph cwd unknown /proc/47311/task/48747/cwd (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48747 safe_time ceph rtd unknown /proc/47311/task/48747/root (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48747 safe_time ceph txt unknown /proc/47311/task/48747/exe (readlink: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48747 safe_time ceph NOFD /proc/47311/task/48747/fd (opendir: Permission denied) 2024-09-10T22:18:55.784 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48748 safe_time ceph cwd unknown /proc/47311/task/48748/cwd (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48748 safe_time ceph rtd unknown /proc/47311/task/48748/root (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48748 safe_time ceph txt unknown /proc/47311/task/48748/exe (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48748 safe_time ceph NOFD /proc/47311/task/48748/fd (opendir: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48749 ms_dispat ceph cwd unknown /proc/47311/task/48749/cwd (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48749 ms_dispat ceph rtd unknown /proc/47311/task/48749/root (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48749 ms_dispat ceph txt unknown /proc/47311/task/48749/exe (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48749 ms_dispat ceph NOFD /proc/47311/task/48749/fd (opendir: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48750 ms_local ceph cwd unknown /proc/47311/task/48750/cwd (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48750 ms_local ceph rtd unknown /proc/47311/task/48750/root (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48750 ms_local ceph txt unknown /proc/47311/task/48750/exe (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48750 ms_local ceph NOFD /proc/47311/task/48750/fd (opendir: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48751 ms_dispat ceph cwd unknown /proc/47311/task/48751/cwd (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48751 ms_dispat ceph rtd unknown /proc/47311/task/48751/root (readlink: Permission denied) 2024-09-10T22:18:55.785 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48751 ms_dispat ceph txt unknown /proc/47311/task/48751/exe (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48751 ms_dispat ceph NOFD /proc/47311/task/48751/fd (opendir: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48752 ms_local ceph cwd unknown /proc/47311/task/48752/cwd (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48752 ms_local ceph rtd unknown /proc/47311/task/48752/root (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48752 ms_local ceph txt unknown /proc/47311/task/48752/exe (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48752 ms_local ceph NOFD /proc/47311/task/48752/fd (opendir: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48753 ms_dispat ceph cwd unknown /proc/47311/task/48753/cwd (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48753 ms_dispat ceph rtd unknown /proc/47311/task/48753/root (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48753 ms_dispat ceph txt unknown /proc/47311/task/48753/exe (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48753 ms_dispat ceph NOFD /proc/47311/task/48753/fd (opendir: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48754 ms_local ceph cwd unknown /proc/47311/task/48754/cwd (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48754 ms_local ceph rtd unknown /proc/47311/task/48754/root (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48754 ms_local ceph txt unknown /proc/47311/task/48754/exe (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48754 ms_local ceph NOFD /proc/47311/task/48754/fd (opendir: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48755 ms_dispat ceph cwd unknown /proc/47311/task/48755/cwd (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48755 ms_dispat ceph rtd unknown /proc/47311/task/48755/root (readlink: Permission denied) 2024-09-10T22:18:55.786 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48755 ms_dispat ceph txt unknown /proc/47311/task/48755/exe (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48755 ms_dispat ceph NOFD /proc/47311/task/48755/fd (opendir: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48756 ms_local ceph cwd unknown /proc/47311/task/48756/cwd (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48756 ms_local ceph rtd unknown /proc/47311/task/48756/root (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48756 ms_local ceph txt unknown /proc/47311/task/48756/exe (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48756 ms_local ceph NOFD /proc/47311/task/48756/fd (opendir: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48757 ms_dispat ceph cwd unknown /proc/47311/task/48757/cwd (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48757 ms_dispat ceph rtd unknown /proc/47311/task/48757/root (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48757 ms_dispat ceph txt unknown /proc/47311/task/48757/exe (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48757 ms_dispat ceph NOFD /proc/47311/task/48757/fd (opendir: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48758 ms_local ceph cwd unknown /proc/47311/task/48758/cwd (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48758 ms_local ceph rtd unknown /proc/47311/task/48758/root (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48758 ms_local ceph txt unknown /proc/47311/task/48758/exe (readlink: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48758 ms_local ceph NOFD /proc/47311/task/48758/fd (opendir: Permission denied) 2024-09-10T22:18:55.787 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48759 ms_dispat ceph cwd unknown /proc/47311/task/48759/cwd (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48759 ms_dispat ceph rtd unknown /proc/47311/task/48759/root (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48759 ms_dispat ceph txt unknown /proc/47311/task/48759/exe (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48759 ms_dispat ceph NOFD /proc/47311/task/48759/fd (opendir: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48760 ms_local ceph cwd unknown /proc/47311/task/48760/cwd (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48760 ms_local ceph rtd unknown /proc/47311/task/48760/root (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48760 ms_local ceph txt unknown /proc/47311/task/48760/exe (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48760 ms_local ceph NOFD /proc/47311/task/48760/fd (opendir: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48761 fn_anonym ceph cwd unknown /proc/47311/task/48761/cwd (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48761 fn_anonym ceph rtd unknown /proc/47311/task/48761/root (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48761 fn_anonym ceph txt unknown /proc/47311/task/48761/exe (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48761 fn_anonym ceph NOFD /proc/47311/task/48761/fd (opendir: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48762 finisher ceph cwd unknown /proc/47311/task/48762/cwd (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48762 finisher ceph rtd unknown /proc/47311/task/48762/root (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48762 finisher ceph txt unknown /proc/47311/task/48762/exe (readlink: Permission denied) 2024-09-10T22:18:55.788 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48762 finisher ceph NOFD /proc/47311/task/48762/fd (opendir: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48763 safe_time ceph cwd unknown /proc/47311/task/48763/cwd (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48763 safe_time ceph rtd unknown /proc/47311/task/48763/root (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48763 safe_time ceph txt unknown /proc/47311/task/48763/exe (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48763 safe_time ceph NOFD /proc/47311/task/48763/fd (opendir: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48764 safe_time ceph cwd unknown /proc/47311/task/48764/cwd (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48764 safe_time ceph rtd unknown /proc/47311/task/48764/root (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48764 safe_time ceph txt unknown /proc/47311/task/48764/exe (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48764 safe_time ceph NOFD /proc/47311/task/48764/fd (opendir: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48765 ceph-osd ceph cwd unknown /proc/47311/task/48765/cwd (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48765 ceph-osd ceph rtd unknown /proc/47311/task/48765/root (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48765 ceph-osd ceph txt unknown /proc/47311/task/48765/exe (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48765 ceph-osd ceph NOFD /proc/47311/task/48765/fd (opendir: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48766 osd_srv_a ceph cwd unknown /proc/47311/task/48766/cwd (readlink: Permission denied) 2024-09-10T22:18:55.789 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48766 osd_srv_a ceph rtd unknown /proc/47311/task/48766/root (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48766 osd_srv_a ceph txt unknown /proc/47311/task/48766/exe (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48766 osd_srv_a ceph NOFD /proc/47311/task/48766/fd (opendir: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48767 tp_osd_tp ceph cwd unknown /proc/47311/task/48767/cwd (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48767 tp_osd_tp ceph rtd unknown /proc/47311/task/48767/root (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48767 tp_osd_tp ceph txt unknown /proc/47311/task/48767/exe (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48767 tp_osd_tp ceph NOFD /proc/47311/task/48767/fd (opendir: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48768 tp_osd_tp ceph cwd unknown /proc/47311/task/48768/cwd (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48768 tp_osd_tp ceph rtd unknown /proc/47311/task/48768/root (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48768 tp_osd_tp ceph txt unknown /proc/47311/task/48768/exe (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48768 tp_osd_tp ceph NOFD /proc/47311/task/48768/fd (opendir: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48769 tp_osd_tp ceph cwd unknown /proc/47311/task/48769/cwd (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48769 tp_osd_tp ceph rtd unknown /proc/47311/task/48769/root (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48769 tp_osd_tp ceph txt unknown /proc/47311/task/48769/exe (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48769 tp_osd_tp ceph NOFD /proc/47311/task/48769/fd (opendir: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48770 tp_osd_tp ceph cwd unknown /proc/47311/task/48770/cwd (readlink: Permission denied) 2024-09-10T22:18:55.790 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48770 tp_osd_tp ceph rtd unknown /proc/47311/task/48770/root (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48770 tp_osd_tp ceph txt unknown /proc/47311/task/48770/exe (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48770 tp_osd_tp ceph NOFD /proc/47311/task/48770/fd (opendir: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48771 tp_osd_tp ceph cwd unknown /proc/47311/task/48771/cwd (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48771 tp_osd_tp ceph rtd unknown /proc/47311/task/48771/root (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48771 tp_osd_tp ceph txt unknown /proc/47311/task/48771/exe (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48771 tp_osd_tp ceph NOFD /proc/47311/task/48771/fd (opendir: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48772 tp_osd_tp ceph cwd unknown /proc/47311/task/48772/cwd (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48772 tp_osd_tp ceph rtd unknown /proc/47311/task/48772/root (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48772 tp_osd_tp ceph txt unknown /proc/47311/task/48772/exe (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48772 tp_osd_tp ceph NOFD /proc/47311/task/48772/fd (opendir: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48773 tp_osd_tp ceph cwd unknown /proc/47311/task/48773/cwd (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48773 tp_osd_tp ceph rtd unknown /proc/47311/task/48773/root (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48773 tp_osd_tp ceph txt unknown /proc/47311/task/48773/exe (readlink: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48773 tp_osd_tp ceph NOFD /proc/47311/task/48773/fd (opendir: Permission denied) 2024-09-10T22:18:55.791 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48774 tp_osd_tp ceph cwd unknown /proc/47311/task/48774/cwd (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48774 tp_osd_tp ceph rtd unknown /proc/47311/task/48774/root (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48774 tp_osd_tp ceph txt unknown /proc/47311/task/48774/exe (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48774 tp_osd_tp ceph NOFD /proc/47311/task/48774/fd (opendir: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48775 tp_osd_tp ceph cwd unknown /proc/47311/task/48775/cwd (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48775 tp_osd_tp ceph rtd unknown /proc/47311/task/48775/root (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48775 tp_osd_tp ceph txt unknown /proc/47311/task/48775/exe (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48775 tp_osd_tp ceph NOFD /proc/47311/task/48775/fd (opendir: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48776 tp_osd_tp ceph cwd unknown /proc/47311/task/48776/cwd (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48776 tp_osd_tp ceph rtd unknown /proc/47311/task/48776/root (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48776 tp_osd_tp ceph txt unknown /proc/47311/task/48776/exe (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48776 tp_osd_tp ceph NOFD /proc/47311/task/48776/fd (opendir: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48777 tp_osd_tp ceph cwd unknown /proc/47311/task/48777/cwd (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48777 tp_osd_tp ceph rtd unknown /proc/47311/task/48777/root (readlink: Permission denied) 2024-09-10T22:18:55.792 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48777 tp_osd_tp ceph txt unknown /proc/47311/task/48777/exe (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48777 tp_osd_tp ceph NOFD /proc/47311/task/48777/fd (opendir: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48778 tp_osd_tp ceph cwd unknown /proc/47311/task/48778/cwd (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48778 tp_osd_tp ceph rtd unknown /proc/47311/task/48778/root (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48778 tp_osd_tp ceph txt unknown /proc/47311/task/48778/exe (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48778 tp_osd_tp ceph NOFD /proc/47311/task/48778/fd (opendir: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48779 tp_osd_tp ceph cwd unknown /proc/47311/task/48779/cwd (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48779 tp_osd_tp ceph rtd unknown /proc/47311/task/48779/root (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48779 tp_osd_tp ceph txt unknown /proc/47311/task/48779/exe (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48779 tp_osd_tp ceph NOFD /proc/47311/task/48779/fd (opendir: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48780 tp_osd_tp ceph cwd unknown /proc/47311/task/48780/cwd (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48780 tp_osd_tp ceph rtd unknown /proc/47311/task/48780/root (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48780 tp_osd_tp ceph txt unknown /proc/47311/task/48780/exe (readlink: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48780 tp_osd_tp ceph NOFD /proc/47311/task/48780/fd (opendir: Permission denied) 2024-09-10T22:18:55.793 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48781 tp_osd_tp ceph cwd unknown /proc/47311/task/48781/cwd (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48781 tp_osd_tp ceph rtd unknown /proc/47311/task/48781/root (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48781 tp_osd_tp ceph txt unknown /proc/47311/task/48781/exe (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48781 tp_osd_tp ceph NOFD /proc/47311/task/48781/fd (opendir: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48782 tp_osd_tp ceph cwd unknown /proc/47311/task/48782/cwd (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48782 tp_osd_tp ceph rtd unknown /proc/47311/task/48782/root (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48782 tp_osd_tp ceph txt unknown /proc/47311/task/48782/exe (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48782 tp_osd_tp ceph NOFD /proc/47311/task/48782/fd (opendir: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48783 osd_srv_h ceph cwd unknown /proc/47311/task/48783/cwd (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48783 osd_srv_h ceph rtd unknown /proc/47311/task/48783/root (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48783 osd_srv_h ceph txt unknown /proc/47311/task/48783/exe (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 47311 48783 osd_srv_h ceph NOFD /proc/47311/task/48783/fd (opendir: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 48322 root cwd unknown /proc/48322/cwd (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 48322 root rtd unknown /proc/48322/root (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 48322 root txt unknown /proc/48322/exe (readlink: Permission denied) 2024-09-10T22:18:55.794 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 48322 root NOFD /proc/48322/fd (opendir: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 48351 root cwd unknown /proc/48351/cwd (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 48351 root rtd unknown /proc/48351/root (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 48351 root txt unknown /proc/48351/exe (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 48351 root NOFD /proc/48351/fd (opendir: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 52049 root cwd unknown /proc/52049/cwd (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 52049 root rtd unknown /proc/52049/root (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 52049 root txt unknown /proc/52049/exe (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 52049 root NOFD /proc/52049/fd (opendir: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 54182 root cwd unknown /proc/54182/cwd (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 54182 root rtd unknown /proc/54182/root (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 54182 root txt unknown /proc/54182/exe (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 54182 root NOFD /proc/54182/fd (opendir: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 54184 root cwd unknown /proc/54184/cwd (readlink: Permission denied) 2024-09-10T22:18:55.795 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 54184 root rtd unknown /proc/54184/root (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 54184 root txt unknown /proc/54184/exe (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 54184 root NOFD /proc/54184/fd (opendir: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 ceph cwd unknown /proc/54186/cwd (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 ceph rtd unknown /proc/54186/root (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 ceph txt unknown /proc/54186/exe (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 ceph NOFD /proc/54186/fd (opendir: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54187 log ceph cwd unknown /proc/54186/task/54187/cwd (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54187 log ceph rtd unknown /proc/54186/task/54187/root (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54187 log ceph txt unknown /proc/54186/task/54187/exe (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54187 log ceph NOFD /proc/54186/task/54187/fd (opendir: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54189 msgr-work ceph cwd unknown /proc/54186/task/54189/cwd (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54189 msgr-work ceph rtd unknown /proc/54186/task/54189/root (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54189 msgr-work ceph txt unknown /proc/54186/task/54189/exe (readlink: Permission denied) 2024-09-10T22:18:55.796 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54189 msgr-work ceph NOFD /proc/54186/task/54189/fd (opendir: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54190 msgr-work ceph cwd unknown /proc/54186/task/54190/cwd (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54190 msgr-work ceph rtd unknown /proc/54186/task/54190/root (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54190 msgr-work ceph txt unknown /proc/54186/task/54190/exe (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54190 msgr-work ceph NOFD /proc/54186/task/54190/fd (opendir: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54191 msgr-work ceph cwd unknown /proc/54186/task/54191/cwd (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54191 msgr-work ceph rtd unknown /proc/54186/task/54191/root (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54191 msgr-work ceph txt unknown /proc/54186/task/54191/exe (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54191 msgr-work ceph NOFD /proc/54186/task/54191/fd (opendir: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54195 service ceph cwd unknown /proc/54186/task/54195/cwd (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54195 service ceph rtd unknown /proc/54186/task/54195/root (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54195 service ceph txt unknown /proc/54186/task/54195/exe (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54195 service ceph NOFD /proc/54186/task/54195/fd (opendir: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54196 admin_soc ceph cwd unknown /proc/54186/task/54196/cwd (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54196 admin_soc ceph rtd unknown /proc/54186/task/54196/root (readlink: Permission denied) 2024-09-10T22:18:55.797 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54196 admin_soc ceph txt unknown /proc/54186/task/54196/exe (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54196 admin_soc ceph NOFD /proc/54186/task/54196/fd (opendir: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54524 signal_ha ceph cwd unknown /proc/54186/task/54524/cwd (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54524 signal_ha ceph rtd unknown /proc/54186/task/54524/root (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54524 signal_ha ceph txt unknown /proc/54186/task/54524/exe (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54524 signal_ha ceph NOFD /proc/54186/task/54524/fd (opendir: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54525 io_contex ceph cwd unknown /proc/54186/task/54525/cwd (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54525 io_contex ceph rtd unknown /proc/54186/task/54525/root (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54525 io_contex ceph txt unknown /proc/54186/task/54525/exe (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54525 io_contex ceph NOFD /proc/54186/task/54525/fd (opendir: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54526 io_contex ceph cwd unknown /proc/54186/task/54526/cwd (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54526 io_contex ceph rtd unknown /proc/54186/task/54526/root (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54526 io_contex ceph txt unknown /proc/54186/task/54526/exe (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54526 io_contex ceph NOFD /proc/54186/task/54526/fd (opendir: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54547 OpHistory ceph cwd unknown /proc/54186/task/54547/cwd (readlink: Permission denied) 2024-09-10T22:18:55.798 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54547 OpHistory ceph rtd unknown /proc/54186/task/54547/root (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54547 OpHistory ceph txt unknown /proc/54186/task/54547/exe (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54547 OpHistory ceph NOFD /proc/54186/task/54547/fd (opendir: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54548 ceph_time ceph cwd unknown /proc/54186/task/54548/cwd (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54548 ceph_time ceph rtd unknown /proc/54186/task/54548/root (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54548 ceph_time ceph txt unknown /proc/54186/task/54548/exe (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54548 ceph_time ceph NOFD /proc/54186/task/54548/fd (opendir: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54754 ceph-osd ceph cwd unknown /proc/54186/task/54754/cwd (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54754 ceph-osd ceph rtd unknown /proc/54186/task/54754/root (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54754 ceph-osd ceph txt unknown /proc/54186/task/54754/exe (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54754 ceph-osd ceph NOFD /proc/54186/task/54754/fd (opendir: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54756 safe_time ceph cwd unknown /proc/54186/task/54756/cwd (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54756 safe_time ceph rtd unknown /proc/54186/task/54756/root (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54756 safe_time ceph txt unknown /proc/54186/task/54756/exe (readlink: Permission denied) 2024-09-10T22:18:55.799 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54756 safe_time ceph NOFD /proc/54186/task/54756/fd (opendir: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54757 safe_time ceph cwd unknown /proc/54186/task/54757/cwd (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54757 safe_time ceph rtd unknown /proc/54186/task/54757/root (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54757 safe_time ceph txt unknown /proc/54186/task/54757/exe (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54757 safe_time ceph NOFD /proc/54186/task/54757/fd (opendir: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54759 safe_time ceph cwd unknown /proc/54186/task/54759/cwd (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54759 safe_time ceph rtd unknown /proc/54186/task/54759/root (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54759 safe_time ceph txt unknown /proc/54186/task/54759/exe (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54759 safe_time ceph NOFD /proc/54186/task/54759/fd (opendir: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54760 safe_time ceph cwd unknown /proc/54186/task/54760/cwd (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54760 safe_time ceph rtd unknown /proc/54186/task/54760/root (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54760 safe_time ceph txt unknown /proc/54186/task/54760/exe (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54760 safe_time ceph NOFD /proc/54186/task/54760/fd (opendir: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54761 fn_anonym ceph cwd unknown /proc/54186/task/54761/cwd (readlink: Permission denied) 2024-09-10T22:18:55.800 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54761 fn_anonym ceph rtd unknown /proc/54186/task/54761/root (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54761 fn_anonym ceph txt unknown /proc/54186/task/54761/exe (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54761 fn_anonym ceph NOFD /proc/54186/task/54761/fd (opendir: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54880 rocksdb:l ceph cwd unknown /proc/54186/task/54880/cwd (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54880 rocksdb:l ceph rtd unknown /proc/54186/task/54880/root (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54880 rocksdb:l ceph txt unknown /proc/54186/task/54880/exe (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54880 rocksdb:l ceph NOFD /proc/54186/task/54880/fd (opendir: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54881 rocksdb:l ceph cwd unknown /proc/54186/task/54881/cwd (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54881 rocksdb:l ceph rtd unknown /proc/54186/task/54881/root (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54881 rocksdb:l ceph txt unknown /proc/54186/task/54881/exe (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54881 rocksdb:l ceph NOFD /proc/54186/task/54881/fd (opendir: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54882 rocksdb:l ceph cwd unknown /proc/54186/task/54882/cwd (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54882 rocksdb:l ceph rtd unknown /proc/54186/task/54882/root (readlink: Permission denied) 2024-09-10T22:18:55.801 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54882 rocksdb:l ceph txt unknown /proc/54186/task/54882/exe (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54882 rocksdb:l ceph NOFD /proc/54186/task/54882/fd (opendir: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54883 rocksdb:h ceph cwd unknown /proc/54186/task/54883/cwd (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54883 rocksdb:h ceph rtd unknown /proc/54186/task/54883/root (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54883 rocksdb:h ceph txt unknown /proc/54186/task/54883/exe (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 54883 rocksdb:h ceph NOFD /proc/54186/task/54883/fd (opendir: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55297 bstore_ai ceph cwd unknown /proc/54186/task/55297/cwd (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55297 bstore_ai ceph rtd unknown /proc/54186/task/55297/root (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55297 bstore_ai ceph txt unknown /proc/54186/task/55297/exe (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55297 bstore_ai ceph NOFD /proc/54186/task/55297/fd (opendir: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55487 bstore_ai ceph cwd unknown /proc/54186/task/55487/cwd (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55487 bstore_ai ceph rtd unknown /proc/54186/task/55487/root (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55487 bstore_ai ceph txt unknown /proc/54186/task/55487/exe (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55487 bstore_ai ceph NOFD /proc/54186/task/55487/fd (opendir: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55669 ceph-osd ceph cwd unknown /proc/54186/task/55669/cwd (readlink: Permission denied) 2024-09-10T22:18:55.802 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55669 ceph-osd ceph rtd unknown /proc/54186/task/55669/root (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55669 ceph-osd ceph txt unknown /proc/54186/task/55669/exe (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55669 ceph-osd ceph NOFD /proc/54186/task/55669/fd (opendir: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55670 cfin ceph cwd unknown /proc/54186/task/55670/cwd (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55670 cfin ceph rtd unknown /proc/54186/task/55670/root (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55670 cfin ceph txt unknown /proc/54186/task/55670/exe (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55670 cfin ceph NOFD /proc/54186/task/55670/fd (opendir: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55671 bstore_kv ceph cwd unknown /proc/54186/task/55671/cwd (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55671 bstore_kv ceph rtd unknown /proc/54186/task/55671/root (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55671 bstore_kv ceph txt unknown /proc/54186/task/55671/exe (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55671 bstore_kv ceph NOFD /proc/54186/task/55671/fd (opendir: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55672 bstore_kv ceph cwd unknown /proc/54186/task/55672/cwd (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55672 bstore_kv ceph rtd unknown /proc/54186/task/55672/root (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55672 bstore_kv ceph txt unknown /proc/54186/task/55672/exe (readlink: Permission denied) 2024-09-10T22:18:55.803 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55672 bstore_kv ceph NOFD /proc/54186/task/55672/fd (opendir: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55673 bstore_me ceph cwd unknown /proc/54186/task/55673/cwd (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55673 bstore_me ceph rtd unknown /proc/54186/task/55673/root (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55673 bstore_me ceph txt unknown /proc/54186/task/55673/exe (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55673 bstore_me ceph NOFD /proc/54186/task/55673/fd (opendir: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55674 ms_dispat ceph cwd unknown /proc/54186/task/55674/cwd (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55674 ms_dispat ceph rtd unknown /proc/54186/task/55674/root (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55674 ms_dispat ceph txt unknown /proc/54186/task/55674/exe (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55674 ms_dispat ceph NOFD /proc/54186/task/55674/fd (opendir: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55675 ms_local ceph cwd unknown /proc/54186/task/55675/cwd (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55675 ms_local ceph rtd unknown /proc/54186/task/55675/root (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55675 ms_local ceph txt unknown /proc/54186/task/55675/exe (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55675 ms_local ceph NOFD /proc/54186/task/55675/fd (opendir: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55676 safe_time ceph cwd unknown /proc/54186/task/55676/cwd (readlink: Permission denied) 2024-09-10T22:18:55.804 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55676 safe_time ceph rtd unknown /proc/54186/task/55676/root (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55676 safe_time ceph txt unknown /proc/54186/task/55676/exe (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55676 safe_time ceph NOFD /proc/54186/task/55676/fd (opendir: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55677 safe_time ceph cwd unknown /proc/54186/task/55677/cwd (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55677 safe_time ceph rtd unknown /proc/54186/task/55677/root (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55677 safe_time ceph txt unknown /proc/54186/task/55677/exe (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55677 safe_time ceph NOFD /proc/54186/task/55677/fd (opendir: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55678 ms_dispat ceph cwd unknown /proc/54186/task/55678/cwd (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55678 ms_dispat ceph rtd unknown /proc/54186/task/55678/root (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55678 ms_dispat ceph txt unknown /proc/54186/task/55678/exe (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55678 ms_dispat ceph NOFD /proc/54186/task/55678/fd (opendir: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55679 ms_local ceph cwd unknown /proc/54186/task/55679/cwd (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55679 ms_local ceph rtd unknown /proc/54186/task/55679/root (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55679 ms_local ceph txt unknown /proc/54186/task/55679/exe (readlink: Permission denied) 2024-09-10T22:18:55.805 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55679 ms_local ceph NOFD /proc/54186/task/55679/fd (opendir: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55680 ms_dispat ceph cwd unknown /proc/54186/task/55680/cwd (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55680 ms_dispat ceph rtd unknown /proc/54186/task/55680/root (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55680 ms_dispat ceph txt unknown /proc/54186/task/55680/exe (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55680 ms_dispat ceph NOFD /proc/54186/task/55680/fd (opendir: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55681 ms_local ceph cwd unknown /proc/54186/task/55681/cwd (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55681 ms_local ceph rtd unknown /proc/54186/task/55681/root (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55681 ms_local ceph txt unknown /proc/54186/task/55681/exe (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55681 ms_local ceph NOFD /proc/54186/task/55681/fd (opendir: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55682 ms_dispat ceph cwd unknown /proc/54186/task/55682/cwd (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55682 ms_dispat ceph rtd unknown /proc/54186/task/55682/root (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55682 ms_dispat ceph txt unknown /proc/54186/task/55682/exe (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55682 ms_dispat ceph NOFD /proc/54186/task/55682/fd (opendir: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55683 ms_local ceph cwd unknown /proc/54186/task/55683/cwd (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55683 ms_local ceph rtd unknown /proc/54186/task/55683/root (readlink: Permission denied) 2024-09-10T22:18:55.806 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55683 ms_local ceph txt unknown /proc/54186/task/55683/exe (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55683 ms_local ceph NOFD /proc/54186/task/55683/fd (opendir: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55684 ms_dispat ceph cwd unknown /proc/54186/task/55684/cwd (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55684 ms_dispat ceph rtd unknown /proc/54186/task/55684/root (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55684 ms_dispat ceph txt unknown /proc/54186/task/55684/exe (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55684 ms_dispat ceph NOFD /proc/54186/task/55684/fd (opendir: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55685 ms_local ceph cwd unknown /proc/54186/task/55685/cwd (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55685 ms_local ceph rtd unknown /proc/54186/task/55685/root (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55685 ms_local ceph txt unknown /proc/54186/task/55685/exe (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55685 ms_local ceph NOFD /proc/54186/task/55685/fd (opendir: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55686 ms_dispat ceph cwd unknown /proc/54186/task/55686/cwd (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55686 ms_dispat ceph rtd unknown /proc/54186/task/55686/root (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55686 ms_dispat ceph txt unknown /proc/54186/task/55686/exe (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55686 ms_dispat ceph NOFD /proc/54186/task/55686/fd (opendir: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55687 ms_local ceph cwd unknown /proc/54186/task/55687/cwd (readlink: Permission denied) 2024-09-10T22:18:55.807 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55687 ms_local ceph rtd unknown /proc/54186/task/55687/root (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55687 ms_local ceph txt unknown /proc/54186/task/55687/exe (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55687 ms_local ceph NOFD /proc/54186/task/55687/fd (opendir: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55688 ms_dispat ceph cwd unknown /proc/54186/task/55688/cwd (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55688 ms_dispat ceph rtd unknown /proc/54186/task/55688/root (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55688 ms_dispat ceph txt unknown /proc/54186/task/55688/exe (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55688 ms_dispat ceph NOFD /proc/54186/task/55688/fd (opendir: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55689 ms_local ceph cwd unknown /proc/54186/task/55689/cwd (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55689 ms_local ceph rtd unknown /proc/54186/task/55689/root (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55689 ms_local ceph txt unknown /proc/54186/task/55689/exe (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55689 ms_local ceph NOFD /proc/54186/task/55689/fd (opendir: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55690 fn_anonym ceph cwd unknown /proc/54186/task/55690/cwd (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55690 fn_anonym ceph rtd unknown /proc/54186/task/55690/root (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55690 fn_anonym ceph txt unknown /proc/54186/task/55690/exe (readlink: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55690 fn_anonym ceph NOFD /proc/54186/task/55690/fd (opendir: Permission denied) 2024-09-10T22:18:55.808 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55691 finisher ceph cwd unknown /proc/54186/task/55691/cwd (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55691 finisher ceph rtd unknown /proc/54186/task/55691/root (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55691 finisher ceph txt unknown /proc/54186/task/55691/exe (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55691 finisher ceph NOFD /proc/54186/task/55691/fd (opendir: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55692 safe_time ceph cwd unknown /proc/54186/task/55692/cwd (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55692 safe_time ceph rtd unknown /proc/54186/task/55692/root (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55692 safe_time ceph txt unknown /proc/54186/task/55692/exe (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55692 safe_time ceph NOFD /proc/54186/task/55692/fd (opendir: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55693 safe_time ceph cwd unknown /proc/54186/task/55693/cwd (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55693 safe_time ceph rtd unknown /proc/54186/task/55693/root (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55693 safe_time ceph txt unknown /proc/54186/task/55693/exe (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55693 safe_time ceph NOFD /proc/54186/task/55693/fd (opendir: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55694 ceph-osd ceph cwd unknown /proc/54186/task/55694/cwd (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55694 ceph-osd ceph rtd unknown /proc/54186/task/55694/root (readlink: Permission denied) 2024-09-10T22:18:55.809 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55694 ceph-osd ceph txt unknown /proc/54186/task/55694/exe (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55694 ceph-osd ceph NOFD /proc/54186/task/55694/fd (opendir: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55695 osd_srv_a ceph cwd unknown /proc/54186/task/55695/cwd (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55695 osd_srv_a ceph rtd unknown /proc/54186/task/55695/root (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55695 osd_srv_a ceph txt unknown /proc/54186/task/55695/exe (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55695 osd_srv_a ceph NOFD /proc/54186/task/55695/fd (opendir: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55696 tp_osd_tp ceph cwd unknown /proc/54186/task/55696/cwd (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55696 tp_osd_tp ceph rtd unknown /proc/54186/task/55696/root (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55696 tp_osd_tp ceph txt unknown /proc/54186/task/55696/exe (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55696 tp_osd_tp ceph NOFD /proc/54186/task/55696/fd (opendir: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55697 tp_osd_tp ceph cwd unknown /proc/54186/task/55697/cwd (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55697 tp_osd_tp ceph rtd unknown /proc/54186/task/55697/root (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55697 tp_osd_tp ceph txt unknown /proc/54186/task/55697/exe (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55697 tp_osd_tp ceph NOFD /proc/54186/task/55697/fd (opendir: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55698 tp_osd_tp ceph cwd unknown /proc/54186/task/55698/cwd (readlink: Permission denied) 2024-09-10T22:18:55.810 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55698 tp_osd_tp ceph rtd unknown /proc/54186/task/55698/root (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55698 tp_osd_tp ceph txt unknown /proc/54186/task/55698/exe (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55698 tp_osd_tp ceph NOFD /proc/54186/task/55698/fd (opendir: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55699 tp_osd_tp ceph cwd unknown /proc/54186/task/55699/cwd (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55699 tp_osd_tp ceph rtd unknown /proc/54186/task/55699/root (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55699 tp_osd_tp ceph txt unknown /proc/54186/task/55699/exe (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55699 tp_osd_tp ceph NOFD /proc/54186/task/55699/fd (opendir: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55700 tp_osd_tp ceph cwd unknown /proc/54186/task/55700/cwd (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55700 tp_osd_tp ceph rtd unknown /proc/54186/task/55700/root (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55700 tp_osd_tp ceph txt unknown /proc/54186/task/55700/exe (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55700 tp_osd_tp ceph NOFD /proc/54186/task/55700/fd (opendir: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55701 tp_osd_tp ceph cwd unknown /proc/54186/task/55701/cwd (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55701 tp_osd_tp ceph rtd unknown /proc/54186/task/55701/root (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55701 tp_osd_tp ceph txt unknown /proc/54186/task/55701/exe (readlink: Permission denied) 2024-09-10T22:18:55.811 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55701 tp_osd_tp ceph NOFD /proc/54186/task/55701/fd (opendir: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55702 tp_osd_tp ceph cwd unknown /proc/54186/task/55702/cwd (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55702 tp_osd_tp ceph rtd unknown /proc/54186/task/55702/root (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55702 tp_osd_tp ceph txt unknown /proc/54186/task/55702/exe (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55702 tp_osd_tp ceph NOFD /proc/54186/task/55702/fd (opendir: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55703 tp_osd_tp ceph cwd unknown /proc/54186/task/55703/cwd (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55703 tp_osd_tp ceph rtd unknown /proc/54186/task/55703/root (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55703 tp_osd_tp ceph txt unknown /proc/54186/task/55703/exe (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55703 tp_osd_tp ceph NOFD /proc/54186/task/55703/fd (opendir: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55704 tp_osd_tp ceph cwd unknown /proc/54186/task/55704/cwd (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55704 tp_osd_tp ceph rtd unknown /proc/54186/task/55704/root (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55704 tp_osd_tp ceph txt unknown /proc/54186/task/55704/exe (readlink: Permission denied) 2024-09-10T22:18:55.812 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55704 tp_osd_tp ceph NOFD /proc/54186/task/55704/fd (opendir: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55705 tp_osd_tp ceph cwd unknown /proc/54186/task/55705/cwd (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55705 tp_osd_tp ceph rtd unknown /proc/54186/task/55705/root (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55705 tp_osd_tp ceph txt unknown /proc/54186/task/55705/exe (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55705 tp_osd_tp ceph NOFD /proc/54186/task/55705/fd (opendir: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55706 tp_osd_tp ceph cwd unknown /proc/54186/task/55706/cwd (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55706 tp_osd_tp ceph rtd unknown /proc/54186/task/55706/root (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55706 tp_osd_tp ceph txt unknown /proc/54186/task/55706/exe (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55706 tp_osd_tp ceph NOFD /proc/54186/task/55706/fd (opendir: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55707 tp_osd_tp ceph cwd unknown /proc/54186/task/55707/cwd (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55707 tp_osd_tp ceph rtd unknown /proc/54186/task/55707/root (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55707 tp_osd_tp ceph txt unknown /proc/54186/task/55707/exe (readlink: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55707 tp_osd_tp ceph NOFD /proc/54186/task/55707/fd (opendir: Permission denied) 2024-09-10T22:18:55.813 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55708 tp_osd_tp ceph cwd unknown /proc/54186/task/55708/cwd (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55708 tp_osd_tp ceph rtd unknown /proc/54186/task/55708/root (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55708 tp_osd_tp ceph txt unknown /proc/54186/task/55708/exe (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55708 tp_osd_tp ceph NOFD /proc/54186/task/55708/fd (opendir: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55709 tp_osd_tp ceph cwd unknown /proc/54186/task/55709/cwd (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55709 tp_osd_tp ceph rtd unknown /proc/54186/task/55709/root (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55709 tp_osd_tp ceph txt unknown /proc/54186/task/55709/exe (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55709 tp_osd_tp ceph NOFD /proc/54186/task/55709/fd (opendir: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55710 tp_osd_tp ceph cwd unknown /proc/54186/task/55710/cwd (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55710 tp_osd_tp ceph rtd unknown /proc/54186/task/55710/root (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55710 tp_osd_tp ceph txt unknown /proc/54186/task/55710/exe (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55710 tp_osd_tp ceph NOFD /proc/54186/task/55710/fd (opendir: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55711 tp_osd_tp ceph cwd unknown /proc/54186/task/55711/cwd (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55711 tp_osd_tp ceph rtd unknown /proc/54186/task/55711/root (readlink: Permission denied) 2024-09-10T22:18:55.814 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55711 tp_osd_tp ceph txt unknown /proc/54186/task/55711/exe (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55711 tp_osd_tp ceph NOFD /proc/54186/task/55711/fd (opendir: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55712 osd_srv_h ceph cwd unknown /proc/54186/task/55712/cwd (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55712 osd_srv_h ceph rtd unknown /proc/54186/task/55712/root (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55712 osd_srv_h ceph txt unknown /proc/54186/task/55712/exe (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 54186 55712 osd_srv_h ceph NOFD /proc/54186/task/55712/fd (opendir: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 54522 root cwd unknown /proc/54522/cwd (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 54522 root rtd unknown /proc/54522/root (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 54522 root txt unknown /proc/54522/exe (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 54522 root NOFD /proc/54522/fd (opendir: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 54817 root cwd unknown /proc/54817/cwd (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 54817 root rtd unknown /proc/54817/root (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 54817 root txt unknown /proc/54817/exe (readlink: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 54817 root NOFD /proc/54817/fd (opendir: Permission denied) 2024-09-10T22:18:55.815 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 54834 root cwd unknown /proc/54834/cwd (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 54834 root rtd unknown /proc/54834/root (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 54834 root txt unknown /proc/54834/exe (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 54834 root NOFD /proc/54834/fd (opendir: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 58383 root cwd unknown /proc/58383/cwd (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 58383 root rtd unknown /proc/58383/root (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 58383 root txt unknown /proc/58383/exe (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/2 58383 root NOFD /proc/58383/fd (opendir: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 58677 root cwd unknown /proc/58677/cwd (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 58677 root rtd unknown /proc/58677/root (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 58677 root txt unknown /proc/58677/exe (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 58677 root NOFD /proc/58677/fd (opendir: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 60236 root cwd unknown /proc/60236/cwd (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 60236 root rtd unknown /proc/60236/root (readlink: Permission denied) 2024-09-10T22:18:55.816 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 60236 root txt unknown /proc/60236/exe (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 60236 root NOFD /proc/60236/fd (opendir: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 60521 root cwd unknown /proc/60521/cwd (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 60521 root rtd unknown /proc/60521/root (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 60521 root txt unknown /proc/60521/exe (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/3 60521 root NOFD /proc/60521/fd (opendir: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 61065 root cwd unknown /proc/61065/cwd (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 61065 root rtd unknown /proc/61065/root (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 61065 root txt unknown /proc/61065/exe (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 61065 root NOFD /proc/61065/fd (opendir: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 61067 root cwd unknown /proc/61067/cwd (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 61067 root rtd unknown /proc/61067/root (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 61067 root txt unknown /proc/61067/exe (readlink: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 61067 root NOFD /proc/61067/fd (opendir: Permission denied) 2024-09-10T22:18:55.817 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 ceph cwd unknown /proc/61069/cwd (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 ceph rtd unknown /proc/61069/root (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 ceph txt unknown /proc/61069/exe (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 ceph NOFD /proc/61069/fd (opendir: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61070 log ceph cwd unknown /proc/61069/task/61070/cwd (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61070 log ceph rtd unknown /proc/61069/task/61070/root (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61070 log ceph txt unknown /proc/61069/task/61070/exe (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61070 log ceph NOFD /proc/61069/task/61070/fd (opendir: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61072 msgr-work ceph cwd unknown /proc/61069/task/61072/cwd (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61072 msgr-work ceph rtd unknown /proc/61069/task/61072/root (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61072 msgr-work ceph txt unknown /proc/61069/task/61072/exe (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61072 msgr-work ceph NOFD /proc/61069/task/61072/fd (opendir: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61073 msgr-work ceph cwd unknown /proc/61069/task/61073/cwd (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61073 msgr-work ceph rtd unknown /proc/61069/task/61073/root (readlink: Permission denied) 2024-09-10T22:18:55.818 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61073 msgr-work ceph txt unknown /proc/61069/task/61073/exe (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61073 msgr-work ceph NOFD /proc/61069/task/61073/fd (opendir: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61074 msgr-work ceph cwd unknown /proc/61069/task/61074/cwd (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61074 msgr-work ceph rtd unknown /proc/61069/task/61074/root (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61074 msgr-work ceph txt unknown /proc/61069/task/61074/exe (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61074 msgr-work ceph NOFD /proc/61069/task/61074/fd (opendir: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61078 service ceph cwd unknown /proc/61069/task/61078/cwd (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61078 service ceph rtd unknown /proc/61069/task/61078/root (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61078 service ceph txt unknown /proc/61069/task/61078/exe (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61078 service ceph NOFD /proc/61069/task/61078/fd (opendir: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61079 admin_soc ceph cwd unknown /proc/61069/task/61079/cwd (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61079 admin_soc ceph rtd unknown /proc/61069/task/61079/root (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61079 admin_soc ceph txt unknown /proc/61069/task/61079/exe (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61079 admin_soc ceph NOFD /proc/61069/task/61079/fd (opendir: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61388 signal_ha ceph cwd unknown /proc/61069/task/61388/cwd (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61388 signal_ha ceph rtd unknown /proc/61069/task/61388/root (readlink: Permission denied) 2024-09-10T22:18:55.819 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61388 signal_ha ceph txt unknown /proc/61069/task/61388/exe (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61388 signal_ha ceph NOFD /proc/61069/task/61388/fd (opendir: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61389 io_contex ceph cwd unknown /proc/61069/task/61389/cwd (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61389 io_contex ceph rtd unknown /proc/61069/task/61389/root (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61389 io_contex ceph txt unknown /proc/61069/task/61389/exe (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61389 io_contex ceph NOFD /proc/61069/task/61389/fd (opendir: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61390 io_contex ceph cwd unknown /proc/61069/task/61390/cwd (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61390 io_contex ceph rtd unknown /proc/61069/task/61390/root (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61390 io_contex ceph txt unknown /proc/61069/task/61390/exe (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61390 io_contex ceph NOFD /proc/61069/task/61390/fd (opendir: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61414 OpHistory ceph cwd unknown /proc/61069/task/61414/cwd (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61414 OpHistory ceph rtd unknown /proc/61069/task/61414/root (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61414 OpHistory ceph txt unknown /proc/61069/task/61414/exe (readlink: Permission denied) 2024-09-10T22:18:55.820 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61414 OpHistory ceph NOFD /proc/61069/task/61414/fd (opendir: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61415 ceph_time ceph cwd unknown /proc/61069/task/61415/cwd (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61415 ceph_time ceph rtd unknown /proc/61069/task/61415/root (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61415 ceph_time ceph txt unknown /proc/61069/task/61415/exe (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61415 ceph_time ceph NOFD /proc/61069/task/61415/fd (opendir: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61607 ceph-osd ceph cwd unknown /proc/61069/task/61607/cwd (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61607 ceph-osd ceph rtd unknown /proc/61069/task/61607/root (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61607 ceph-osd ceph txt unknown /proc/61069/task/61607/exe (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61607 ceph-osd ceph NOFD /proc/61069/task/61607/fd (opendir: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61608 safe_time ceph cwd unknown /proc/61069/task/61608/cwd (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61608 safe_time ceph rtd unknown /proc/61069/task/61608/root (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61608 safe_time ceph txt unknown /proc/61069/task/61608/exe (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61608 safe_time ceph NOFD /proc/61069/task/61608/fd (opendir: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61610 safe_time ceph cwd unknown /proc/61069/task/61610/cwd (readlink: Permission denied) 2024-09-10T22:18:55.821 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61610 safe_time ceph rtd unknown /proc/61069/task/61610/root (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61610 safe_time ceph txt unknown /proc/61069/task/61610/exe (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61610 safe_time ceph NOFD /proc/61069/task/61610/fd (opendir: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61611 safe_time ceph cwd unknown /proc/61069/task/61611/cwd (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61611 safe_time ceph rtd unknown /proc/61069/task/61611/root (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61611 safe_time ceph txt unknown /proc/61069/task/61611/exe (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61611 safe_time ceph NOFD /proc/61069/task/61611/fd (opendir: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61612 safe_time ceph cwd unknown /proc/61069/task/61612/cwd (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61612 safe_time ceph rtd unknown /proc/61069/task/61612/root (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61612 safe_time ceph txt unknown /proc/61069/task/61612/exe (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61612 safe_time ceph NOFD /proc/61069/task/61612/fd (opendir: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61613 fn_anonym ceph cwd unknown /proc/61069/task/61613/cwd (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61613 fn_anonym ceph rtd unknown /proc/61069/task/61613/root (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61613 fn_anonym ceph txt unknown /proc/61069/task/61613/exe (readlink: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61613 fn_anonym ceph NOFD /proc/61069/task/61613/fd (opendir: Permission denied) 2024-09-10T22:18:55.822 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61741 rocksdb:l ceph cwd unknown /proc/61069/task/61741/cwd (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61741 rocksdb:l ceph rtd unknown /proc/61069/task/61741/root (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61741 rocksdb:l ceph txt unknown /proc/61069/task/61741/exe (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61741 rocksdb:l ceph NOFD /proc/61069/task/61741/fd (opendir: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61742 rocksdb:l ceph cwd unknown /proc/61069/task/61742/cwd (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61742 rocksdb:l ceph rtd unknown /proc/61069/task/61742/root (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61742 rocksdb:l ceph txt unknown /proc/61069/task/61742/exe (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61742 rocksdb:l ceph NOFD /proc/61069/task/61742/fd (opendir: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61743 rocksdb:l ceph cwd unknown /proc/61069/task/61743/cwd (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61743 rocksdb:l ceph rtd unknown /proc/61069/task/61743/root (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61743 rocksdb:l ceph txt unknown /proc/61069/task/61743/exe (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61743 rocksdb:l ceph NOFD /proc/61069/task/61743/fd (opendir: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61744 rocksdb:h ceph cwd unknown /proc/61069/task/61744/cwd (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61744 rocksdb:h ceph rtd unknown /proc/61069/task/61744/root (readlink: Permission denied) 2024-09-10T22:18:55.823 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61744 rocksdb:h ceph txt unknown /proc/61069/task/61744/exe (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 61744 rocksdb:h ceph NOFD /proc/61069/task/61744/fd (opendir: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62176 bstore_ai ceph cwd unknown /proc/61069/task/62176/cwd (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62176 bstore_ai ceph rtd unknown /proc/61069/task/62176/root (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62176 bstore_ai ceph txt unknown /proc/61069/task/62176/exe (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62176 bstore_ai ceph NOFD /proc/61069/task/62176/fd (opendir: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62363 bstore_ai ceph cwd unknown /proc/61069/task/62363/cwd (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62363 bstore_ai ceph rtd unknown /proc/61069/task/62363/root (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62363 bstore_ai ceph txt unknown /proc/61069/task/62363/exe (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62363 bstore_ai ceph NOFD /proc/61069/task/62363/fd (opendir: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62550 ceph-osd ceph cwd unknown /proc/61069/task/62550/cwd (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62550 ceph-osd ceph rtd unknown /proc/61069/task/62550/root (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62550 ceph-osd ceph txt unknown /proc/61069/task/62550/exe (readlink: Permission denied) 2024-09-10T22:18:55.824 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62550 ceph-osd ceph NOFD /proc/61069/task/62550/fd (opendir: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62551 cfin ceph cwd unknown /proc/61069/task/62551/cwd (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62551 cfin ceph rtd unknown /proc/61069/task/62551/root (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62551 cfin ceph txt unknown /proc/61069/task/62551/exe (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62551 cfin ceph NOFD /proc/61069/task/62551/fd (opendir: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62552 bstore_kv ceph cwd unknown /proc/61069/task/62552/cwd (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62552 bstore_kv ceph rtd unknown /proc/61069/task/62552/root (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62552 bstore_kv ceph txt unknown /proc/61069/task/62552/exe (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62552 bstore_kv ceph NOFD /proc/61069/task/62552/fd (opendir: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62553 bstore_kv ceph cwd unknown /proc/61069/task/62553/cwd (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62553 bstore_kv ceph rtd unknown /proc/61069/task/62553/root (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62553 bstore_kv ceph txt unknown /proc/61069/task/62553/exe (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62553 bstore_kv ceph NOFD /proc/61069/task/62553/fd (opendir: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62554 bstore_me ceph cwd unknown /proc/61069/task/62554/cwd (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62554 bstore_me ceph rtd unknown /proc/61069/task/62554/root (readlink: Permission denied) 2024-09-10T22:18:55.825 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62554 bstore_me ceph txt unknown /proc/61069/task/62554/exe (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62554 bstore_me ceph NOFD /proc/61069/task/62554/fd (opendir: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62562 ms_dispat ceph cwd unknown /proc/61069/task/62562/cwd (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62562 ms_dispat ceph rtd unknown /proc/61069/task/62562/root (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62562 ms_dispat ceph txt unknown /proc/61069/task/62562/exe (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62562 ms_dispat ceph NOFD /proc/61069/task/62562/fd (opendir: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62563 ms_local ceph cwd unknown /proc/61069/task/62563/cwd (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62563 ms_local ceph rtd unknown /proc/61069/task/62563/root (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62563 ms_local ceph txt unknown /proc/61069/task/62563/exe (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62563 ms_local ceph NOFD /proc/61069/task/62563/fd (opendir: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62564 safe_time ceph cwd unknown /proc/61069/task/62564/cwd (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62564 safe_time ceph rtd unknown /proc/61069/task/62564/root (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62564 safe_time ceph txt unknown /proc/61069/task/62564/exe (readlink: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62564 safe_time ceph NOFD /proc/61069/task/62564/fd (opendir: Permission denied) 2024-09-10T22:18:55.826 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62565 safe_time ceph cwd unknown /proc/61069/task/62565/cwd (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62565 safe_time ceph rtd unknown /proc/61069/task/62565/root (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62565 safe_time ceph txt unknown /proc/61069/task/62565/exe (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62565 safe_time ceph NOFD /proc/61069/task/62565/fd (opendir: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62566 ms_dispat ceph cwd unknown /proc/61069/task/62566/cwd (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62566 ms_dispat ceph rtd unknown /proc/61069/task/62566/root (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62566 ms_dispat ceph txt unknown /proc/61069/task/62566/exe (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62566 ms_dispat ceph NOFD /proc/61069/task/62566/fd (opendir: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62567 ms_local ceph cwd unknown /proc/61069/task/62567/cwd (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62567 ms_local ceph rtd unknown /proc/61069/task/62567/root (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62567 ms_local ceph txt unknown /proc/61069/task/62567/exe (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62567 ms_local ceph NOFD /proc/61069/task/62567/fd (opendir: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62568 ms_dispat ceph cwd unknown /proc/61069/task/62568/cwd (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62568 ms_dispat ceph rtd unknown /proc/61069/task/62568/root (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62568 ms_dispat ceph txt unknown /proc/61069/task/62568/exe (readlink: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62568 ms_dispat ceph NOFD /proc/61069/task/62568/fd (opendir: Permission denied) 2024-09-10T22:18:55.827 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62569 ms_local ceph cwd unknown /proc/61069/task/62569/cwd (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62569 ms_local ceph rtd unknown /proc/61069/task/62569/root (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62569 ms_local ceph txt unknown /proc/61069/task/62569/exe (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62569 ms_local ceph NOFD /proc/61069/task/62569/fd (opendir: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62570 ms_dispat ceph cwd unknown /proc/61069/task/62570/cwd (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62570 ms_dispat ceph rtd unknown /proc/61069/task/62570/root (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62570 ms_dispat ceph txt unknown /proc/61069/task/62570/exe (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62570 ms_dispat ceph NOFD /proc/61069/task/62570/fd (opendir: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62571 ms_local ceph cwd unknown /proc/61069/task/62571/cwd (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62571 ms_local ceph rtd unknown /proc/61069/task/62571/root (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62571 ms_local ceph txt unknown /proc/61069/task/62571/exe (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62571 ms_local ceph NOFD /proc/61069/task/62571/fd (opendir: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62572 ms_dispat ceph cwd unknown /proc/61069/task/62572/cwd (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62572 ms_dispat ceph rtd unknown /proc/61069/task/62572/root (readlink: Permission denied) 2024-09-10T22:18:55.828 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62572 ms_dispat ceph txt unknown /proc/61069/task/62572/exe (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62572 ms_dispat ceph NOFD /proc/61069/task/62572/fd (opendir: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62573 ms_local ceph cwd unknown /proc/61069/task/62573/cwd (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62573 ms_local ceph rtd unknown /proc/61069/task/62573/root (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62573 ms_local ceph txt unknown /proc/61069/task/62573/exe (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62573 ms_local ceph NOFD /proc/61069/task/62573/fd (opendir: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62575 ms_dispat ceph cwd unknown /proc/61069/task/62575/cwd (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62575 ms_dispat ceph rtd unknown /proc/61069/task/62575/root (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62575 ms_dispat ceph txt unknown /proc/61069/task/62575/exe (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62575 ms_dispat ceph NOFD /proc/61069/task/62575/fd (opendir: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62576 ms_local ceph cwd unknown /proc/61069/task/62576/cwd (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62576 ms_local ceph rtd unknown /proc/61069/task/62576/root (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62576 ms_local ceph txt unknown /proc/61069/task/62576/exe (readlink: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62576 ms_local ceph NOFD /proc/61069/task/62576/fd (opendir: Permission denied) 2024-09-10T22:18:55.829 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62577 ms_dispat ceph cwd unknown /proc/61069/task/62577/cwd (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62577 ms_dispat ceph rtd unknown /proc/61069/task/62577/root (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62577 ms_dispat ceph txt unknown /proc/61069/task/62577/exe (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62577 ms_dispat ceph NOFD /proc/61069/task/62577/fd (opendir: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62579 ms_local ceph cwd unknown /proc/61069/task/62579/cwd (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62579 ms_local ceph rtd unknown /proc/61069/task/62579/root (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62579 ms_local ceph txt unknown /proc/61069/task/62579/exe (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62579 ms_local ceph NOFD /proc/61069/task/62579/fd (opendir: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62580 fn_anonym ceph cwd unknown /proc/61069/task/62580/cwd (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62580 fn_anonym ceph rtd unknown /proc/61069/task/62580/root (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62580 fn_anonym ceph txt unknown /proc/61069/task/62580/exe (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62580 fn_anonym ceph NOFD /proc/61069/task/62580/fd (opendir: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62581 finisher ceph cwd unknown /proc/61069/task/62581/cwd (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62581 finisher ceph rtd unknown /proc/61069/task/62581/root (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62581 finisher ceph txt unknown /proc/61069/task/62581/exe (readlink: Permission denied) 2024-09-10T22:18:55.830 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62581 finisher ceph NOFD /proc/61069/task/62581/fd (opendir: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62582 safe_time ceph cwd unknown /proc/61069/task/62582/cwd (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62582 safe_time ceph rtd unknown /proc/61069/task/62582/root (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62582 safe_time ceph txt unknown /proc/61069/task/62582/exe (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62582 safe_time ceph NOFD /proc/61069/task/62582/fd (opendir: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62583 safe_time ceph cwd unknown /proc/61069/task/62583/cwd (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62583 safe_time ceph rtd unknown /proc/61069/task/62583/root (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62583 safe_time ceph txt unknown /proc/61069/task/62583/exe (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62583 safe_time ceph NOFD /proc/61069/task/62583/fd (opendir: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62584 ceph-osd ceph cwd unknown /proc/61069/task/62584/cwd (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62584 ceph-osd ceph rtd unknown /proc/61069/task/62584/root (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62584 ceph-osd ceph txt unknown /proc/61069/task/62584/exe (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62584 ceph-osd ceph NOFD /proc/61069/task/62584/fd (opendir: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62585 osd_srv_a ceph cwd unknown /proc/61069/task/62585/cwd (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62585 osd_srv_a ceph rtd unknown /proc/61069/task/62585/root (readlink: Permission denied) 2024-09-10T22:18:55.831 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62585 osd_srv_a ceph txt unknown /proc/61069/task/62585/exe (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62585 osd_srv_a ceph NOFD /proc/61069/task/62585/fd (opendir: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62586 tp_osd_tp ceph cwd unknown /proc/61069/task/62586/cwd (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62586 tp_osd_tp ceph rtd unknown /proc/61069/task/62586/root (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62586 tp_osd_tp ceph txt unknown /proc/61069/task/62586/exe (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62586 tp_osd_tp ceph NOFD /proc/61069/task/62586/fd (opendir: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62587 tp_osd_tp ceph cwd unknown /proc/61069/task/62587/cwd (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62587 tp_osd_tp ceph rtd unknown /proc/61069/task/62587/root (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62587 tp_osd_tp ceph txt unknown /proc/61069/task/62587/exe (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62587 tp_osd_tp ceph NOFD /proc/61069/task/62587/fd (opendir: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62588 tp_osd_tp ceph cwd unknown /proc/61069/task/62588/cwd (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62588 tp_osd_tp ceph rtd unknown /proc/61069/task/62588/root (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62588 tp_osd_tp ceph txt unknown /proc/61069/task/62588/exe (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62588 tp_osd_tp ceph NOFD /proc/61069/task/62588/fd (opendir: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62589 tp_osd_tp ceph cwd unknown /proc/61069/task/62589/cwd (readlink: Permission denied) 2024-09-10T22:18:55.832 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62589 tp_osd_tp ceph rtd unknown /proc/61069/task/62589/root (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62589 tp_osd_tp ceph txt unknown /proc/61069/task/62589/exe (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62589 tp_osd_tp ceph NOFD /proc/61069/task/62589/fd (opendir: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62590 tp_osd_tp ceph cwd unknown /proc/61069/task/62590/cwd (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62590 tp_osd_tp ceph rtd unknown /proc/61069/task/62590/root (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62590 tp_osd_tp ceph txt unknown /proc/61069/task/62590/exe (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62590 tp_osd_tp ceph NOFD /proc/61069/task/62590/fd (opendir: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62591 tp_osd_tp ceph cwd unknown /proc/61069/task/62591/cwd (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62591 tp_osd_tp ceph rtd unknown /proc/61069/task/62591/root (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62591 tp_osd_tp ceph txt unknown /proc/61069/task/62591/exe (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62591 tp_osd_tp ceph NOFD /proc/61069/task/62591/fd (opendir: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62593 tp_osd_tp ceph cwd unknown /proc/61069/task/62593/cwd (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62593 tp_osd_tp ceph rtd unknown /proc/61069/task/62593/root (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62593 tp_osd_tp ceph txt unknown /proc/61069/task/62593/exe (readlink: Permission denied) 2024-09-10T22:18:55.833 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62593 tp_osd_tp ceph NOFD /proc/61069/task/62593/fd (opendir: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62594 tp_osd_tp ceph cwd unknown /proc/61069/task/62594/cwd (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62594 tp_osd_tp ceph rtd unknown /proc/61069/task/62594/root (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62594 tp_osd_tp ceph txt unknown /proc/61069/task/62594/exe (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62594 tp_osd_tp ceph NOFD /proc/61069/task/62594/fd (opendir: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62595 tp_osd_tp ceph cwd unknown /proc/61069/task/62595/cwd (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62595 tp_osd_tp ceph rtd unknown /proc/61069/task/62595/root (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62595 tp_osd_tp ceph txt unknown /proc/61069/task/62595/exe (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62595 tp_osd_tp ceph NOFD /proc/61069/task/62595/fd (opendir: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62596 tp_osd_tp ceph cwd unknown /proc/61069/task/62596/cwd (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62596 tp_osd_tp ceph rtd unknown /proc/61069/task/62596/root (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62596 tp_osd_tp ceph txt unknown /proc/61069/task/62596/exe (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62596 tp_osd_tp ceph NOFD /proc/61069/task/62596/fd (opendir: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62597 tp_osd_tp ceph cwd unknown /proc/61069/task/62597/cwd (readlink: Permission denied) 2024-09-10T22:18:55.834 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62597 tp_osd_tp ceph rtd unknown /proc/61069/task/62597/root (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62597 tp_osd_tp ceph txt unknown /proc/61069/task/62597/exe (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62597 tp_osd_tp ceph NOFD /proc/61069/task/62597/fd (opendir: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62598 tp_osd_tp ceph cwd unknown /proc/61069/task/62598/cwd (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62598 tp_osd_tp ceph rtd unknown /proc/61069/task/62598/root (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62598 tp_osd_tp ceph txt unknown /proc/61069/task/62598/exe (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62598 tp_osd_tp ceph NOFD /proc/61069/task/62598/fd (opendir: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62599 tp_osd_tp ceph cwd unknown /proc/61069/task/62599/cwd (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62599 tp_osd_tp ceph rtd unknown /proc/61069/task/62599/root (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62599 tp_osd_tp ceph txt unknown /proc/61069/task/62599/exe (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62599 tp_osd_tp ceph NOFD /proc/61069/task/62599/fd (opendir: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62600 tp_osd_tp ceph cwd unknown /proc/61069/task/62600/cwd (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62600 tp_osd_tp ceph rtd unknown /proc/61069/task/62600/root (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62600 tp_osd_tp ceph txt unknown /proc/61069/task/62600/exe (readlink: Permission denied) 2024-09-10T22:18:55.835 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62600 tp_osd_tp ceph NOFD /proc/61069/task/62600/fd (opendir: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62601 tp_osd_tp ceph cwd unknown /proc/61069/task/62601/cwd (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62601 tp_osd_tp ceph rtd unknown /proc/61069/task/62601/root (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62601 tp_osd_tp ceph txt unknown /proc/61069/task/62601/exe (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62601 tp_osd_tp ceph NOFD /proc/61069/task/62601/fd (opendir: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62602 tp_osd_tp ceph cwd unknown /proc/61069/task/62602/cwd (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62602 tp_osd_tp ceph rtd unknown /proc/61069/task/62602/root (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62602 tp_osd_tp ceph txt unknown /proc/61069/task/62602/exe (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62602 tp_osd_tp ceph NOFD /proc/61069/task/62602/fd (opendir: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62603 osd_srv_h ceph cwd unknown /proc/61069/task/62603/cwd (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62603 osd_srv_h ceph rtd unknown /proc/61069/task/62603/root (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62603 osd_srv_h ceph txt unknown /proc/61069/task/62603/exe (readlink: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 61069 62603 osd_srv_h ceph NOFD /proc/61069/task/62603/fd (opendir: Permission denied) 2024-09-10T22:18:55.836 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 61925 root cwd unknown /proc/61925/cwd (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 61925 root rtd unknown /proc/61925/root (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 61925 root txt unknown /proc/61925/exe (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 61925 root NOFD /proc/61925/fd (opendir: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 61942 root cwd unknown /proc/61942/cwd (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 61942 root rtd unknown /proc/61942/root (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 61942 root txt unknown /proc/61942/exe (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 61942 root NOFD /proc/61942/fd (opendir: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 67499 root cwd unknown /proc/67499/cwd (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 67499 root rtd unknown /proc/67499/root (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 67499 root txt unknown /proc/67499/exe (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 67499 root NOFD /proc/67499/fd (opendir: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 67564 root cwd unknown /proc/67564/cwd (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 67564 root rtd unknown /proc/67564/root (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 67564 root txt unknown /proc/67564/exe (readlink: Permission denied) 2024-09-10T22:18:55.837 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 67564 root NOFD /proc/67564/fd (opendir: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 67566 root cwd unknown /proc/67566/cwd (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 67566 root rtd unknown /proc/67566/root (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 67566 root txt unknown /proc/67566/exe (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 67566 root NOFD /proc/67566/fd (opendir: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 ceph cwd unknown /proc/67568/cwd (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 ceph rtd unknown /proc/67568/root (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 ceph txt unknown /proc/67568/exe (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 ceph NOFD /proc/67568/fd (opendir: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67569 log ceph cwd unknown /proc/67568/task/67569/cwd (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67569 log ceph rtd unknown /proc/67568/task/67569/root (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67569 log ceph txt unknown /proc/67568/task/67569/exe (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67569 log ceph NOFD /proc/67568/task/67569/fd (opendir: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67571 msgr-work ceph cwd unknown /proc/67568/task/67571/cwd (readlink: Permission denied) 2024-09-10T22:18:55.838 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67571 msgr-work ceph rtd unknown /proc/67568/task/67571/root (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67571 msgr-work ceph txt unknown /proc/67568/task/67571/exe (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67571 msgr-work ceph NOFD /proc/67568/task/67571/fd (opendir: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67572 msgr-work ceph cwd unknown /proc/67568/task/67572/cwd (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67572 msgr-work ceph rtd unknown /proc/67568/task/67572/root (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67572 msgr-work ceph txt unknown /proc/67568/task/67572/exe (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67572 msgr-work ceph NOFD /proc/67568/task/67572/fd (opendir: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67573 msgr-work ceph cwd unknown /proc/67568/task/67573/cwd (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67573 msgr-work ceph rtd unknown /proc/67568/task/67573/root (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67573 msgr-work ceph txt unknown /proc/67568/task/67573/exe (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67573 msgr-work ceph NOFD /proc/67568/task/67573/fd (opendir: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67577 service ceph cwd unknown /proc/67568/task/67577/cwd (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67577 service ceph rtd unknown /proc/67568/task/67577/root (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67577 service ceph txt unknown /proc/67568/task/67577/exe (readlink: Permission denied) 2024-09-10T22:18:55.839 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67577 service ceph NOFD /proc/67568/task/67577/fd (opendir: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67578 admin_soc ceph cwd unknown /proc/67568/task/67578/cwd (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67578 admin_soc ceph rtd unknown /proc/67568/task/67578/root (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67578 admin_soc ceph txt unknown /proc/67568/task/67578/exe (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67578 admin_soc ceph NOFD /proc/67568/task/67578/fd (opendir: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67905 signal_ha ceph cwd unknown /proc/67568/task/67905/cwd (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67905 signal_ha ceph rtd unknown /proc/67568/task/67905/root (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67905 signal_ha ceph txt unknown /proc/67568/task/67905/exe (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67905 signal_ha ceph NOFD /proc/67568/task/67905/fd (opendir: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67906 io_contex ceph cwd unknown /proc/67568/task/67906/cwd (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67906 io_contex ceph rtd unknown /proc/67568/task/67906/root (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67906 io_contex ceph txt unknown /proc/67568/task/67906/exe (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67906 io_contex ceph NOFD /proc/67568/task/67906/fd (opendir: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67907 io_contex ceph cwd unknown /proc/67568/task/67907/cwd (readlink: Permission denied) 2024-09-10T22:18:55.840 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67907 io_contex ceph rtd unknown /proc/67568/task/67907/root (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67907 io_contex ceph txt unknown /proc/67568/task/67907/exe (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67907 io_contex ceph NOFD /proc/67568/task/67907/fd (opendir: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67925 OpHistory ceph cwd unknown /proc/67568/task/67925/cwd (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67925 OpHistory ceph rtd unknown /proc/67568/task/67925/root (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67925 OpHistory ceph txt unknown /proc/67568/task/67925/exe (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67925 OpHistory ceph NOFD /proc/67568/task/67925/fd (opendir: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67926 ceph_time ceph cwd unknown /proc/67568/task/67926/cwd (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67926 ceph_time ceph rtd unknown /proc/67568/task/67926/root (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67926 ceph_time ceph txt unknown /proc/67568/task/67926/exe (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 67926 ceph_time ceph NOFD /proc/67568/task/67926/fd (opendir: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68220 ceph-osd ceph cwd unknown /proc/67568/task/68220/cwd (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68220 ceph-osd ceph rtd unknown /proc/67568/task/68220/root (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68220 ceph-osd ceph txt unknown /proc/67568/task/68220/exe (readlink: Permission denied) 2024-09-10T22:18:55.841 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68220 ceph-osd ceph NOFD /proc/67568/task/68220/fd (opendir: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68221 safe_time ceph cwd unknown /proc/67568/task/68221/cwd (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68221 safe_time ceph rtd unknown /proc/67568/task/68221/root (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68221 safe_time ceph txt unknown /proc/67568/task/68221/exe (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68221 safe_time ceph NOFD /proc/67568/task/68221/fd (opendir: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68222 safe_time ceph cwd unknown /proc/67568/task/68222/cwd (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68222 safe_time ceph rtd unknown /proc/67568/task/68222/root (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68222 safe_time ceph txt unknown /proc/67568/task/68222/exe (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68222 safe_time ceph NOFD /proc/67568/task/68222/fd (opendir: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68223 safe_time ceph cwd unknown /proc/67568/task/68223/cwd (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68223 safe_time ceph rtd unknown /proc/67568/task/68223/root (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68223 safe_time ceph txt unknown /proc/67568/task/68223/exe (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68223 safe_time ceph NOFD /proc/67568/task/68223/fd (opendir: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68224 safe_time ceph cwd unknown /proc/67568/task/68224/cwd (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68224 safe_time ceph rtd unknown /proc/67568/task/68224/root (readlink: Permission denied) 2024-09-10T22:18:55.842 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68224 safe_time ceph txt unknown /proc/67568/task/68224/exe (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68224 safe_time ceph NOFD /proc/67568/task/68224/fd (opendir: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68225 fn_anonym ceph cwd unknown /proc/67568/task/68225/cwd (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68225 fn_anonym ceph rtd unknown /proc/67568/task/68225/root (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68225 fn_anonym ceph txt unknown /proc/67568/task/68225/exe (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68225 fn_anonym ceph NOFD /proc/67568/task/68225/fd (opendir: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68301 rocksdb:l ceph cwd unknown /proc/67568/task/68301/cwd (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68301 rocksdb:l ceph rtd unknown /proc/67568/task/68301/root (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68301 rocksdb:l ceph txt unknown /proc/67568/task/68301/exe (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68301 rocksdb:l ceph NOFD /proc/67568/task/68301/fd (opendir: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68302 rocksdb:l ceph cwd unknown /proc/67568/task/68302/cwd (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68302 rocksdb:l ceph rtd unknown /proc/67568/task/68302/root (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68302 rocksdb:l ceph txt unknown /proc/67568/task/68302/exe (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68302 rocksdb:l ceph NOFD /proc/67568/task/68302/fd (opendir: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68303 rocksdb:l ceph cwd unknown /proc/67568/task/68303/cwd (readlink: Permission denied) 2024-09-10T22:18:55.843 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68303 rocksdb:l ceph rtd unknown /proc/67568/task/68303/root (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68303 rocksdb:l ceph txt unknown /proc/67568/task/68303/exe (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68303 rocksdb:l ceph NOFD /proc/67568/task/68303/fd (opendir: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68304 rocksdb:h ceph cwd unknown /proc/67568/task/68304/cwd (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68304 rocksdb:h ceph rtd unknown /proc/67568/task/68304/root (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68304 rocksdb:h ceph txt unknown /proc/67568/task/68304/exe (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68304 rocksdb:h ceph NOFD /proc/67568/task/68304/fd (opendir: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68691 bstore_ai ceph cwd unknown /proc/67568/task/68691/cwd (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68691 bstore_ai ceph rtd unknown /proc/67568/task/68691/root (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68691 bstore_ai ceph txt unknown /proc/67568/task/68691/exe (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68691 bstore_ai ceph NOFD /proc/67568/task/68691/fd (opendir: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68896 bstore_ai ceph cwd unknown /proc/67568/task/68896/cwd (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68896 bstore_ai ceph rtd unknown /proc/67568/task/68896/root (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68896 bstore_ai ceph txt unknown /proc/67568/task/68896/exe (readlink: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 68896 bstore_ai ceph NOFD /proc/67568/task/68896/fd (opendir: Permission denied) 2024-09-10T22:18:55.844 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69078 ceph-osd ceph cwd unknown /proc/67568/task/69078/cwd (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69078 ceph-osd ceph rtd unknown /proc/67568/task/69078/root (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69078 ceph-osd ceph txt unknown /proc/67568/task/69078/exe (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69078 ceph-osd ceph NOFD /proc/67568/task/69078/fd (opendir: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69079 cfin ceph cwd unknown /proc/67568/task/69079/cwd (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69079 cfin ceph rtd unknown /proc/67568/task/69079/root (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69079 cfin ceph txt unknown /proc/67568/task/69079/exe (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69079 cfin ceph NOFD /proc/67568/task/69079/fd (opendir: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69080 bstore_kv ceph cwd unknown /proc/67568/task/69080/cwd (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69080 bstore_kv ceph rtd unknown /proc/67568/task/69080/root (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69080 bstore_kv ceph txt unknown /proc/67568/task/69080/exe (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69080 bstore_kv ceph NOFD /proc/67568/task/69080/fd (opendir: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69081 bstore_kv ceph cwd unknown /proc/67568/task/69081/cwd (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69081 bstore_kv ceph rtd unknown /proc/67568/task/69081/root (readlink: Permission denied) 2024-09-10T22:18:55.845 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69081 bstore_kv ceph txt unknown /proc/67568/task/69081/exe (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69081 bstore_kv ceph NOFD /proc/67568/task/69081/fd (opendir: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69082 bstore_me ceph cwd unknown /proc/67568/task/69082/cwd (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69082 bstore_me ceph rtd unknown /proc/67568/task/69082/root (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69082 bstore_me ceph txt unknown /proc/67568/task/69082/exe (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69082 bstore_me ceph NOFD /proc/67568/task/69082/fd (opendir: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69083 ms_dispat ceph cwd unknown /proc/67568/task/69083/cwd (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69083 ms_dispat ceph rtd unknown /proc/67568/task/69083/root (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69083 ms_dispat ceph txt unknown /proc/67568/task/69083/exe (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69083 ms_dispat ceph NOFD /proc/67568/task/69083/fd (opendir: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69084 ms_local ceph cwd unknown /proc/67568/task/69084/cwd (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69084 ms_local ceph rtd unknown /proc/67568/task/69084/root (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69084 ms_local ceph txt unknown /proc/67568/task/69084/exe (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69084 ms_local ceph NOFD /proc/67568/task/69084/fd (opendir: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69085 safe_time ceph cwd unknown /proc/67568/task/69085/cwd (readlink: Permission denied) 2024-09-10T22:18:55.846 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69085 safe_time ceph rtd unknown /proc/67568/task/69085/root (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69085 safe_time ceph txt unknown /proc/67568/task/69085/exe (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69085 safe_time ceph NOFD /proc/67568/task/69085/fd (opendir: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69086 safe_time ceph cwd unknown /proc/67568/task/69086/cwd (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69086 safe_time ceph rtd unknown /proc/67568/task/69086/root (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69086 safe_time ceph txt unknown /proc/67568/task/69086/exe (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69086 safe_time ceph NOFD /proc/67568/task/69086/fd (opendir: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69087 ms_dispat ceph cwd unknown /proc/67568/task/69087/cwd (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69087 ms_dispat ceph rtd unknown /proc/67568/task/69087/root (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69087 ms_dispat ceph txt unknown /proc/67568/task/69087/exe (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69087 ms_dispat ceph NOFD /proc/67568/task/69087/fd (opendir: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69088 ms_local ceph cwd unknown /proc/67568/task/69088/cwd (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69088 ms_local ceph rtd unknown /proc/67568/task/69088/root (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69088 ms_local ceph txt unknown /proc/67568/task/69088/exe (readlink: Permission denied) 2024-09-10T22:18:55.847 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69088 ms_local ceph NOFD /proc/67568/task/69088/fd (opendir: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69089 ms_dispat ceph cwd unknown /proc/67568/task/69089/cwd (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69089 ms_dispat ceph rtd unknown /proc/67568/task/69089/root (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69089 ms_dispat ceph txt unknown /proc/67568/task/69089/exe (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69089 ms_dispat ceph NOFD /proc/67568/task/69089/fd (opendir: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69090 ms_local ceph cwd unknown /proc/67568/task/69090/cwd (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69090 ms_local ceph rtd unknown /proc/67568/task/69090/root (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69090 ms_local ceph txt unknown /proc/67568/task/69090/exe (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69090 ms_local ceph NOFD /proc/67568/task/69090/fd (opendir: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69091 ms_dispat ceph cwd unknown /proc/67568/task/69091/cwd (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69091 ms_dispat ceph rtd unknown /proc/67568/task/69091/root (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69091 ms_dispat ceph txt unknown /proc/67568/task/69091/exe (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69091 ms_dispat ceph NOFD /proc/67568/task/69091/fd (opendir: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69092 ms_local ceph cwd unknown /proc/67568/task/69092/cwd (readlink: Permission denied) 2024-09-10T22:18:55.848 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69092 ms_local ceph rtd unknown /proc/67568/task/69092/root (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69092 ms_local ceph txt unknown /proc/67568/task/69092/exe (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69092 ms_local ceph NOFD /proc/67568/task/69092/fd (opendir: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69093 ms_dispat ceph cwd unknown /proc/67568/task/69093/cwd (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69093 ms_dispat ceph rtd unknown /proc/67568/task/69093/root (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69093 ms_dispat ceph txt unknown /proc/67568/task/69093/exe (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69093 ms_dispat ceph NOFD /proc/67568/task/69093/fd (opendir: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69094 ms_local ceph cwd unknown /proc/67568/task/69094/cwd (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69094 ms_local ceph rtd unknown /proc/67568/task/69094/root (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69094 ms_local ceph txt unknown /proc/67568/task/69094/exe (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69094 ms_local ceph NOFD /proc/67568/task/69094/fd (opendir: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69095 ms_dispat ceph cwd unknown /proc/67568/task/69095/cwd (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69095 ms_dispat ceph rtd unknown /proc/67568/task/69095/root (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69095 ms_dispat ceph txt unknown /proc/67568/task/69095/exe (readlink: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69095 ms_dispat ceph NOFD /proc/67568/task/69095/fd (opendir: Permission denied) 2024-09-10T22:18:55.849 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69096 ms_local ceph cwd unknown /proc/67568/task/69096/cwd (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69096 ms_local ceph rtd unknown /proc/67568/task/69096/root (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69096 ms_local ceph txt unknown /proc/67568/task/69096/exe (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69096 ms_local ceph NOFD /proc/67568/task/69096/fd (opendir: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69097 ms_dispat ceph cwd unknown /proc/67568/task/69097/cwd (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69097 ms_dispat ceph rtd unknown /proc/67568/task/69097/root (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69097 ms_dispat ceph txt unknown /proc/67568/task/69097/exe (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69097 ms_dispat ceph NOFD /proc/67568/task/69097/fd (opendir: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69098 ms_local ceph cwd unknown /proc/67568/task/69098/cwd (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69098 ms_local ceph rtd unknown /proc/67568/task/69098/root (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69098 ms_local ceph txt unknown /proc/67568/task/69098/exe (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69098 ms_local ceph NOFD /proc/67568/task/69098/fd (opendir: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69099 fn_anonym ceph cwd unknown /proc/67568/task/69099/cwd (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69099 fn_anonym ceph rtd unknown /proc/67568/task/69099/root (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69099 fn_anonym ceph txt unknown /proc/67568/task/69099/exe (readlink: Permission denied) 2024-09-10T22:18:55.850 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69099 fn_anonym ceph NOFD /proc/67568/task/69099/fd (opendir: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69100 finisher ceph cwd unknown /proc/67568/task/69100/cwd (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69100 finisher ceph rtd unknown /proc/67568/task/69100/root (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69100 finisher ceph txt unknown /proc/67568/task/69100/exe (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69100 finisher ceph NOFD /proc/67568/task/69100/fd (opendir: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69101 safe_time ceph cwd unknown /proc/67568/task/69101/cwd (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69101 safe_time ceph rtd unknown /proc/67568/task/69101/root (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69101 safe_time ceph txt unknown /proc/67568/task/69101/exe (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69101 safe_time ceph NOFD /proc/67568/task/69101/fd (opendir: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69102 safe_time ceph cwd unknown /proc/67568/task/69102/cwd (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69102 safe_time ceph rtd unknown /proc/67568/task/69102/root (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69102 safe_time ceph txt unknown /proc/67568/task/69102/exe (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69102 safe_time ceph NOFD /proc/67568/task/69102/fd (opendir: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69103 ceph-osd ceph cwd unknown /proc/67568/task/69103/cwd (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69103 ceph-osd ceph rtd unknown /proc/67568/task/69103/root (readlink: Permission denied) 2024-09-10T22:18:55.851 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69103 ceph-osd ceph txt unknown /proc/67568/task/69103/exe (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69103 ceph-osd ceph NOFD /proc/67568/task/69103/fd (opendir: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69104 osd_srv_a ceph cwd unknown /proc/67568/task/69104/cwd (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69104 osd_srv_a ceph rtd unknown /proc/67568/task/69104/root (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69104 osd_srv_a ceph txt unknown /proc/67568/task/69104/exe (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69104 osd_srv_a ceph NOFD /proc/67568/task/69104/fd (opendir: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69105 tp_osd_tp ceph cwd unknown /proc/67568/task/69105/cwd (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69105 tp_osd_tp ceph rtd unknown /proc/67568/task/69105/root (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69105 tp_osd_tp ceph txt unknown /proc/67568/task/69105/exe (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69105 tp_osd_tp ceph NOFD /proc/67568/task/69105/fd (opendir: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69106 tp_osd_tp ceph cwd unknown /proc/67568/task/69106/cwd (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69106 tp_osd_tp ceph rtd unknown /proc/67568/task/69106/root (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69106 tp_osd_tp ceph txt unknown /proc/67568/task/69106/exe (readlink: Permission denied) 2024-09-10T22:18:55.852 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69106 tp_osd_tp ceph NOFD /proc/67568/task/69106/fd (opendir: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69107 tp_osd_tp ceph cwd unknown /proc/67568/task/69107/cwd (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69107 tp_osd_tp ceph rtd unknown /proc/67568/task/69107/root (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69107 tp_osd_tp ceph txt unknown /proc/67568/task/69107/exe (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69107 tp_osd_tp ceph NOFD /proc/67568/task/69107/fd (opendir: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69108 tp_osd_tp ceph cwd unknown /proc/67568/task/69108/cwd (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69108 tp_osd_tp ceph rtd unknown /proc/67568/task/69108/root (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69108 tp_osd_tp ceph txt unknown /proc/67568/task/69108/exe (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69108 tp_osd_tp ceph NOFD /proc/67568/task/69108/fd (opendir: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69109 tp_osd_tp ceph cwd unknown /proc/67568/task/69109/cwd (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69109 tp_osd_tp ceph rtd unknown /proc/67568/task/69109/root (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69109 tp_osd_tp ceph txt unknown /proc/67568/task/69109/exe (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69109 tp_osd_tp ceph NOFD /proc/67568/task/69109/fd (opendir: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69110 tp_osd_tp ceph cwd unknown /proc/67568/task/69110/cwd (readlink: Permission denied) 2024-09-10T22:18:55.853 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69110 tp_osd_tp ceph rtd unknown /proc/67568/task/69110/root (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69110 tp_osd_tp ceph txt unknown /proc/67568/task/69110/exe (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69110 tp_osd_tp ceph NOFD /proc/67568/task/69110/fd (opendir: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69111 tp_osd_tp ceph cwd unknown /proc/67568/task/69111/cwd (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69111 tp_osd_tp ceph rtd unknown /proc/67568/task/69111/root (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69111 tp_osd_tp ceph txt unknown /proc/67568/task/69111/exe (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69111 tp_osd_tp ceph NOFD /proc/67568/task/69111/fd (opendir: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69112 tp_osd_tp ceph cwd unknown /proc/67568/task/69112/cwd (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69112 tp_osd_tp ceph rtd unknown /proc/67568/task/69112/root (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69112 tp_osd_tp ceph txt unknown /proc/67568/task/69112/exe (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69112 tp_osd_tp ceph NOFD /proc/67568/task/69112/fd (opendir: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69113 tp_osd_tp ceph cwd unknown /proc/67568/task/69113/cwd (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69113 tp_osd_tp ceph rtd unknown /proc/67568/task/69113/root (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69113 tp_osd_tp ceph txt unknown /proc/67568/task/69113/exe (readlink: Permission denied) 2024-09-10T22:18:55.854 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69113 tp_osd_tp ceph NOFD /proc/67568/task/69113/fd (opendir: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69114 tp_osd_tp ceph cwd unknown /proc/67568/task/69114/cwd (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69114 tp_osd_tp ceph rtd unknown /proc/67568/task/69114/root (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69114 tp_osd_tp ceph txt unknown /proc/67568/task/69114/exe (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69114 tp_osd_tp ceph NOFD /proc/67568/task/69114/fd (opendir: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69115 tp_osd_tp ceph cwd unknown /proc/67568/task/69115/cwd (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69115 tp_osd_tp ceph rtd unknown /proc/67568/task/69115/root (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69115 tp_osd_tp ceph txt unknown /proc/67568/task/69115/exe (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69115 tp_osd_tp ceph NOFD /proc/67568/task/69115/fd (opendir: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69116 tp_osd_tp ceph cwd unknown /proc/67568/task/69116/cwd (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69116 tp_osd_tp ceph rtd unknown /proc/67568/task/69116/root (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69116 tp_osd_tp ceph txt unknown /proc/67568/task/69116/exe (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69116 tp_osd_tp ceph NOFD /proc/67568/task/69116/fd (opendir: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69117 tp_osd_tp ceph cwd unknown /proc/67568/task/69117/cwd (readlink: Permission denied) 2024-09-10T22:18:55.855 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69117 tp_osd_tp ceph rtd unknown /proc/67568/task/69117/root (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69117 tp_osd_tp ceph txt unknown /proc/67568/task/69117/exe (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69117 tp_osd_tp ceph NOFD /proc/67568/task/69117/fd (opendir: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69118 tp_osd_tp ceph cwd unknown /proc/67568/task/69118/cwd (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69118 tp_osd_tp ceph rtd unknown /proc/67568/task/69118/root (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69118 tp_osd_tp ceph txt unknown /proc/67568/task/69118/exe (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69118 tp_osd_tp ceph NOFD /proc/67568/task/69118/fd (opendir: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69119 tp_osd_tp ceph cwd unknown /proc/67568/task/69119/cwd (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69119 tp_osd_tp ceph rtd unknown /proc/67568/task/69119/root (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69119 tp_osd_tp ceph txt unknown /proc/67568/task/69119/exe (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69119 tp_osd_tp ceph NOFD /proc/67568/task/69119/fd (opendir: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69120 tp_osd_tp ceph cwd unknown /proc/67568/task/69120/cwd (readlink: Permission denied) 2024-09-10T22:18:55.856 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69120 tp_osd_tp ceph rtd unknown /proc/67568/task/69120/root (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69120 tp_osd_tp ceph txt unknown /proc/67568/task/69120/exe (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69120 tp_osd_tp ceph NOFD /proc/67568/task/69120/fd (opendir: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69121 osd_srv_h ceph cwd unknown /proc/67568/task/69121/cwd (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69121 osd_srv_h ceph rtd unknown /proc/67568/task/69121/root (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69121 osd_srv_h ceph txt unknown /proc/67568/task/69121/exe (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-osd 67568 69121 osd_srv_h ceph NOFD /proc/67568/task/69121/fd (opendir: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 68236 root cwd unknown /proc/68236/cwd (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 68236 root rtd unknown /proc/68236/root (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 68236 root txt unknown /proc/68236/exe (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 68236 root NOFD /proc/68236/fd (opendir: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 68253 root cwd unknown /proc/68253/cwd (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 68253 root rtd unknown /proc/68253/root (readlink: Permission denied) 2024-09-10T22:18:55.857 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 68253 root txt unknown /proc/68253/exe (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 68253 root NOFD /proc/68253/fd (opendir: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 69126 root cwd unknown /proc/69126/cwd (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 69126 root rtd unknown /proc/69126/root (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 69126 root txt unknown /proc/69126/exe (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 69126 root NOFD /proc/69126/fd (opendir: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72252 root cwd unknown /proc/72252/cwd (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72252 root rtd unknown /proc/72252/root (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72252 root txt unknown /proc/72252/exe (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72252 root NOFD /proc/72252/fd (opendir: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72269 root cwd unknown /proc/72269/cwd (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72269 root rtd unknown /proc/72269/root (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72269 root txt unknown /proc/72269/exe (readlink: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72269 root NOFD /proc/72269/fd (opendir: Permission denied) 2024-09-10T22:18:55.858 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72270 root cwd unknown /proc/72270/cwd (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72270 root rtd unknown /proc/72270/root (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72270 root txt unknown /proc/72270/exe (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72270 root NOFD /proc/72270/fd (opendir: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72287 root cwd unknown /proc/72287/cwd (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72287 root rtd unknown /proc/72287/root (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72287 root txt unknown /proc/72287/exe (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72287 root NOFD /proc/72287/fd (opendir: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72288 root cwd unknown /proc/72288/cwd (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72288 root rtd unknown /proc/72288/root (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72288 root txt unknown /proc/72288/exe (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72288 root NOFD /proc/72288/fd (opendir: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72305 root cwd unknown /proc/72305/cwd (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72305 root rtd unknown /proc/72305/root (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72305 root txt unknown /proc/72305/exe (readlink: Permission denied) 2024-09-10T22:18:55.859 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72305 root NOFD /proc/72305/fd (opendir: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72306 root cwd unknown /proc/72306/cwd (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72306 root rtd unknown /proc/72306/root (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72306 root txt unknown /proc/72306/exe (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 72306 root NOFD /proc/72306/fd (opendir: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72323 root cwd unknown /proc/72323/cwd (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72323 root rtd unknown /proc/72323/root (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72323 root txt unknown /proc/72323/exe (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:journalct 72323 root NOFD /proc/72323/fd (opendir: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 72856 root cwd unknown /proc/72856/cwd (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 72856 root rtd unknown /proc/72856/root (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 72856 root txt unknown /proc/72856/exe (readlink: Permission denied) 2024-09-10T22:18:55.860 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 72856 root NOFD /proc/72856/fd (opendir: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 72858 root cwd unknown /proc/72858/cwd (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 72858 root rtd unknown /proc/72858/root (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 72858 root txt unknown /proc/72858/exe (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 72858 root NOFD /proc/72858/fd (opendir: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 ceph cwd unknown /proc/72872/cwd (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 ceph rtd unknown /proc/72872/root (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 ceph txt unknown /proc/72872/exe (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 ceph NOFD /proc/72872/fd (opendir: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72873 log ceph cwd unknown /proc/72872/task/72873/cwd (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72873 log ceph rtd unknown /proc/72872/task/72873/root (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72873 log ceph txt unknown /proc/72872/task/72873/exe (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72873 log ceph NOFD /proc/72872/task/72873/fd (opendir: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72875 msgr-work ceph cwd unknown /proc/72872/task/72875/cwd (readlink: Permission denied) 2024-09-10T22:18:55.861 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72875 msgr-work ceph rtd unknown /proc/72872/task/72875/root (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72875 msgr-work ceph txt unknown /proc/72872/task/72875/exe (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72875 msgr-work ceph NOFD /proc/72872/task/72875/fd (opendir: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72876 msgr-work ceph cwd unknown /proc/72872/task/72876/cwd (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72876 msgr-work ceph rtd unknown /proc/72872/task/72876/root (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72876 msgr-work ceph txt unknown /proc/72872/task/72876/exe (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72876 msgr-work ceph NOFD /proc/72872/task/72876/fd (opendir: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72877 msgr-work ceph cwd unknown /proc/72872/task/72877/cwd (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72877 msgr-work ceph rtd unknown /proc/72872/task/72877/root (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72877 msgr-work ceph txt unknown /proc/72872/task/72877/exe (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72877 msgr-work ceph NOFD /proc/72872/task/72877/fd (opendir: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72881 service ceph cwd unknown /proc/72872/task/72881/cwd (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72881 service ceph rtd unknown /proc/72872/task/72881/root (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72881 service ceph txt unknown /proc/72872/task/72881/exe (readlink: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72881 service ceph NOFD /proc/72872/task/72881/fd (opendir: Permission denied) 2024-09-10T22:18:55.862 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72882 admin_soc ceph cwd unknown /proc/72872/task/72882/cwd (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72882 admin_soc ceph rtd unknown /proc/72872/task/72882/root (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72882 admin_soc ceph txt unknown /proc/72872/task/72882/exe (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72882 admin_soc ceph NOFD /proc/72872/task/72882/fd (opendir: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72883 signal_ha ceph cwd unknown /proc/72872/task/72883/cwd (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72883 signal_ha ceph rtd unknown /proc/72872/task/72883/root (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72883 signal_ha ceph txt unknown /proc/72872/task/72883/exe (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72883 signal_ha ceph NOFD /proc/72872/task/72883/fd (opendir: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72884 io_contex ceph cwd unknown /proc/72872/task/72884/cwd (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72884 io_contex ceph rtd unknown /proc/72872/task/72884/root (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72884 io_contex ceph txt unknown /proc/72872/task/72884/exe (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72884 io_contex ceph NOFD /proc/72872/task/72884/fd (opendir: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72885 io_contex ceph cwd unknown /proc/72872/task/72885/cwd (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72885 io_contex ceph rtd unknown /proc/72872/task/72885/root (readlink: Permission denied) 2024-09-10T22:18:55.863 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72885 io_contex ceph txt unknown /proc/72872/task/72885/exe (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72885 io_contex ceph NOFD /proc/72872/task/72885/fd (opendir: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72886 ms_dispat ceph cwd unknown /proc/72872/task/72886/cwd (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72886 ms_dispat ceph rtd unknown /proc/72872/task/72886/root (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72886 ms_dispat ceph txt unknown /proc/72872/task/72886/exe (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72886 ms_dispat ceph NOFD /proc/72872/task/72886/fd (opendir: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72887 ms_local ceph cwd unknown /proc/72872/task/72887/cwd (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72887 ms_local ceph rtd unknown /proc/72872/task/72887/root (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72887 ms_local ceph txt unknown /proc/72872/task/72887/exe (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72887 ms_local ceph NOFD /proc/72872/task/72887/fd (opendir: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72888 safe_time ceph cwd unknown /proc/72872/task/72888/cwd (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72888 safe_time ceph rtd unknown /proc/72872/task/72888/root (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72888 safe_time ceph txt unknown /proc/72872/task/72888/exe (readlink: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72888 safe_time ceph NOFD /proc/72872/task/72888/fd (opendir: Permission denied) 2024-09-10T22:18:55.864 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72889 safe_time ceph cwd unknown /proc/72872/task/72889/cwd (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72889 safe_time ceph rtd unknown /proc/72872/task/72889/root (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72889 safe_time ceph txt unknown /proc/72872/task/72889/exe (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72889 safe_time ceph NOFD /proc/72872/task/72889/fd (opendir: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72890 ceph-mds ceph cwd unknown /proc/72872/task/72890/cwd (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72890 ceph-mds ceph rtd unknown /proc/72872/task/72890/root (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72890 ceph-mds ceph txt unknown /proc/72872/task/72890/exe (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72890 ceph-mds ceph NOFD /proc/72872/task/72890/fd (opendir: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72895 safe_time ceph cwd unknown /proc/72872/task/72895/cwd (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72895 safe_time ceph rtd unknown /proc/72872/task/72895/root (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72895 safe_time ceph txt unknown /proc/72872/task/72895/exe (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 72872 72895 safe_time ceph NOFD /proc/72872/task/72895/fd (opendir: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 73241 root cwd unknown /proc/73241/cwd (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 73241 root rtd unknown /proc/73241/root (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 73241 root txt unknown /proc/73241/exe (readlink: Permission denied) 2024-09-10T22:18:55.865 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 73241 root NOFD /proc/73241/fd (opendir: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 73243 root cwd unknown /proc/73243/cwd (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 73243 root rtd unknown /proc/73243/root (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 73243 root txt unknown /proc/73243/exe (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 73243 root NOFD /proc/73243/fd (opendir: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 ceph cwd unknown /proc/73245/cwd (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 ceph rtd unknown /proc/73245/root (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 ceph txt unknown /proc/73245/exe (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 ceph NOFD /proc/73245/fd (opendir: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73246 log ceph cwd unknown /proc/73245/task/73246/cwd (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73246 log ceph rtd unknown /proc/73245/task/73246/root (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73246 log ceph txt unknown /proc/73245/task/73246/exe (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73246 log ceph NOFD /proc/73245/task/73246/fd (opendir: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73248 msgr-work ceph cwd unknown /proc/73245/task/73248/cwd (readlink: Permission denied) 2024-09-10T22:18:55.866 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73248 msgr-work ceph rtd unknown /proc/73245/task/73248/root (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73248 msgr-work ceph txt unknown /proc/73245/task/73248/exe (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73248 msgr-work ceph NOFD /proc/73245/task/73248/fd (opendir: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73249 msgr-work ceph cwd unknown /proc/73245/task/73249/cwd (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73249 msgr-work ceph rtd unknown /proc/73245/task/73249/root (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73249 msgr-work ceph txt unknown /proc/73245/task/73249/exe (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73249 msgr-work ceph NOFD /proc/73245/task/73249/fd (opendir: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73250 msgr-work ceph cwd unknown /proc/73245/task/73250/cwd (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73250 msgr-work ceph rtd unknown /proc/73245/task/73250/root (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73250 msgr-work ceph txt unknown /proc/73245/task/73250/exe (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73250 msgr-work ceph NOFD /proc/73245/task/73250/fd (opendir: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73254 service ceph cwd unknown /proc/73245/task/73254/cwd (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73254 service ceph rtd unknown /proc/73245/task/73254/root (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73254 service ceph txt unknown /proc/73245/task/73254/exe (readlink: Permission denied) 2024-09-10T22:18:55.867 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73254 service ceph NOFD /proc/73245/task/73254/fd (opendir: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73255 admin_soc ceph cwd unknown /proc/73245/task/73255/cwd (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73255 admin_soc ceph rtd unknown /proc/73245/task/73255/root (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73255 admin_soc ceph txt unknown /proc/73245/task/73255/exe (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73255 admin_soc ceph NOFD /proc/73245/task/73255/fd (opendir: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73256 signal_ha ceph cwd unknown /proc/73245/task/73256/cwd (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73256 signal_ha ceph rtd unknown /proc/73245/task/73256/root (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73256 signal_ha ceph txt unknown /proc/73245/task/73256/exe (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73256 signal_ha ceph NOFD /proc/73245/task/73256/fd (opendir: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73257 io_contex ceph cwd unknown /proc/73245/task/73257/cwd (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73257 io_contex ceph rtd unknown /proc/73245/task/73257/root (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73257 io_contex ceph txt unknown /proc/73245/task/73257/exe (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73257 io_contex ceph NOFD /proc/73245/task/73257/fd (opendir: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73258 io_contex ceph cwd unknown /proc/73245/task/73258/cwd (readlink: Permission denied) 2024-09-10T22:18:55.868 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73258 io_contex ceph rtd unknown /proc/73245/task/73258/root (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73258 io_contex ceph txt unknown /proc/73245/task/73258/exe (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73258 io_contex ceph NOFD /proc/73245/task/73258/fd (opendir: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73259 ms_dispat ceph cwd unknown /proc/73245/task/73259/cwd (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73259 ms_dispat ceph rtd unknown /proc/73245/task/73259/root (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73259 ms_dispat ceph txt unknown /proc/73245/task/73259/exe (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73259 ms_dispat ceph NOFD /proc/73245/task/73259/fd (opendir: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73260 ms_local ceph cwd unknown /proc/73245/task/73260/cwd (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73260 ms_local ceph rtd unknown /proc/73245/task/73260/root (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73260 ms_local ceph txt unknown /proc/73245/task/73260/exe (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73260 ms_local ceph NOFD /proc/73245/task/73260/fd (opendir: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73261 safe_time ceph cwd unknown /proc/73245/task/73261/cwd (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73261 safe_time ceph rtd unknown /proc/73245/task/73261/root (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73261 safe_time ceph txt unknown /proc/73245/task/73261/exe (readlink: Permission denied) 2024-09-10T22:18:55.869 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73261 safe_time ceph NOFD /proc/73245/task/73261/fd (opendir: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73262 safe_time ceph cwd unknown /proc/73245/task/73262/cwd (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73262 safe_time ceph rtd unknown /proc/73245/task/73262/root (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73262 safe_time ceph txt unknown /proc/73245/task/73262/exe (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73262 safe_time ceph NOFD /proc/73245/task/73262/fd (opendir: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73263 ceph-mds ceph cwd unknown /proc/73245/task/73263/cwd (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73263 ceph-mds ceph rtd unknown /proc/73245/task/73263/root (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73263 ceph-mds ceph txt unknown /proc/73245/task/73263/exe (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73263 ceph-mds ceph NOFD /proc/73245/task/73263/fd (opendir: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73268 safe_time ceph cwd unknown /proc/73245/task/73268/cwd (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73268 safe_time ceph rtd unknown /proc/73245/task/73268/root (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73268 safe_time ceph txt unknown /proc/73245/task/73268/exe (readlink: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 73245 73268 safe_time ceph NOFD /proc/73245/task/73268/fd (opendir: Permission denied) 2024-09-10T22:18:55.870 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74051 root cwd unknown /proc/74051/cwd (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74051 root rtd unknown /proc/74051/root (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74051 root txt unknown /proc/74051/exe (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74051 root NOFD /proc/74051/fd (opendir: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74058 root cwd unknown /proc/74058/cwd (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74058 root rtd unknown /proc/74058/root (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74058 root txt unknown /proc/74058/exe (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74058 root NOFD /proc/74058/fd (opendir: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 ceph cwd unknown /proc/74062/cwd (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 ceph rtd unknown /proc/74062/root (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 ceph txt unknown /proc/74062/exe (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 ceph NOFD /proc/74062/fd (opendir: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74063 log ceph cwd unknown /proc/74062/task/74063/cwd (readlink: Permission denied) 2024-09-10T22:18:55.871 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74063 log ceph rtd unknown /proc/74062/task/74063/root (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74063 log ceph txt unknown /proc/74062/task/74063/exe (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74063 log ceph NOFD /proc/74062/task/74063/fd (opendir: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74065 msgr-work ceph cwd unknown /proc/74062/task/74065/cwd (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74065 msgr-work ceph rtd unknown /proc/74062/task/74065/root (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74065 msgr-work ceph txt unknown /proc/74062/task/74065/exe (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74065 msgr-work ceph NOFD /proc/74062/task/74065/fd (opendir: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74066 msgr-work ceph cwd unknown /proc/74062/task/74066/cwd (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74066 msgr-work ceph rtd unknown /proc/74062/task/74066/root (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74066 msgr-work ceph txt unknown /proc/74062/task/74066/exe (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74066 msgr-work ceph NOFD /proc/74062/task/74066/fd (opendir: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74067 msgr-work ceph cwd unknown /proc/74062/task/74067/cwd (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74067 msgr-work ceph rtd unknown /proc/74062/task/74067/root (readlink: Permission denied) 2024-09-10T22:18:55.872 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74067 msgr-work ceph txt unknown /proc/74062/task/74067/exe (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74067 msgr-work ceph NOFD /proc/74062/task/74067/fd (opendir: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74071 service ceph cwd unknown /proc/74062/task/74071/cwd (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74071 service ceph rtd unknown /proc/74062/task/74071/root (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74071 service ceph txt unknown /proc/74062/task/74071/exe (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74071 service ceph NOFD /proc/74062/task/74071/fd (opendir: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74072 admin_soc ceph cwd unknown /proc/74062/task/74072/cwd (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74072 admin_soc ceph rtd unknown /proc/74062/task/74072/root (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74072 admin_soc ceph txt unknown /proc/74062/task/74072/exe (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74072 admin_soc ceph NOFD /proc/74062/task/74072/fd (opendir: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74073 signal_ha ceph cwd unknown /proc/74062/task/74073/cwd (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74073 signal_ha ceph rtd unknown /proc/74062/task/74073/root (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74073 signal_ha ceph txt unknown /proc/74062/task/74073/exe (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74073 signal_ha ceph NOFD /proc/74062/task/74073/fd (opendir: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74074 io_contex ceph cwd unknown /proc/74062/task/74074/cwd (readlink: Permission denied) 2024-09-10T22:18:55.873 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74074 io_contex ceph rtd unknown /proc/74062/task/74074/root (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74074 io_contex ceph txt unknown /proc/74062/task/74074/exe (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74074 io_contex ceph NOFD /proc/74062/task/74074/fd (opendir: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74075 io_contex ceph cwd unknown /proc/74062/task/74075/cwd (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74075 io_contex ceph rtd unknown /proc/74062/task/74075/root (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74075 io_contex ceph txt unknown /proc/74062/task/74075/exe (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74075 io_contex ceph NOFD /proc/74062/task/74075/fd (opendir: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74076 ms_dispat ceph cwd unknown /proc/74062/task/74076/cwd (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74076 ms_dispat ceph rtd unknown /proc/74062/task/74076/root (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74076 ms_dispat ceph txt unknown /proc/74062/task/74076/exe (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74076 ms_dispat ceph NOFD /proc/74062/task/74076/fd (opendir: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74077 ms_local ceph cwd unknown /proc/74062/task/74077/cwd (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74077 ms_local ceph rtd unknown /proc/74062/task/74077/root (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74077 ms_local ceph txt unknown /proc/74062/task/74077/exe (readlink: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74077 ms_local ceph NOFD /proc/74062/task/74077/fd (opendir: Permission denied) 2024-09-10T22:18:55.874 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74078 safe_time ceph cwd unknown /proc/74062/task/74078/cwd (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74078 safe_time ceph rtd unknown /proc/74062/task/74078/root (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74078 safe_time ceph txt unknown /proc/74062/task/74078/exe (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74078 safe_time ceph NOFD /proc/74062/task/74078/fd (opendir: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74079 safe_time ceph cwd unknown /proc/74062/task/74079/cwd (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74079 safe_time ceph rtd unknown /proc/74062/task/74079/root (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74079 safe_time ceph txt unknown /proc/74062/task/74079/exe (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74079 safe_time ceph NOFD /proc/74062/task/74079/fd (opendir: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74080 ceph-mds ceph cwd unknown /proc/74062/task/74080/cwd (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74080 ceph-mds ceph rtd unknown /proc/74062/task/74080/root (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74080 ceph-mds ceph txt unknown /proc/74062/task/74080/exe (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74080 ceph-mds ceph NOFD /proc/74062/task/74080/fd (opendir: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74210 safe_time ceph cwd unknown /proc/74062/task/74210/cwd (readlink: Permission denied) 2024-09-10T22:18:55.875 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74210 safe_time ceph rtd unknown /proc/74062/task/74210/root (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74210 safe_time ceph txt unknown /proc/74062/task/74210/exe (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74062 74210 safe_time ceph NOFD /proc/74062/task/74210/fd (opendir: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 74364 root cwd unknown /proc/74364/cwd (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 74364 root rtd unknown /proc/74364/root (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 74364 root txt unknown /proc/74364/exe (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/6 74364 root NOFD /proc/74364/fd (opendir: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74427 root cwd unknown /proc/74427/cwd (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74427 root rtd unknown /proc/74427/root (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74427 root txt unknown /proc/74427/exe (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:conmon 74427 root NOFD /proc/74427/fd (opendir: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74429 root cwd unknown /proc/74429/cwd (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74429 root rtd unknown /proc/74429/root (readlink: Permission denied) 2024-09-10T22:18:55.876 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74429 root txt unknown /proc/74429/exe (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:podman-in 74429 root NOFD /proc/74429/fd (opendir: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 ceph cwd unknown /proc/74431/cwd (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 ceph rtd unknown /proc/74431/root (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 ceph txt unknown /proc/74431/exe (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 ceph NOFD /proc/74431/fd (opendir: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74432 log ceph cwd unknown /proc/74431/task/74432/cwd (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74432 log ceph rtd unknown /proc/74431/task/74432/root (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74432 log ceph txt unknown /proc/74431/task/74432/exe (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74432 log ceph NOFD /proc/74431/task/74432/fd (opendir: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74434 msgr-work ceph cwd unknown /proc/74431/task/74434/cwd (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74434 msgr-work ceph rtd unknown /proc/74431/task/74434/root (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74434 msgr-work ceph txt unknown /proc/74431/task/74434/exe (readlink: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74434 msgr-work ceph NOFD /proc/74431/task/74434/fd (opendir: Permission denied) 2024-09-10T22:18:55.877 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74435 msgr-work ceph cwd unknown /proc/74431/task/74435/cwd (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74435 msgr-work ceph rtd unknown /proc/74431/task/74435/root (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74435 msgr-work ceph txt unknown /proc/74431/task/74435/exe (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74435 msgr-work ceph NOFD /proc/74431/task/74435/fd (opendir: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74436 msgr-work ceph cwd unknown /proc/74431/task/74436/cwd (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74436 msgr-work ceph rtd unknown /proc/74431/task/74436/root (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74436 msgr-work ceph txt unknown /proc/74431/task/74436/exe (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74436 msgr-work ceph NOFD /proc/74431/task/74436/fd (opendir: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74440 service ceph cwd unknown /proc/74431/task/74440/cwd (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74440 service ceph rtd unknown /proc/74431/task/74440/root (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74440 service ceph txt unknown /proc/74431/task/74440/exe (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74440 service ceph NOFD /proc/74431/task/74440/fd (opendir: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74441 admin_soc ceph cwd unknown /proc/74431/task/74441/cwd (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74441 admin_soc ceph rtd unknown /proc/74431/task/74441/root (readlink: Permission denied) 2024-09-10T22:18:55.878 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74441 admin_soc ceph txt unknown /proc/74431/task/74441/exe (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74441 admin_soc ceph NOFD /proc/74431/task/74441/fd (opendir: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74442 signal_ha ceph cwd unknown /proc/74431/task/74442/cwd (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74442 signal_ha ceph rtd unknown /proc/74431/task/74442/root (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74442 signal_ha ceph txt unknown /proc/74431/task/74442/exe (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74442 signal_ha ceph NOFD /proc/74431/task/74442/fd (opendir: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74443 io_contex ceph cwd unknown /proc/74431/task/74443/cwd (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74443 io_contex ceph rtd unknown /proc/74431/task/74443/root (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74443 io_contex ceph txt unknown /proc/74431/task/74443/exe (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74443 io_contex ceph NOFD /proc/74431/task/74443/fd (opendir: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74444 io_contex ceph cwd unknown /proc/74431/task/74444/cwd (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74444 io_contex ceph rtd unknown /proc/74431/task/74444/root (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74444 io_contex ceph txt unknown /proc/74431/task/74444/exe (readlink: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74444 io_contex ceph NOFD /proc/74431/task/74444/fd (opendir: Permission denied) 2024-09-10T22:18:55.879 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74445 ms_dispat ceph cwd unknown /proc/74431/task/74445/cwd (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74445 ms_dispat ceph rtd unknown /proc/74431/task/74445/root (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74445 ms_dispat ceph txt unknown /proc/74431/task/74445/exe (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74445 ms_dispat ceph NOFD /proc/74431/task/74445/fd (opendir: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74446 ms_local ceph cwd unknown /proc/74431/task/74446/cwd (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74446 ms_local ceph rtd unknown /proc/74431/task/74446/root (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74446 ms_local ceph txt unknown /proc/74431/task/74446/exe (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74446 ms_local ceph NOFD /proc/74431/task/74446/fd (opendir: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74447 safe_time ceph cwd unknown /proc/74431/task/74447/cwd (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74447 safe_time ceph rtd unknown /proc/74431/task/74447/root (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74447 safe_time ceph txt unknown /proc/74431/task/74447/exe (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74447 safe_time ceph NOFD /proc/74431/task/74447/fd (opendir: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74448 safe_time ceph cwd unknown /proc/74431/task/74448/cwd (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74448 safe_time ceph rtd unknown /proc/74431/task/74448/root (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74448 safe_time ceph txt unknown /proc/74431/task/74448/exe (readlink: Permission denied) 2024-09-10T22:18:55.880 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74448 safe_time ceph NOFD /proc/74431/task/74448/fd (opendir: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74449 ceph-mds ceph cwd unknown /proc/74431/task/74449/cwd (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74449 ceph-mds ceph rtd unknown /proc/74431/task/74449/root (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74449 ceph-mds ceph txt unknown /proc/74431/task/74449/exe (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74449 ceph-mds ceph NOFD /proc/74431/task/74449/fd (opendir: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74465 safe_time ceph cwd unknown /proc/74431/task/74465/cwd (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74465 safe_time ceph rtd unknown /proc/74431/task/74465/root (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74465 safe_time ceph txt unknown /proc/74431/task/74465/exe (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:ceph-mds 74431 74465 safe_time ceph NOFD /proc/74431/task/74465/fd (opendir: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 77757 root cwd unknown /proc/77757/cwd (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 77757 root rtd unknown /proc/77757/root (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 77757 root txt unknown /proc/77757/exe (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/0 77757 root NOFD /proc/77757/fd (opendir: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 79028 root cwd unknown /proc/79028/cwd (readlink: Permission denied) 2024-09-10T22:18:55.881 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 79028 root rtd unknown /proc/79028/root (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 79028 root txt unknown /proc/79028/exe (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/4 79028 root NOFD /proc/79028/fd (opendir: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 84645 root cwd unknown /proc/84645/cwd (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 84645 root rtd unknown /proc/84645/root (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 84645 root txt unknown /proc/84645/exe (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/5 84645 root NOFD /proc/84645/fd (opendir: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 84682 root cwd unknown /proc/84682/cwd (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 84682 root rtd unknown /proc/84682/root (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 84682 root txt unknown /proc/84682/exe (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 84682 root NOFD /proc/84682/fd (opendir: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84703 root cwd unknown /proc/84703/cwd (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84703 root rtd unknown /proc/84703/root (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84703 root txt unknown /proc/84703/exe (readlink: Permission denied) 2024-09-10T22:18:55.882 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84703 root NOFD /proc/84703/fd (opendir: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84704 root cwd unknown /proc/84704/cwd (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84704 root rtd unknown /proc/84704/root (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84704 root txt unknown /proc/84704/exe (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84704 root NOFD /proc/84704/fd (opendir: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84705 root cwd unknown /proc/84705/cwd (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84705 root rtd unknown /proc/84705/root (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84705 root txt unknown /proc/84705/exe (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/R 84705 root NOFD /proc/84705/fd (opendir: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 85485 root cwd unknown /proc/85485/cwd (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 85485 root rtd unknown /proc/85485/root (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 85485 root txt unknown /proc/85485/exe (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:sudo 85485 root NOFD /proc/85485/fd (opendir: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 85521 root cwd unknown /proc/85521/cwd (readlink: Permission denied) 2024-09-10T22:18:55.883 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 85521 root rtd unknown /proc/85521/root (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 85521 root txt unknown /proc/85521/exe (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:daemon-he 85521 root NOFD /proc/85521/fd (opendir: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:bash 85522 root cwd unknown /proc/85522/cwd (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:bash 85522 root rtd unknown /proc/85522/root (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:bash 85522 root txt unknown /proc/85522/exe (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:bash 85522 root NOFD /proc/85522/fd (opendir: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 85973 root cwd unknown /proc/85973/cwd (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 85973 root rtd unknown /proc/85973/root (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 85973 root txt unknown /proc/85973/exe (readlink: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/1 85973 root NOFD /proc/85973/fd (opendir: Permission denied) 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T22:18:55.884 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu txt REG 8,1 41128 11685 /usr/bin/timeout 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T22:18:55.885 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu 0r FIFO 0,13 0t0 231833 pipe 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu 1w FIFO 0,13 0t0 231834 pipe 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:timeout 87508 ubuntu 2w FIFO 0,13 0t0 231835 pipe 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu txt REG 8,1 1389072 11254 /usr/bin/bash 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 2586930 19889 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 54 19892 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 3284 32609 /usr/lib/locale/en_US.utf8/LC_TIME 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 286 32606 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T22:18:55.886 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 57 30370 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 34 32659 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 77 19891 /usr/lib/locale/en_US.utf8/LC_NAME 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 167 32601 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 59 32608 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 23 32605 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 195080 11252 /usr/lib64/libtinfo.so.6.2 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 369 32604 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu 0r FIFO 0,13 0t0 231833 pipe 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu 1w FIFO 0,13 0t0 231834 pipe 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu 2w FIFO 0,13 0t0 231835 pipe 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:fsync-tes 87526 ubuntu 255r REG 8,1 207 655476 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 88729 root cwd unknown /proc/88729/cwd (readlink: Permission denied) 2024-09-10T22:18:55.887 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 88729 root rtd unknown /proc/88729/root (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 88729 root txt unknown /proc/88729/exe (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/7 88729 root NOFD /proc/88729/fd (opendir: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 88917 root cwd unknown /proc/88917/cwd (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 88917 root rtd unknown /proc/88917/root (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 88917 root txt unknown /proc/88917/exe (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:kworker/u 88917 root NOFD /proc/88917/fd (opendir: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 89704 root cwd unknown /proc/89704/cwd (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 89704 root rtd unknown /proc/89704/root (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 89704 root txt unknown /proc/89704/exe (readlink: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:sleep 89704 root NOFD /proc/89704/fd (opendir: Permission denied) 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-10T22:18:55.888 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T22:18:55.889 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 0r FIFO 0,13 0t0 231833 pipe 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 1w FIFO 0,13 0t0 231834 pipe 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 2w FIFO 0,13 0t0 231835 pipe 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 3r DIR 0,20 0 1 /proc 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 4r DIR 0,20 0 239354 /proc/89707/fd 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 5w FIFO 0,13 0t0 239359 pipe 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89707 ubuntu 6r FIFO 0,13 0t0 239360 pipe 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu cwd DIR 0,120 4 1099511627782 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu rtd DIR 8,1 4096 2 / 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu txt REG 8,1 179232 13934 /usr/bin/lsof 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 5436544 2392 /usr/lib64/libcrypto.so.3.2.2 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 346132 32690 /usr/lib/locale/C.utf8/LC_CTYPE 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 102672 11274 /usr/lib64/libz.so.1.2.11 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 70880 11221 /usr/lib64/libresolv.so.2 2024-09-10T22:18:55.890 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 23992 11348 /usr/lib64/libkeyutils.so.1.10 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 66320 12998 /usr/lib64/libkrb5support.so.0.1 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 23872 11298 /usr/lib64/libcom_err.so.2.1 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 906368 12996 /usr/lib64/libkrb5.so.3.3 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 358560 12986 /usr/lib64/libgssapi_krb5.so.2.2 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 636848 11327 /usr/lib64/libpcre2-8.so.0.11.0 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 2544296 11212 /usr/lib64/libc.so.6 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 99112 12990 /usr/lib64/libk5crypto.so.3.1 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 196224 13024 /usr/lib64/libtirpc.so.3.0.0 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 175744 11412 /usr/lib64/libselinux.so.1 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 26988 31782 /usr/lib64/gconv/gconv-modules.cache 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu mem REG 8,1 877424 15688 /usr/lib64/ld-linux-x86-64.so.2 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu 4r FIFO 0,13 0t0 239359 pipe 2024-09-10T22:18:55.891 INFO:tasks.workunit.client.0.smithi005.stdout:lsof 89708 ubuntu 7w FIFO 0,13 0t0 239360 pipe 2024-09-10T22:18:55.892 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T22:18:55.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T22:18:55.893 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:55 smithi005 ceph-mon[31115]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:55.893 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:55 smithi052 ceph-mon[34997]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:55.893 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:55 smithi189 ceph-mon[35784]: pgmap v408: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.3 MiB/s wr, 11 op/s 2024-09-10T22:18:55.935 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2024-09-10T22:18:55.935 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T22:18:56.282 DEBUG:teuthology.parallel:result is None 2024-09-10T22:18:56.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T22:18:56.314 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T22:18:56.314 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-10T22:18:56.324 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:18:56.362 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-10T22:18:56.371 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-10T22:18:57.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:57 smithi052 ceph-mon[34997]: pgmap v409: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 12 op/s 2024-09-10T22:18:57.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:57 smithi005 ceph-mon[31115]: pgmap v409: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 12 op/s 2024-09-10T22:18:57.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:57 smithi189 ceph-mon[35784]: pgmap v409: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 864 KiB/s wr, 12 op/s 2024-09-10T22:18:59.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:18:59 smithi052 ceph-mon[34997]: pgmap v410: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 861 KiB/s wr, 10 op/s 2024-09-10T22:18:59.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:18:59 smithi005 ceph-mon[31115]: pgmap v410: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 861 KiB/s wr, 10 op/s 2024-09-10T22:18:59.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:18:59 smithi189 ceph-mon[35784]: pgmap v410: 97 pgs: 97 active+clean; 258 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 861 KiB/s wr, 10 op/s 2024-09-10T22:19:01.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:01 smithi052 ceph-mon[34997]: pgmap v411: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T22:19:01.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:01 smithi005 ceph-mon[31115]: pgmap v411: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T22:19:01.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:01 smithi189 ceph-mon[35784]: pgmap v411: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2024-09-10T22:19:03.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:03 smithi052 ceph-mon[34997]: pgmap v412: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 607 KiB/s wr, 12 op/s 2024-09-10T22:19:03.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:03 smithi005 ceph-mon[31115]: pgmap v412: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 607 KiB/s wr, 12 op/s 2024-09-10T22:19:03.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:03 smithi189 ceph-mon[35784]: pgmap v412: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 607 KiB/s wr, 12 op/s 2024-09-10T22:19:05.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:05 smithi052 ceph-mon[34997]: pgmap v413: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-09-10T22:19:05.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:05 smithi005 ceph-mon[31115]: pgmap v413: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-09-10T22:19:05.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:05 smithi189 ceph-mon[35784]: pgmap v413: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 2.3 MiB/s wr, 9 op/s 2024-09-10T22:19:06.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:06 smithi005 ceph-mon[31115]: pgmap v414: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.8 MiB/s wr, 13 op/s 2024-09-10T22:19:06.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:06 smithi189 ceph-mon[35784]: pgmap v414: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.8 MiB/s wr, 13 op/s 2024-09-10T22:19:06.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:06 smithi052 ceph-mon[34997]: pgmap v414: 97 pgs: 97 active+clean; 257 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.8 MiB/s wr, 13 op/s 2024-09-10T22:19:09.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:08 smithi005 ceph-mon[31115]: pgmap v415: 97 pgs: 97 active+clean; 245 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2024-09-10T22:19:09.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:08 smithi189 ceph-mon[35784]: pgmap v415: 97 pgs: 97 active+clean; 245 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2024-09-10T22:19:09.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:08 smithi052 ceph-mon[34997]: pgmap v415: 97 pgs: 97 active+clean; 245 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 15 MiB/s wr, 12 op/s 2024-09-10T22:19:10.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-10T22:19:10.751 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:11.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:10 smithi005 ceph-mon[31115]: pgmap v416: 97 pgs: 97 active+clean; 149 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 18 MiB/s wr, 15 op/s 2024-09-10T22:19:11.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:10 smithi189 ceph-mon[35784]: pgmap v416: 97 pgs: 97 active+clean; 149 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 18 MiB/s wr, 15 op/s 2024-09-10T22:19:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 -- 172.21.15.5:0/910323413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 msgr2=0x7fadf81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 --2- 172.21.15.5:0/910323413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf81031c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009900 tx=0x7fadf002a410 comp rx=0 tx=0).stop 2024-09-10T22:19:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 -- 172.21.15.5:0/910323413 shutdown_connections 2024-09-10T22:19:11.225 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 --2- 172.21.15.5:0/910323413 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf8109170 0x7fadf810f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 --2- 172.21.15.5:0/910323413 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf81087f0 0x7fadf8108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 --2- 172.21.15.5:0/910323413 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf81031c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 -- 172.21.15.5:0/910323413 >> 172.21.15.5:0/910323413 conn(0x7fadf80fe830 msgr2=0x7fadf8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 -- 172.21.15.5:0/910323413 shutdown_connections 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 -- 172.21.15.5:0/910323413 wait complete. 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 Processor -- start 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.222+0000 7fae00780640 1 -- start start 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fae00780640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fae00780640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf81087f0 0x7fadf80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fae00780640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf8109170 0x7fadf8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fae00780640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112e70 con 0x7fadf8102de0 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fae00780640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112cf0 con 0x7fadf8109170 2024-09-10T22:19:11.226 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fae00780640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8112ff0 con 0x7fadf81087f0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf80754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39370/0 (socket says 172.21.15.5:39370) 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 -- 172.21.15.5:0/2679877855 learned_addr learned my addr 172.21.15.5:0/2679877855 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf81087f0 0x7fadf80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfed1d640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf8109170 0x7fadf8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 -- 172.21.15.5:0/2679877855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf81087f0 msgr2=0x7fadf80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf81087f0 0x7fadf80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 -- 172.21.15.5:0/2679877855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf8109170 msgr2=0x7fadf8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf8109170 0x7fadf8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 -- 172.21.15.5:0/2679877855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf81a77f0 con 0x7fadf8102de0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfed1d640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf8109170 0x7fadf8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf81087f0 0x7fadf80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.223+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf80754a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fadf0006010 tx=0x7fadf00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.224+0000 7fadf77fe640 1 -- 172.21.15.5:0/2679877855 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf003f030 con 0x7fadf8102de0 2024-09-10T22:19:11.227 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.224+0000 7fadf77fe640 1 -- 172.21.15.5:0/2679877855 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0003800 con 0x7fadf8102de0 2024-09-10T22:19:11.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.224+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf81a7a80 con 0x7fadf8102de0 2024-09-10T22:19:11.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.224+0000 7fadf77fe640 1 -- 172.21.15.5:0/2679877855 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0035070 con 0x7fadf8102de0 2024-09-10T22:19:11.228 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.224+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf81a7fe0 con 0x7fadf8102de0 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 Processor -- start 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 -- start start 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fadf77fe640 1 -- 172.21.15.5:0/2679877855 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fadf0031b10 con 0x7fadf8102de0 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5653ae91fe50 con 0x5653ae9a99c0 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653ae90f280 con 0x5653ae9a90a0 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fae02b55740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5653ae913090 con 0x5653ae9b5950 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fadfe51c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.230 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fadfe51c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9b5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39384/0 (socket says 172.21.15.5:39384) 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.227+0000 7fadfe51c640 1 -- 172.21.15.5:0/1268642658 learned_addr learned my addr 172.21.15.5:0/1268642658 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfed1d640 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfe51c640 1 -- 172.21.15.5:0/1268642658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 msgr2=0x5653ae9b7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfe51c640 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9b7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfe51c640 1 -- 172.21.15.5:0/1268642658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 msgr2=0x5653ae9a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfe51c640 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfe51c640 1 -- 172.21.15.5:0/1268642658 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ae66d650 con 0x5653ae9a99c0 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfed1d640 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfe51c640 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9b5410 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fadf010c750 tx=0x7fadf010c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaeba0e09bab5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadf77fe640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fade00b52e0 0x7fade00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadf4ff9640 1 -- 172.21.15.5:0/1268642658 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00c9420 con 0x5653ae9a99c0 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadfed1d640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fade00b52e0 0x7fade00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.231 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadf4ff9640 1 -- 172.21.15.5:0/1268642658 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0113030 con 0x5653ae9a99c0 2024-09-10T22:19:11.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.228+0000 7fadf4ff9640 1 -- 172.21.15.5:0/1268642658 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00cc720 con 0x5653ae9a99c0 2024-09-10T22:19:11.232 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fadf77fe640 1 -- 172.21.15.5:0/2679877855 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fadf01065e0 con 0x7fadf8102de0 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 -- 172.21.15.5:0/1268642658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 msgr2=0x5653ae9b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fadfed1d640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fade00b52e0 0x7fade00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadf8077560 tx=0x7fade8009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9b5410 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fadf010c750 tx=0x7fadf010c840 comp rx=0 tx=0).stop 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 -- 172.21.15.5:0/1268642658 shutdown_connections 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9b7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9b5410 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 --2- 172.21.15.5:0/1268642658 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 -- 172.21.15.5:0/1268642658 >> 172.21.15.5:0/1268642658 conn(0x5653ae9a6ed0 msgr2=0x5653ae9a8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:11.235 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 -- 172.21.15.5:0/1268642658 shutdown_connections 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.229+0000 7fae02b55740 1 -- 172.21.15.5:0/1268642658 wait complete. 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 -- start start 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 Processor -- start 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a90a0 0x5653ae9b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a99c0 0x5653ae9b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 0x5653ae9b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x5653ae770700 con 0x5653ae9b5950 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x5653ae8aa110 con 0x5653ae9a99c0 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5653ae9b8390 con 0x5653ae9a90a0 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fae02b55740 10 client.0 _ll_register_callbacks cb 0x5653ae8c3990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fadfed1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 0x5653ae9b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fadfed1d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 0x5653ae9b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39392/0 (socket says 172.21.15.5:39392) 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fadfed1d640 1 -- 172.21.15.5:0/1653516975 learned_addr learned my addr 172.21.15.5:0/1653516975 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:11.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fadfe51c640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a90a0 0x5653ae9b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.230+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a99c0 0x5653ae9b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadfed1d640 1 -- 172.21.15.5:0/1653516975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a90a0 msgr2=0x5653ae9b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadfed1d640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a90a0 0x5653ae9b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadfed1d640 1 -- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a99c0 msgr2=0x5653ae9b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadfed1d640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a99c0 0x5653ae9b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadfed1d640 1 -- 172.21.15.5:0/1653516975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653ae8d7c40 con 0x5653ae9b5950 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadfed1d640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 0x5653ae9b2c00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fade801ae00 tx=0x7fade8004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1959951f2b349543 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadddffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadddffb640 1 -- 172.21.15.5:0/1653516975 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade8028060 con 0x5653ae9b5950 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadddffb640 1 -- 172.21.15.5:0/1653516975 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fade80078d0 con 0x5653ae9b5950 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf0113030 con 0x5653ae9b5950 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadddffb640 1 -- 172.21.15.5:0/1653516975 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fade8007ad0 con 0x5653ae9b5950 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fae02b55740 10 client.15843 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:11.237 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5653ae9c3c60 con 0x5653ae9b5950 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.231+0000 7fadddffb640 1 -- 172.21.15.5:0/1653516975 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0113030 con 0x5653ae9b5950 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fadddffb640 1 -- 172.21.15.5:0/1653516975 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fade8023b30 con 0x5653ae9b5950 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fae02b55740 10 client.15843 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fae02b55740 10 client.15843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fae02b55740 20 client.15843 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fae02b55740 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653ae9c51c0 0x5653ae9c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fae02b55740 4 client.15843 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653ae921da0 con 0x5653ae9c51c0 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fadfe51c640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653ae9c51c0 0x5653ae9c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fadfe51c640 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653ae9c51c0 0x5653ae9c75d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d05d1f25e203435 server_cookie=7f811f71ee6c37fc in_seq=0 out_seq=0 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.232+0000 7fadddffb640 10 client.15843 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fadddffb640 1 -- 172.21.15.5:0/1653516975 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653ae921da0 con 0x5653ae9c51c0 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fadddffb640 10 client.15843 handle_command_reply: tid=0 2024-09-10T22:19:11.238 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 client.15843 shutdown 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 msgr2=0x5653ae9b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 0x5653ae9b2c00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fade801ae00 tx=0x7fade8004b50 comp rx=0 tx=0).stop 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 shutdown_connections 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653ae9c51c0 0x5653ae9c75d0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9b5950 0x5653ae9b2c00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a99c0 0x5653ae9b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 --2- 172.21.15.5:0/1653516975 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a90a0 0x5653ae9b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fadddffb640 0 client.15843 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 >> 172.21.15.5:0/1653516975 conn(0x5653ae9a6ed0 msgr2=0x5653ae9aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 shutdown_connections 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.233+0000 7fae02b55740 1 -- 172.21.15.5:0/1653516975 wait complete. 2024-09-10T22:19:11.239 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.234+0000 7fae02b55740 20 client.15843 trim_cache size 0 max 16384 2024-09-10T22:19:11.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:10 smithi052 ceph-mon[34997]: pgmap v416: 97 pgs: 97 active+clean; 149 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 18 MiB/s wr, 15 op/s 2024-09-10T22:19:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 Processor -- start 2024-09-10T22:19:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 -- start start 2024-09-10T22:19:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 0x5653ae9a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a99c0 0x5653ae9af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9b5950 0x5653ae9afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.253 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b2e20 con 0x5653ae9a90a0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b06f0 con 0x5653ae9b5950 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fae02b55740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81ae540 con 0x5653ae9a99c0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fadfe51c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 0x5653ae9a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fadfe51c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 0x5653ae9a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39400/0 (socket says 172.21.15.5:39400) 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fadfe51c640 1 -- 172.21.15.5:0/2300722062 learned_addr learned my addr 172.21.15.5:0/2300722062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a99c0 0x5653ae9af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.251+0000 7fadfed1d640 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9b5950 0x5653ae9afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7fadfe51c640 1 -- 172.21.15.5:0/2300722062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a99c0 msgr2=0x5653ae9af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a99c0 0x5653ae9af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7fadfe51c640 1 -- 172.21.15.5:0/2300722062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9b5950 msgr2=0x5653ae9afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9b5950 0x5653ae9afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7fadfe51c640 1 -- 172.21.15.5:0/2300722062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653ae9b80b0 con 0x5653ae9a90a0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 0x5653ae9a84f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fadf00a5c50 tx=0x7fadf0031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177d32c65b2c9aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:11.254 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7faddffff640 1 -- 172.21.15.5:0/2300722062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0049040 con 0x5653ae9a90a0 2024-09-10T22:19:11.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7faddffff640 1 -- 172.21.15.5:0/2300722062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0113070 con 0x5653ae9a90a0 2024-09-10T22:19:11.255 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.252+0000 7faddffff640 1 -- 172.21.15.5:0/2300722062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf00cc910 con 0x5653ae9a90a0 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- 172.21.15.5:0/2300722062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 msgr2=0x5653ae9a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 0x5653ae9a84f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fadf00a5c50 tx=0x7fadf0031400 comp rx=0 tx=0).stop 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- 172.21.15.5:0/2300722062 shutdown_connections 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9b5950 0x5653ae9afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9a99c0 0x5653ae9af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- 172.21.15.5:0/2300722062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a90a0 0x5653ae9a84f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- 172.21.15.5:0/2300722062 >> 172.21.15.5:0/2300722062 conn(0x5653ae9a6ed0 msgr2=0x5653ae9a7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:11.258 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- 172.21.15.5:0/2300722062 shutdown_connections 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- 172.21.15.5:0/2300722062 wait complete. 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- start start 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 Processor -- start 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9bde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9baa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81aebb0 con 0x5653ae9a99c0 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81b0020 con 0x5653ae9a90a0 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fadf81af280 con 0x5653ae9b5950 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fae02b55740 10 client.0 _ll_register_callbacks cb 0x7fade80071d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fadfdd1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fadfdd1b640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9ba3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:39416/0 (socket says 172.21.15.5:39416) 2024-09-10T22:19:11.259 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.253+0000 7fadfdd1b640 1 -- 172.21.15.5:0/2921129030 learned_addr learned my addr 172.21.15.5:0/2921129030 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfed1d640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9baa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfdd1b640 1 -- 172.21.15.5:0/2921129030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 msgr2=0x5653ae9baa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9baa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfdd1b640 1 -- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 msgr2=0x5653ae9bde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9bde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfdd1b640 1 -- 172.21.15.5:0/2921129030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653aea320f0 con 0x5653ae9a99c0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9bde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadfdd1b640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9ba3c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fadec014600 tx=0x7fadec014ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9defd1c95fe2fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadddffb640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadddffb640 1 -- 172.21.15.5:0/2921129030 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadec016730 con 0x5653ae9a99c0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadf0113070 con 0x5653ae9a99c0 2024-09-10T22:19:11.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadddffb640 1 -- 172.21.15.5:0/2921129030 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fadec0168d0 con 0x5653ae9a99c0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fadddffb640 1 -- 172.21.15.5:0/2921129030 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fadec027070 con 0x5653ae9a99c0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.254+0000 7fae02b55740 10 client.15849 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5653aea33340 con 0x5653ae9a99c0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fadddffb640 1 -- 172.21.15.5:0/2921129030 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf0113070 con 0x5653ae9a99c0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fadddffb640 1 -- 172.21.15.5:0/2921129030 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fadec012430 con 0x5653ae9a99c0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 10 client.15849 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 20 client.15849 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653aea33ad0 0x5653aea35ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 4 client.15849 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5653ae91d850 con 0x5653aea33ad0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.255+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653aea33ad0 0x5653aea35ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fadddffb640 10 client.15849 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fadfe51c640 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653aea33ad0 0x5653aea35ef0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70dbc6949627206f server_cookie=e2353e1a222efbaf in_seq=0 out_seq=0 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fadddffb640 1 -- 172.21.15.5:0/2921129030 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x5653ae91d850 con 0x5653aea33ad0 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fadddffb640 10 client.15849 handle_command_reply: tid=0 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 client.15849 shutdown 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 msgr2=0x5653ae9ba3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9ba3c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fadec014600 tx=0x7fadec014ac0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 shutdown_connections 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x5653aea33ad0 0x5653aea35ef0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fadddffb640 0 client.15849 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5653ae9b5950 0x5653ae9baa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5653ae9a99c0 0x5653ae9ba3c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 --2- 172.21.15.5:0/2921129030 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5653ae9a90a0 0x5653ae9bde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 >> 172.21.15.5:0/2921129030 conn(0x5653ae9a6ed0 msgr2=0x5653ae9a5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 shutdown_connections 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 1 -- 172.21.15.5:0/2921129030 wait complete. 2024-09-10T22:19:11.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.256+0000 7fae02b55740 20 client.15849 trim_cache size 0 max 16384 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "status": "no active scrubs running", 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "scrubs": {}, 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "scrub_stats": { 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "2fa26f4a-4cae-4217-b147-84a07cb3abd9": { 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:18:38.096194+0000", 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:19:11.263 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "f77c5dc5-804e-4f38-a87c-99a8b446d95b": { 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:18:25.822342+0000", 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "c3f491a8-f960-4d70-807d-4784191d67d0": { 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:43.094860+0000", 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:19:11.264 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "ca33c8df-ea06-4594-a818-6505a6146628": { 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "start_time": "2024-09-10T22:17:00.969370+0000", 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "path": "/", 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_started": 0, 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_passed": 0, 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_failed": 0, 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: "uninline_skipped": 0 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:11.265 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fade00b52e0 msgr2=0x7fade00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fade00b52e0 0x7fade00b77a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fadf8077560 tx=0x7fade8009710 comp rx=0 tx=0).stop 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 msgr2=0x7fadf80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf80754a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fadf0006010 tx=0x7fadf00042f0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 shutdown_connections 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fade00b52e0 0x7fade00b77a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.266 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fadf8109170 0x7fadf8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fadf81087f0 0x7fadf80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 --2- 172.21.15.5:0/2679877855 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fadf8102de0 0x7fadf80754a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 >> 172.21.15.5:0/2679877855 conn(0x7fadf80fe830 msgr2=0x7fadf8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 shutdown_connections 2024-09-10T22:19:11.267 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:11.257+0000 7fae00780640 1 -- 172.21.15.5:0/2679877855 wait complete. 2024-09-10T22:19:12.141 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-10T22:19:12.142 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:19:12.403 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 -- 172.21.15.5:0/1183669108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184102190 msgr2=0x7f618410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 --2- 172.21.15.5:0/1183669108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184102190 0x7f618410eee0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6178009900 tx=0x7f617802a3f0 comp rx=0 tx=0).stop 2024-09-10T22:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 -- 172.21.15.5:0/1183669108 shutdown_connections 2024-09-10T22:19:12.875 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 --2- 172.21.15.5:0/1183669108 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f618410f420 0x7f6184111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 --2- 172.21.15.5:0/1183669108 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184102190 0x7f618410eee0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 --2- 172.21.15.5:0/1183669108 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f6184101870 0x7f6184101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 -- 172.21.15.5:0/1183669108 >> 172.21.15.5:0/1183669108 conn(0x7f61840fd700 msgr2=0x7f61840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 -- 172.21.15.5:0/1183669108 shutdown_connections 2024-09-10T22:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.873+0000 7f6189e23640 1 -- 172.21.15.5:0/1183669108 wait complete. 2024-09-10T22:19:12.876 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.874+0000 7f6189e23640 1 Processor -- start 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.874+0000 7f6189e23640 1 -- start start 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6189e23640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 0x7f618419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6189e23640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184102190 0x7f618419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6189e23640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f618410f420 0x7f61841a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6189e23640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f6184114f90 con 0x7f6184101870 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6189e23640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f6184114e10 con 0x7f618410f420 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6189e23640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f6184115110 con 0x7f6184102190 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 0x7f618419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 0x7f618419b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54114/0 (socket says 172.21.15.5:54114) 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 -- 172.21.15.5:0/2621100971 learned_addr learned my addr 172.21.15.5:0/2621100971 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6182ffd640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184102190 0x7f618419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:12.878 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6183fff640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f618410f420 0x7f61841a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 -- 172.21.15.5:0/2621100971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184102190 msgr2=0x7f618419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184102190 0x7f618419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 -- 172.21.15.5:0/2621100971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f618410f420 msgr2=0x7f61841a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f618410f420 0x7f61841a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 -- 172.21.15.5:0/2621100971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61841a1530 con 0x7f6184101870 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f6183fff640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f618410f420 0x7f61841a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.875+0000 7f61837fe640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 0x7f618419b480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f617400d950 tx=0x7f617400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.876+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174017030 con 0x7f6184101870 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.876+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61841a1820 con 0x7f6184101870 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.876+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6174004020 con 0x7f6184101870 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.876+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61740047a0 con 0x7f6184101870 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.876+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61841a80b0 con 0x7f6184101870 2024-09-10T22:19:12.879 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.877+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618406bb90 con 0x7f6184101870 2024-09-10T22:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.878+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f6174009a30 con 0x7f6184101870 2024-09-10T22:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.879+0000 7f6180ff9640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f616c0b52e0 0x7f616c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.879+0000 7f6182ffd640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f616c0b52e0 0x7f616c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:12.880 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.879+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f61740e5dd0 con 0x7f6184101870 2024-09-10T22:19:12.881 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.879+0000 7f6182ffd640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f616c0b52e0 0x7f616c0b77a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6178031440 tx=0x7f61780095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:12.883 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:12.882+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f61740acc60 con 0x7f6184101870 2024-09-10T22:19:13.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:12 smithi005 ceph-mon[31115]: pgmap v417: 97 pgs: 97 active+clean; 33 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 20 MiB/s wr, 19 op/s 2024-09-10T22:19:13.108 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.107+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61841a8350 con 0x7f6184101870 2024-09-10T22:19:13.109 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.108+0000 7f6180ff9640 1 -- 172.21.15.5:0/2621100971 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f61740ac560 con 0x7f6184101870 2024-09-10T22:19:13.109 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:19:13.110 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:19:13.110 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f616c0b52e0 msgr2=0x7f616c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f616c0b52e0 0x7f616c0b77a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6178031440 tx=0x7f61780095f0 comp rx=0 tx=0).stop 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 msgr2=0x7f618419b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 0x7f618419b480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f617400d950 tx=0x7f617400de10 comp rx=0 tx=0).stop 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 shutdown_connections 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f616c0b52e0 0x7f616c0b77a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f618410f420 0x7f61841a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:13.112 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f6184102190 0x7f618419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 --2- 172.21.15.5:0/2621100971 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f6184101870 0x7f618419b480 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.110+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 >> 172.21.15.5:0/2621100971 conn(0x7f61840fd700 msgr2=0x7f61840ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.111+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 shutdown_connections 2024-09-10T22:19:13.113 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:13.111+0000 7f6189e23640 1 -- 172.21.15.5:0/2621100971 wait complete. 2024-09-10T22:19:13.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:12 smithi189 ceph-mon[35784]: pgmap v417: 97 pgs: 97 active+clean; 33 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 20 MiB/s wr, 19 op/s 2024-09-10T22:19:13.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:12 smithi052 ceph-mon[34997]: pgmap v417: 97 pgs: 97 active+clean; 33 MiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 20 MiB/s wr, 19 op/s 2024-09-10T22:19:13.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-10T22:19:14.176 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:14.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:13 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2621100971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:14.252 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:13 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2621100971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:14.290 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:13 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2621100971' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.644+0000 7ff98aad9640 1 -- 172.21.15.5:0/1086815488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 msgr2=0x7ff984102070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.644+0000 7ff98aad9640 1 --2- 172.21.15.5:0/1086815488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984102070 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff978009900 tx=0x7ff97802a410 comp rx=0 tx=0).stop 2024-09-10T22:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 -- 172.21.15.5:0/1086815488 shutdown_connections 2024-09-10T22:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 --2- 172.21.15.5:0/1086815488 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff984108020 0x7ff98410e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 --2- 172.21.15.5:0/1086815488 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff9841076a0 0x7ff984107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.660 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 --2- 172.21.15.5:0/1086815488 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984102070 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 -- 172.21.15.5:0/1086815488 >> 172.21.15.5:0/1086815488 conn(0x7ff9840fd700 msgr2=0x7ff9840ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 -- 172.21.15.5:0/1086815488 shutdown_connections 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 -- 172.21.15.5:0/1086815488 wait complete. 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 Processor -- start 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.645+0000 7ff98aad9640 1 -- start start 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff98aad9640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff98aad9640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9841076a0 0x7ff984198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff98aad9640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff984108020 0x7ff98419db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff98aad9640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff984111ce0 con 0x7ff984101c90 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff98aad9640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff984111b60 con 0x7ff984108020 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff98aad9640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff984111e60 con 0x7ff9841076a0 2024-09-10T22:19:14.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984198250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54136/0 (socket says 172.21.15.5:54136) 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 -- 172.21.15.5:0/3564344452 learned_addr learned my addr 172.21.15.5:0/3564344452 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff983fff640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9841076a0 0x7ff984198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff989076640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff984108020 0x7ff98419db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 -- 172.21.15.5:0/3564344452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9841076a0 msgr2=0x7ff984198790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9841076a0 0x7ff984198790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 -- 172.21.15.5:0/3564344452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff984108020 msgr2=0x7ff98419db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff984108020 0x7ff98419db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff988875640 1 -- 172.21.15.5:0/3564344452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98419e300 con 0x7ff984101c90 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.646+0000 7ff983fff640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9841076a0 0x7ff984198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:14.662 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.647+0000 7ff988875640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984198250 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff978005940 tx=0x7ff978004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.647+0000 7ff981ffb640 1 -- 172.21.15.5:0/3564344452 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97803f030 con 0x7ff984101c90 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.647+0000 7ff981ffb640 1 -- 172.21.15.5:0/3564344452 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff978003aa0 con 0x7ff984101c90 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.647+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98419e590 con 0x7ff984101c90 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.647+0000 7ff981ffb640 1 -- 172.21.15.5:0/3564344452 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978035070 con 0x7ff984101c90 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.647+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98406aab0 con 0x7ff984101c90 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.650+0000 7ff98ceae740 1 Processor -- start 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.650+0000 7ff98ceae740 1 -- start start 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.650+0000 7ff981ffb640 1 -- 172.21.15.5:0/3564344452 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ff97803bce0 con 0x7ff984101c90 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.650+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 0x55decd4b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.650+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b1a10 0x55decd4bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff98ceae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55decd427ea0 con 0x55decd4b10f0 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff98ceae740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55decd4172d0 con 0x55decd4bd9a0 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff98ceae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55decd41b0e0 con 0x55decd4b1a10 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 0x55decd4b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 0x55decd4b14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54146/0 (socket says 172.21.15.5:54146) 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 -- 172.21.15.5:0/3928417189 learned_addr learned my addr 172.21.15.5:0/3928417189 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff988875640 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b1a10 0x55decd4bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff983fff640 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.664 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 -- 172.21.15.5:0/3928417189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b1a10 msgr2=0x55decd4bd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b1a10 0x55decd4bd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 -- 172.21.15.5:0/3928417189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 msgr2=0x55decd4bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 -- 172.21.15.5:0/3928417189 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decd175650 con 0x55decd4b10f0 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff989076640 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 0x55decd4b14d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009f70 tx=0x7ff97c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccffe78bb578b397 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.651+0000 7ff96effd640 1 -- 172.21.15.5:0/3928417189 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c016070 con 0x55decd4b10f0 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff96effd640 1 -- 172.21.15.5:0/3928417189 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97c004d20 con 0x55decd4b10f0 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff96effd640 1 -- 172.21.15.5:0/3928417189 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c012770 con 0x55decd4b10f0 2024-09-10T22:19:14.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff981ffb640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff9740b52e0 0x7ff9740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff988875640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff9740b52e0 0x7ff9740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff981ffb640 1 -- 172.21.15.5:0/3564344452 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff978106540 con 0x7ff984101c90 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 -- 172.21.15.5:0/3928417189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 msgr2=0x55decd4b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff988875640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff9740b52e0 0x7ff9740b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff9781043e0 tx=0x7ff97810c0e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 0x55decd4b14d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009f70 tx=0x7ff97c010800 comp rx=0 tx=0).stop 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 -- 172.21.15.5:0/3928417189 shutdown_connections 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b1a10 0x55decd4bd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3928417189 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b10f0 0x55decd4b14d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 -- 172.21.15.5:0/3928417189 >> 172.21.15.5:0/3928417189 conn(0x55decd4aef20 msgr2=0x55decd4b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.652+0000 7ff98ceae740 1 -- 172.21.15.5:0/3928417189 shutdown_connections 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 -- 172.21.15.5:0/3928417189 wait complete. 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 -- start start 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 Processor -- start 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4bd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 0x55decd4ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 0x55decd4baba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55decd278700 con 0x55decd4bd9a0 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x55decd3b2160 con 0x55decd4b1a10 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x55decd4c0620 con 0x55decd4b10f0 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff98ceae740 10 client.0 _ll_register_callbacks cb 0x55decd3cb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.653+0000 7ff989076640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 0x55decd4baba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 0x55decd4ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.667 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff989076640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 0x55decd4baba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54154/0 (socket says 172.21.15.5:54154) 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 0x55decd4ba640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:57760/0 (socket says 172.21.15.5:57760) 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff989076640 1 -- 172.21.15.5:0/3219492883 learned_addr learned my addr 172.21.15.5:0/3219492883 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff989076640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4bd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 -- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 msgr2=0x55decd4bd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4bd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 -- 172.21.15.5:0/3219492883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 msgr2=0x55decd4baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 0x55decd4baba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 -- 172.21.15.5:0/3219492883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decd3dfc90 con 0x55decd4b1a10 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff989076640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 0x55decd4baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff983fff640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 0x55decd4ba640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff97000ea00 tx=0x7ff97000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276378394946972d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff963fff640 10 client.0 ms_handle_connect on v2:172.21.15.52:3300/0 2024-09-10T22:19:14.668 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff963fff640 1 -- 172.21.15.5:0/3219492883 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97000b940 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff97c004d20 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff963fff640 1 -- 172.21.15.5:0/3219492883 <== mon.2 v2:172.21.15.52:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff97000bae0 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff963fff640 1 -- 172.21.15.5:0/3219492883 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff97000bce0 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff98ceae740 10 client.25430 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.654+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55decd4cbf40 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff963fff640 1 -- 172.21.15.5:0/3219492883 <== mon.2 v2:172.21.15.52:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97c004d20 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff963fff640 1 -- 172.21.15.5:0/3219492883 <== mon.2 v2:172.21.15.52:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff9700194e0 con 0x55decd4b1a10 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff98ceae740 10 client.25430 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:14.669 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff98ceae740 10 client.25430 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff98ceae740 20 client.25430 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd4cd4f0 0x55decd4cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff98ceae740 4 client.25430 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55decd429df0 con 0x55decd4cd4f0 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.655+0000 7ff989076640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd4cd4f0 0x55decd4cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff989076640 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd4cd4f0 0x55decd4cf910 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=86e80b663cead368 server_cookie=a5e15b1ec4c7a9a8 in_seq=0 out_seq=0 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff963fff640 10 client.25430 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff963fff640 1 -- 172.21.15.5:0/3219492883 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55decd429df0 con 0x55decd4cd4f0 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff963fff640 10 client.25430 handle_command_reply: tid=0 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 client.25430 shutdown 2024-09-10T22:19:14.670 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 msgr2=0x55decd4ba640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 0x55decd4ba640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff97000ea00 tx=0x7ff97000eec0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 shutdown_connections 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4bd9a0 0x55decd4baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd4cd4f0 0x55decd4cf910 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4b1a10 0x55decd4ba640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3219492883 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4bd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff963fff640 0 client.25430 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.656+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 >> 172.21.15.5:0/3219492883 conn(0x55decd4aef20 msgr2=0x55decd4b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.657+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 shutdown_connections 2024-09-10T22:19:14.671 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.657+0000 7ff98ceae740 1 -- 172.21.15.5:0/3219492883 wait complete. 2024-09-10T22:19:14.672 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.657+0000 7ff98ceae740 20 client.25430 trim_cache size 0 max 16384 2024-09-10T22:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.670+0000 7ff98ceae740 1 Processor -- start 2024-09-10T22:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.670+0000 7ff98ceae740 1 -- start start 2024-09-10T22:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4ba610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4ade60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.673 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4b7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff98ceae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841aea10 con 0x55decd4b1a10 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff98ceae740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841ac2e0 con 0x55decd4bd9a0 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff98ceae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841aa130 con 0x55decd4b10f0 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4ade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54166/0 (socket says 172.21.15.5:54166) 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 -- 172.21.15.5:0/1830027310 learned_addr learned my addr 172.21.15.5:0/1830027310 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff989076640 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4ba610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff989076640 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 -- 172.21.15.5:0/1830027310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 msgr2=0x55decd4ba610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4ba610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 -- 172.21.15.5:0/1830027310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 msgr2=0x55decd4b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.674 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4b7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 -- 172.21.15.5:0/1830027310 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55decd4bb180 con 0x55decd4b1a10 2024-09-10T22:19:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff989076640 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:19:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.671+0000 7ff983fff640 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4ade60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff970019af0 tx=0x7ff97001af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac132f940ee73a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff96e7fc640 1 -- 172.21.15.5:0/1830027310 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970034070 con 0x55decd4b1a10 2024-09-10T22:19:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff96e7fc640 1 -- 172.21.15.5:0/1830027310 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97001e070 con 0x55decd4b1a10 2024-09-10T22:19:14.675 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff96e7fc640 1 -- 172.21.15.5:0/1830027310 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff970019dd0 con 0x55decd4b1a10 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff98ceae740 1 -- 172.21.15.5:0/1830027310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 msgr2=0x55decd4ade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff98ceae740 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4ade60 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff970019af0 tx=0x7ff97001af50 comp rx=0 tx=0).stop 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff98ceae740 1 -- 172.21.15.5:0/1830027310 shutdown_connections 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff98ceae740 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd4b7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.672+0000 7ff98ceae740 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4ade60 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 --2- 172.21.15.5:0/1830027310 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4ba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- 172.21.15.5:0/1830027310 >> 172.21.15.5:0/1830027310 conn(0x55decd4aef20 msgr2=0x55decd4ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- 172.21.15.5:0/1830027310 shutdown_connections 2024-09-10T22:19:14.679 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- 172.21.15.5:0/1830027310 wait complete. 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- start start 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 Processor -- start 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd533490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841aa7a0 con 0x55decd4b1a10 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841abc10 con 0x55decd4bd9a0 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.673+0000 7ff98ceae740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ff9841aae70 con 0x55decd4b10f0 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff98ceae740 10 client.0 _ll_register_callbacks cb 0x7ff970009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:14.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.189:3300/0 says I am v2:172.21.15.5:43226/0 (socket says 172.21.15.5:43226) 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff983fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4c28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54180/0 (socket says 172.21.15.5:54180) 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 -- 172.21.15.5:0/3526612114 learned_addr learned my addr 172.21.15.5:0/3526612114 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd533490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 -- 172.21.15.5:0/3526612114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 msgr2=0x55decd533490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd533490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 -- 172.21.15.5:0/3526612114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 msgr2=0x55decd4c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.681 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 -- 172.21.15.5:0/3526612114 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decd533bd0 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff989076640 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4c2330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009640 tx=0x7ff970005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c111ceddf15eb server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff963fff640 10 client.0 ms_handle_connect on v2:172.21.15.189:3300/0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.674+0000 7ff963fff640 1 -- 172.21.15.5:0/3526612114 <== mon.1 v2:172.21.15.189:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c016040 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff963fff640 1 -- 172.21.15.5:0/3526612114 <== mon.1 v2:172.21.15.189:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ff97c005580 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff97001e070 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff963fff640 1 -- 172.21.15.5:0/3526612114 <== mon.1 v2:172.21.15.189:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff97c03c070 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 10 client.25450 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55decd53afc0 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff963fff640 1 -- 172.21.15.5:0/3526612114 <== mon.1 v2:172.21.15.189:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff97001e070 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff963fff640 1 -- 172.21.15.5:0/3526612114 <== mon.1 v2:172.21.15.189:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff970009ce0 con 0x55decd4b10f0 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 10 client.25450 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 10 client.25450 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 20 client.25450 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:14.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd53b580 0x55decd53d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 4 client.25450 mds_command: new command op to 24562 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 --> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55decd4258a0 con 0x55decd53b580 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.675+0000 7ff983fff640 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd53b580 0x55decd53d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff983fff640 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd53b580 0x55decd53d9a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf7e5c8703e2e749 server_cookie=9841fac4c667b3ab in_seq=0 out_seq=0 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff963fff640 10 client.25450 ms_handle_connect on v2:172.21.15.189:6838/3637381557 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff963fff640 1 -- 172.21.15.5:0/3526612114 <== mds.2 v2:172.21.15.189:6838/3637381557 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55decd4258a0 con 0x55decd53b580 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff963fff640 10 client.25450 handle_command_reply: tid=0 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 client.25450 shutdown 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 msgr2=0x55decd4c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4c2330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009640 tx=0x7ff970005f90 comp rx=0 tx=0).stop 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 shutdown_connections 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:6838/3637381557,v1:172.21.15.189:6839/3637381557] conn(0x55decd53b580 0x55decd53d9a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x55decd4bd9a0 0x55decd533490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x55decd4b1a10 0x55decd4c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff963fff640 0 client.25450 ms_handle_reset on v2:172.21.15.189:6838/3637381557 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 --2- 172.21.15.5:0/3526612114 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x55decd4b10f0 0x55decd4c2330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 >> 172.21.15.5:0/3526612114 conn(0x55decd4aef20 msgr2=0x55decd4adf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.676+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 shutdown_connections 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98ceae740 1 -- 172.21.15.5:0/3526612114 wait complete. 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98ceae740 20 client.25450 trim_cache size 0 max 16384 2024-09-10T22:19:14.684 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff9740b52e0 msgr2=0x7ff9740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff9740b52e0 0x7ff9740b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff9781043e0 tx=0x7ff97810c0e0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 msgr2=0x7ff984198250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984198250 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ff978005940 tx=0x7ff978004270 comp rx=0 tx=0).stop 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 shutdown_connections 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ff9740b52e0 0x7ff9740b77a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.685 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ff984108020 0x7ff98419db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ff9841076a0 0x7ff984198790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 --2- 172.21.15.5:0/3564344452 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ff984101c90 0x7ff984198250 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.677+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 >> 172.21.15.5:0/3564344452 conn(0x7ff9840fd700 msgr2=0x7ff984105ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.678+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 shutdown_connections 2024-09-10T22:19:14.686 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:14.678+0000 7ff98aad9640 1 -- 172.21.15.5:0/3564344452 wait complete. 2024-09-10T22:19:15.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:14 smithi189 ceph-mon[35784]: pgmap v418: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 21 MiB/s wr, 17 op/s 2024-09-10T22:19:15.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:14 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:15.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:14 smithi052 ceph-mon[34997]: pgmap v418: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 21 MiB/s wr, 17 op/s 2024-09-10T22:19:15.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:14 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:15.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:14 smithi005 ceph-mon[31115]: pgmap v418: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 21 MiB/s wr, 17 op/s 2024-09-10T22:19:15.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:14 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-10T22:19:15.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-10T22:19:15.665 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:16.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:15 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:16.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:15 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:16.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:15 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:19:16.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:15 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:16.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:15 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:16.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:15 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/379131550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f8075e00 msgr2=0x7fe3f810ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/379131550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f8075e00 0x7fe3f810ee90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009900 tx=0x7fe3e002a410 comp rx=0 tx=0).stop 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/379131550 shutdown_connections 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/379131550 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/379131550 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f8075e00 0x7fe3f810ee90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/379131550 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f80754e0 0x7fe3f80758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/379131550 >> 172.21.15.5:0/379131550 conn(0x7fe3f80fe830 msgr2=0x7fe3f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/379131550 shutdown_connections 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/379131550 wait complete. 2024-09-10T22:19:16.197 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.136+0000 7fe3fd4ba640 1 Processor -- start 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 -- start start 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f80754e0 0x7fe3f819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8075e00 0x7fe3f819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8114f80 con 0x7fe3f810f3d0 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8114e00 con 0x7fe3f8075e00 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3fd4ba640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8115100 con 0x7fe3f80754e0 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54196/0 (socket says 172.21.15.5:54196) 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 -- 172.21.15.5:0/3035635309 learned_addr learned my addr 172.21.15.5:0/3035635309 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8075e00 0x7fe3f819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f80754e0 0x7fe3f819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.198 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 -- 172.21.15.5:0/3035635309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f80754e0 msgr2=0x7fe3f819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f80754e0 0x7fe3f819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 -- 172.21.15.5:0/3035635309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8075e00 msgr2=0x7fe3f819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8075e00 0x7fe3f819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f77fe640 1 -- 172.21.15.5:0/3035635309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f81a1560 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.137+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f80754e0 0x7fe3f819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.138+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81a0d90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000e970 tx=0x7fe3f000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.138+0000 7fe3effff640 1 -- 172.21.15.5:0/3035635309 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000ccc0 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.138+0000 7fe3effff640 1 -- 172.21.15.5:0/3035635309 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3f00054d0 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.138+0000 7fe3effff640 1 -- 172.21.15.5:0/3035635309 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0010430 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.138+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f81a1850 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.138+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81a7f10 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 Processor -- start 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3effff640 1 -- 172.21.15.5:0/3035635309 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fe3f0005020 con 0x7fe3f810f3d0 2024-09-10T22:19:16.199 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 -- start start 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490994d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x55664900fea0 con 0x556649099a10 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556648fff2d0 con 0x5566490990f0 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.141+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5566490030e0 con 0x5566490a59a0 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54202/0 (socket says 172.21.15.5:54202) 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 -- 172.21.15.5:0/505222133 learned_addr learned my addr 172.21.15.5:0/505222133 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 -- 172.21.15.5:0/505222133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 msgr2=0x5566490a7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.200 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 -- 172.21.15.5:0/505222133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 msgr2=0x5566490994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 -- 172.21.15.5:0/505222133 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556648d5d650 con 0x556649099a10 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3effff640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe3e40b5360 0x7fe3e40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a5460 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007f70 tx=0x7fe3e800e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15ad6153fd2ac6c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe3e40b5360 0x7fe3e40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3effff640 1 -- 172.21.15.5:0/3035635309 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe3f00e5f20 con 0x7fe3f810f3d0 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3ed7fa640 1 -- 172.21.15.5:0/505222133 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8014070 con 0x556649099a10 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3ed7fa640 1 -- 172.21.15.5:0/505222133 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e8004d20 con 0x556649099a10 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.142+0000 7fe3ed7fa640 1 -- 172.21.15.5:0/505222133 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8005480 con 0x556649099a10 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 -- 172.21.15.5:0/505222133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 msgr2=0x5566490a5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe3e40b5360 0x7fe3e40b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0031440 tx=0x7fe3e0005db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:16.201 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a5460 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8007f70 tx=0x7fe3e800e7e0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 -- 172.21.15.5:0/505222133 shutdown_connections 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a5460 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/505222133 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 -- 172.21.15.5:0/505222133 >> 172.21.15.5:0/505222133 conn(0x556649096f20 msgr2=0x5566490980c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 -- 172.21.15.5:0/505222133 shutdown_connections 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.143+0000 7fe3ff88f740 1 -- 172.21.15.5:0/505222133 wait complete. 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 -- start start 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 Processor -- start 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490990f0 0x5566490a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490a59a0 0x5566490a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.202 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x556648e60700 con 0x556649099a10 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x556648f9a160 con 0x5566490a59a0 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x5566490a8620 con 0x5566490990f0 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3ff88f740 10 client.0 _ll_register_callbacks cb 0x556648fb39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54218/0 (socket says 172.21.15.5:54218) 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 -- 172.21.15.5:0/1734093735 learned_addr learned my addr 172.21.15.5:0/1734093735 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490990f0 0x5566490a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490a59a0 0x5566490a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 -- 172.21.15.5:0/1734093735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490990f0 msgr2=0x5566490a52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490990f0 0x5566490a52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 -- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490a59a0 msgr2=0x5566490a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.203 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490a59a0 0x5566490a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.144+0000 7fe3f67fc640 1 -- 172.21.15.5:0/1734093735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556648fc7c90 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a2740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0033000 tx=0x7fe3e0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff809aa6aa8e37b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1734093735 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e004f030 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1734093735 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe3e00043d0 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e8004d20 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1734093735 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3e0045070 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 10 client.15885 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5566490b4010 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1734093735 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e8004d20 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1734093735 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3e003d5e0 con 0x556649099a10 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 10 client.15885 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:16.204 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 10 client.15885 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 20 client.15885 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5566490b5570 0x5566490b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 4 client.15885 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.145+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556649011df0 con 0x5566490b5570 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.146+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5566490b5570 0x5566490b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.146+0000 7fe3de7fc640 10 client.15885 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.146+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5566490b5570 0x5566490b79d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6c50eb16b7e8099 server_cookie=a2ea34bdf0b2eb93 in_seq=0 out_seq=0 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1734093735 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556649011df0 con 0x5566490b5570 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3de7fc640 10 client.15885 handle_command_reply: tid=0 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 client.15885 shutdown 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 msgr2=0x5566490a2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a2740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0033000 tx=0x7fe3e0005780 comp rx=0 tx=0).stop 2024-09-10T22:19:16.205 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 shutdown_connections 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490a59a0 0x5566490a2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x5566490b5570 0x5566490b79d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a2740 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3de7fc640 0 client.15885 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1734093735 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490990f0 0x5566490a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 >> 172.21.15.5:0/1734093735 conn(0x556649096f20 msgr2=0x55664909cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 shutdown_connections 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1734093735 wait complete. 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.147+0000 7fe3ff88f740 20 client.15885 trim_cache size 0 max 16384 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 Processor -- start 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 -- start start 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.206 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81b2e20 con 0x556649099a10 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81b06f0 con 0x5566490990f0 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81ae540 con 0x5566490a59a0 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54224/0 (socket says 172.21.15.5:54224) 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 -- 172.21.15.5:0/2280254644 learned_addr learned my addr 172.21.15.5:0/2280254644 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 -- 172.21.15.5:0/2280254644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 msgr2=0x5566490a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 -- 172.21.15.5:0/2280254644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 msgr2=0x5566490b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.207 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.161+0000 7fe3f67fc640 1 -- 172.21.15.5:0/2280254644 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566490a4f20 con 0x556649099a10 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a4480 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006010 tx=0x7fe3e00058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43368bac577719f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ecff9640 1 -- 172.21.15.5:0/2280254644 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e004f070 con 0x556649099a10 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ecff9640 1 -- 172.21.15.5:0/2280254644 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e0004490 con 0x556649099a10 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ecff9640 1 -- 172.21.15.5:0/2280254644 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0035040 con 0x556649099a10 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ff88f740 1 -- 172.21.15.5:0/2280254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 msgr2=0x5566490a4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a4480 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006010 tx=0x7fe3e00058b0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ff88f740 1 -- 172.21.15.5:0/2280254644 shutdown_connections 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.162+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x5566490a59a0 0x5566490a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x556649099a10 0x5566490a4480 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/2280254644 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- 172.21.15.5:0/2280254644 >> 172.21.15.5:0/2280254644 conn(0x556649096f20 msgr2=0x5566490a3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- 172.21.15.5:0/2280254644 shutdown_connections 2024-09-10T22:19:16.208 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- 172.21.15.5:0/2280254644 wait complete. 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- start start 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 Processor -- start 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556649099a10 0x5566490a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 0x5566490a9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81aebb0 con 0x5566490a59a0 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81b0020 con 0x5566490990f0 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f81af280 con 0x556649099a10 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3ff88f740 10 client.0 _ll_register_callbacks cb 0x7fe3e0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.163+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 0x5566490a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 0x5566490a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54234/0 (socket says 172.21.15.5:54234) 2024-09-10T22:19:16.209 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 -- 172.21.15.5:0/1502218120 learned_addr learned my addr 172.21.15.5:0/1502218120 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556649099a10 0x5566490a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 -- 172.21.15.5:0/1502218120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556649099a10 msgr2=0x5566490a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556649099a10 0x5566490a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 -- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 msgr2=0x5566490ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 -- 172.21.15.5:0/1502218120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566491224a0 con 0x5566490a59a0 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f67fc640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556649099a10 0x5566490a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3f77fe640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 0x5566490a9060 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000cfd0 tx=0x7fe3f00ac570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0a79234b05f84b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:19:16.210 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1502218120 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3f00d3030 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1502218120 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fe3f00ab910 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3e0004490 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1502218120 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe3f00ac1c0 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3ff88f740 10 client.15891 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556649123720 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.164+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1502218120 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e0004490 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1502218120 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe3f00ab380 con 0x5566490a59a0 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3ff88f740 10 client.15891 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3ff88f740 10 client.15891 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3ff88f740 20 client.15891 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x556649123ef0 0x556649126310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3ff88f740 4 client.15891 mds_command: new command op to 24563 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:19:16.211 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 --> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55664900d8a0 con 0x556649123ef0 2024-09-10T22:19:16.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x556649123ef0 0x556649126310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:16.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3f6ffd640 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x556649123ef0 0x556649126310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89a991781076cd70 server_cookie=bc7a4ffd124ca64d in_seq=0 out_seq=0 2024-09-10T22:19:16.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3de7fc640 10 client.15891 ms_handle_connect on v2:172.21.15.52:6836/992786234 2024-09-10T22:19:16.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.165+0000 7fe3de7fc640 1 -- 172.21.15.5:0/1502218120 <== mds.1 v2:172.21.15.52:6836/992786234 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55664900d8a0 con 0x556649123ef0 2024-09-10T22:19:16.212 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3de7fc640 10 client.15891 handle_command_reply: tid=0 2024-09-10T22:19:16.212 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 client.15891 shutdown 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 msgr2=0x5566490a9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 0x5566490a9060 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000cfd0 tx=0x7fe3f00ac570 comp rx=0 tx=0).stop 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 shutdown_connections 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:6836/992786234,v1:172.21.15.52:6837/992786234] conn(0x556649123ef0 0x556649126310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x5566490a59a0 0x5566490a9060 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x556649099a10 0x5566490a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3de7fc640 0 client.15891 ms_handle_reset on v2:172.21.15.52:6836/992786234 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 --2- 172.21.15.5:0/1502218120 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x5566490990f0 0x5566490ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 >> 172.21.15.5:0/1502218120 conn(0x556649096f20 msgr2=0x5566490a4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 shutdown_connections 2024-09-10T22:19:16.213 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 1 -- 172.21.15.5:0/1502218120 wait complete. 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3ff88f740 20 client.15891 trim_cache size 0 max 16384 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe3e40b5360 msgr2=0x7fe3e40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe3e40b5360 0x7fe3e40b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0031440 tx=0x7fe3e0005db0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 msgr2=0x7fe3f81a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81a0d90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000e970 tx=0x7fe3f000ee30 comp rx=0 tx=0).stop 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 shutdown_connections 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fe3e40b5360 0x7fe3e40b7820 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fe3f810f3d0 0x7fe3f81a0d90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fe3f8075e00 0x7fe3f819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 --2- 172.21.15.5:0/3035635309 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fe3f80754e0 0x7fe3f819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.166+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 >> 172.21.15.5:0/3035635309 conn(0x7fe3f80fe830 msgr2=0x7fe3f81115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.167+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 shutdown_connections 2024-09-10T22:19:16.214 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:16.167+0000 7fe3fd4ba640 1 -- 172.21.15.5:0/3035635309 wait complete. 2024-09-10T22:19:16.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:15 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-10T22:19:16.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:15 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-10T22:19:16.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:15 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' 2024-09-10T22:19:16.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-10T22:19:17.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:16 smithi005 ceph-mon[31115]: pgmap v419: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 20 MiB/s wr, 18 op/s 2024-09-10T22:19:17.113 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:17.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:16 smithi189 ceph-mon[35784]: pgmap v419: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 20 MiB/s wr, 18 op/s 2024-09-10T22:19:17.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:16 smithi052 ceph-mon[34997]: pgmap v419: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 20 MiB/s wr, 18 op/s 2024-09-10T22:19:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 -- 172.21.15.5:0/624861362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8102dc0 msgr2=0x7f7aa81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/624861362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8102dc0 0x7f7aa81031a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a9802a410 comp rx=0 tx=0).stop 2024-09-10T22:19:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 -- 172.21.15.5:0/624861362 shutdown_connections 2024-09-10T22:19:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/624861362 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aa8109150 0x7f7aa810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/624861362 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aa81087d0 0x7f7aa8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.609 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/624861362 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8102dc0 0x7f7aa81031a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 -- 172.21.15.5:0/624861362 >> 172.21.15.5:0/624861362 conn(0x7f7aa80fe830 msgr2=0x7f7aa8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 -- 172.21.15.5:0/624861362 shutdown_connections 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.587+0000 7f7aad9e6640 1 -- 172.21.15.5:0/624861362 wait complete. 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 Processor -- start 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 -- start start 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aa8102dc0 0x7f7aa81992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aa81087d0 0x7f7aa8199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 0x7f7aa819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8112e60 con 0x7f7aa8109150 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8112ce0 con 0x7f7aa81087d0 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aad9e6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8112fe0 con 0x7f7aa8102dc0 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aa77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 0x7f7aa819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.610 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aa77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 0x7f7aa819ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54254/0 (socket says 172.21.15.5:54254) 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aa77fe640 1 -- 172.21.15.5:0/3064797320 learned_addr learned my addr 172.21.15.5:0/3064797320 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.588+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aa81087d0 0x7f7aa8199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aa8102dc0 0x7f7aa81992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa77fe640 1 -- 172.21.15.5:0/3064797320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aa8102dc0 msgr2=0x7f7aa81992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aa8102dc0 0x7f7aa81992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa77fe640 1 -- 172.21.15.5:0/3064797320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aa81087d0 msgr2=0x7f7aa8199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aa81087d0 0x7f7aa8199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa77fe640 1 -- 172.21.15.5:0/3064797320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa819f380 con 0x7f7aa8109150 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 0x7f7aa819ebb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000eaa0 tx=0x7f7aa000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aac9e4640 1 -- 172.21.15.5:0/3064797320 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000cdb0 con 0x7f7aa8109150 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa819f670 con 0x7f7aa8109150 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aac9e4640 1 -- 172.21.15.5:0/3064797320 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa0005020 con 0x7f7aa8109150 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aac9e4640 1 -- 172.21.15.5:0/3064797320 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa00116d0 con 0x7f7aa8109150 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.589+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa81a5d30 con 0x7f7aa8109150 2024-09-10T22:19:17.611 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 Processor -- start 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aac9e4640 1 -- 172.21.15.5:0/3064797320 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f7aa000f040 con 0x7f7aa8109150 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 -- start start 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea524d0 0x56545ea528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea5e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea5ed80 0x56545ea61170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56545e9c8ea0 con 0x56545ea52df0 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56545e9b82d0 con 0x56545ea524d0 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56545e9bc0e0 con 0x56545ea5ed80 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aa6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea5e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aa6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea5e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54264/0 (socket says 172.21.15.5:54264) 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/1261038290 learned_addr learned my addr 172.21.15.5:0/1261038290 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea524d0 0x56545ea528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.612 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.592+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea5ed80 0x56545ea61170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/1261038290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea5ed80 msgr2=0x56545ea61170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea5ed80 0x56545ea61170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/1261038290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea524d0 msgr2=0x56545ea528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea524d0 0x56545ea528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/1261038290 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545e716650 con 0x56545ea52df0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea524d0 0x56545ea528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea5e840 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000c00 tx=0x7f7a98004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf5437b36703021 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aac9e4640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a900b52e0 0x7f7a900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7a8dffb640 1 -- 172.21.15.5:0/1261038290 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98035040 con 0x56545ea52df0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a900b52e0 0x7f7a900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7a8dffb640 1 -- 172.21.15.5:0/1261038290 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a980054f0 con 0x56545ea52df0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7a8dffb640 1 -- 172.21.15.5:0/1261038290 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98003850 con 0x56545ea52df0 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.593+0000 7f7aac9e4640 1 -- 172.21.15.5:0/3064797320 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7aa00e59c0 con 0x7f7aa8109150 2024-09-10T22:19:17.613 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 -- 172.21.15.5:0/1261038290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 msgr2=0x56545ea5e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea5e840 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000c00 tx=0x7f7a98004180 comp rx=0 tx=0).stop 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a900b52e0 0x7f7a900b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8101d90 tx=0x7f7a9c014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 -- 172.21.15.5:0/1261038290 shutdown_connections 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea5ed80 0x56545ea61170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea5e840 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/1261038290 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea524d0 0x56545ea528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 -- 172.21.15.5:0/1261038290 >> 172.21.15.5:0/1261038290 conn(0x56545ea50300 msgr2=0x56545ea514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 -- 172.21.15.5:0/1261038290 shutdown_connections 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 -- 172.21.15.5:0/1261038290 wait complete. 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.594+0000 7f7aafdbb740 1 -- start start 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 Processor -- start 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea5e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea52df0 0x56545ea5ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.614 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 0x56545ea5c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x56545e819700 con 0x56545ea5ed80 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x56545e953160 con 0x56545ea52df0 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x56545ea619a0 con 0x56545ea524d0 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aafdbb740 10 client.0 _ll_register_callbacks cb 0x56545e96c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 0x56545ea5c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa6ffd640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 0x56545ea5c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54268/0 (socket says 172.21.15.5:54268) 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 -- 172.21.15.5:0/2419111323 learned_addr learned my addr 172.21.15.5:0/2419111323 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea52df0 0x56545ea5ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 -- 172.21.15.5:0/2419111323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 msgr2=0x56545ea5e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea5e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 -- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea52df0 msgr2=0x56545ea5ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea52df0 0x56545ea5ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.615 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa77fe640 1 -- 172.21.15.5:0/2419111323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545e980c90 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea5e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.595+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea52df0 0x56545ea5ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 0x56545ea5c000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00abf60 tx=0x7f7aa00abd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e01c9ce16c961a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7a86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7a86ffd640 1 -- 172.21.15.5:0/2419111323 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa001f030 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7a86ffd640 1 -- 172.21.15.5:0/2419111323 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7aa00054f0 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a980054f0 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7a86ffd640 1 -- 172.21.15.5:0/2419111323 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7aa00b0c90 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 10 client.15903 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56545ea6d260 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7a86ffd640 1 -- 172.21.15.5:0/2419111323 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a980054f0 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7a86ffd640 1 -- 172.21.15.5:0/2419111323 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7aa00a7bb0 con 0x56545ea5ed80 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 10 client.15903 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:17.616 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 20 client.15903 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545ea6e720 0x56545ea70b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 4 client.15903 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.596+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56545e9cadf0 con 0x56545ea6e720 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.597+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545ea6e720 0x56545ea70b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.597+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545ea6e720 0x56545ea70b30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b7bd5f2507c211 server_cookie=284fdae1041714b0 in_seq=0 out_seq=0 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.597+0000 7f7a86ffd640 10 client.15903 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7a86ffd640 1 -- 172.21.15.5:0/2419111323 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56545e9cadf0 con 0x56545ea6e720 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7a86ffd640 10 client.15903 handle_command_reply: tid=0 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 client.15903 shutdown 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 msgr2=0x56545ea5c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 0x56545ea5c000 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00abf60 tx=0x7f7aa00abd70 comp rx=0 tx=0).stop 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 shutdown_connections 2024-09-10T22:19:17.617 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545ea6e720 0x56545ea70b30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea5ed80 0x56545ea5c000 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea52df0 0x56545ea5ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7a86ffd640 0 client.15903 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2419111323 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea5e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 >> 172.21.15.5:0/2419111323 conn(0x56545ea50300 msgr2=0x56545ea55ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 shutdown_connections 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2419111323 wait complete. 2024-09-10T22:19:17.618 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.598+0000 7f7aafdbb740 20 client.15903 trim_cache size 0 max 16384 2024-09-10T22:19:17.622 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.611+0000 7f7aafdbb740 1 Processor -- start 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.611+0000 7f7aafdbb740 1 -- start start 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea4fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea58c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa81b0be0 con 0x56545ea52df0 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa81ae4b0 con 0x56545ea5ed80 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa81ac300 con 0x56545ea524d0 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea58c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea58c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54272/0 (socket says 172.21.15.5:54272) 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 -- 172.21.15.5:0/2951183986 learned_addr learned my addr 172.21.15.5:0/2951183986 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea4fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.623 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 -- 172.21.15.5:0/2951183986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 msgr2=0x56545ea4fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea4fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 -- 172.21.15.5:0/2951183986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 msgr2=0x56545ea591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 -- 172.21.15.5:0/2951183986 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545ea52c20 con 0x56545ea52df0 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.612+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea58c70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c01e510 tx=0x7f7a9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a2e373e37ac98a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7a8d7fa640 1 -- 172.21.15.5:0/2951183986 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c02d070 con 0x56545ea52df0 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7a8d7fa640 1 -- 172.21.15.5:0/2951183986 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a9c01ec40 con 0x56545ea52df0 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7a8d7fa640 1 -- 172.21.15.5:0/2951183986 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c028680 con 0x56545ea52df0 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2951183986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 msgr2=0x56545ea58c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea58c70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c01e510 tx=0x7f7a9c019000 comp rx=0 tx=0).stop 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2951183986 shutdown_connections 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.624 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea52df0 0x56545ea58c70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/2951183986 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea524d0 0x56545ea4fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2951183986 >> 172.21.15.5:0/2951183986 conn(0x56545ea50300 msgr2=0x56545ea56c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2951183986 shutdown_connections 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.613+0000 7f7aafdbb740 1 -- 172.21.15.5:0/2951183986 wait complete. 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 -- start start 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 Processor -- start 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 0x56545ea671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea52df0 0x56545ea626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea62bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa81ac970 con 0x56545ea524d0 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa81adde0 con 0x56545ea5ed80 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa81ad040 con 0x56545ea52df0 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aafdbb740 10 client.0 _ll_register_callbacks cb 0x7f7aa0093040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T22:19:17.625 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aa6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 0x56545ea671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aa6ffd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 0x56545ea671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54288/0 (socket says 172.21.15.5:54288) 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/567521079 learned_addr learned my addr 172.21.15.5:0/567521079 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.614+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea52df0 0x56545ea626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea62bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/567521079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea52df0 msgr2=0x56545ea626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea52df0 0x56545ea626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 msgr2=0x56545ea62bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea62bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa6ffd640 1 -- 172.21.15.5:0/567521079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545ea63230 con 0x56545ea524d0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa77fe640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea62bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aa6ffd640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 0x56545ea671e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a9802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf65416523bea95b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7a86ffd640 10 client.0 ms_handle_connect on v2:172.21.15.5:3300/0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7a86ffd640 1 -- 172.21.15.5:0/567521079 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98035040 con 0x56545ea524d0 2024-09-10T22:19:17.626 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7a86ffd640 1 -- 172.21.15.5:0/567521079 <== mon.0 v2:172.21.15.5:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f7a98004f70 con 0x56545ea524d0 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a9c01ec40 con 0x56545ea524d0 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7a86ffd640 1 -- 172.21.15.5:0/567521079 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a98005190 con 0x56545ea524d0 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aafdbb740 10 client.15909 fetch_fsmap learned FSMap version 25 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.615+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56545eadb3e0 con 0x56545ea524d0 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7a86ffd640 1 -- 172.21.15.5:0/567521079 <== mon.0 v2:172.21.15.5:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a9c01ec40 con 0x56545ea524d0 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7a86ffd640 1 -- 172.21.15.5:0/567521079 <== mon.0 v2:172.21.15.5:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7a98003cd0 con 0x56545ea524d0 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aafdbb740 10 client.15909 fetch_fsmap finished waiting for FSMap version 25 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aafdbb740 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aafdbb740 20 client.15909 populate_metadata read hostname 'smithi005' 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545eadb720 0x56545eaddb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aafdbb740 4 client.15909 mds_command: new command op to 24578 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 --> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56545e9c68a0 con 0x56545eadb720 2024-09-10T22:19:17.627 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545eadb720 0x56545eaddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7aa67fc640 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545eadb720 0x56545eaddb10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26cf31f5be75bc92 server_cookie=e8c41e4f2436f0bb in_seq=0 out_seq=0 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.616+0000 7f7a86ffd640 10 client.15909 ms_handle_connect on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7a86ffd640 1 -- 172.21.15.5:0/567521079 <== mds.0 v2:172.21.15.52:6838/3172231401 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56545e9c68a0 con 0x56545eadb720 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7a86ffd640 10 client.15909 handle_command_reply: tid=0 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 client.15909 shutdown 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 msgr2=0x56545ea671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 0x56545ea671e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009900 tx=0x7f7a9802a410 comp rx=0 tx=0).stop 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 shutdown_connections 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:6838/3172231401,v1:172.21.15.52:6839/3172231401] conn(0x56545eadb720 0x56545eaddb10 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x56545ea5ed80 0x56545ea62bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x56545ea52df0 0x56545ea626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 --2- 172.21.15.5:0/567521079 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x56545ea524d0 0x56545ea671e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.628 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7a86ffd640 0 client.15909 ms_handle_reset on v2:172.21.15.52:6838/3172231401 2024-09-10T22:19:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 >> 172.21.15.5:0/567521079 conn(0x56545ea50300 msgr2=0x56545ea5d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 shutdown_connections 2024-09-10T22:19:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 1 -- 172.21.15.5:0/567521079 wait complete. 2024-09-10T22:19:17.629 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aafdbb740 20 client.15909 trim_cache size 0 max 16384 2024-09-10T22:19:17.629 INFO:teuthology.orchestra.run.smithi005.stdout:[] 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.617+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a900b52e0 msgr2=0x7f7a900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a900b52e0 0x7f7a900b77a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8101d90 tx=0x7f7a9c014040 comp rx=0 tx=0).stop 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 msgr2=0x7f7aa819ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 0x7f7aa819ebb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000eaa0 tx=0x7f7aa000ef60 comp rx=0 tx=0).stop 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 shutdown_connections 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f7a900b52e0 0x7f7a900b77a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f7aa8109150 0x7f7aa819ebb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f7aa81087d0 0x7f7aa8199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 --2- 172.21.15.5:0/3064797320 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f7aa8102dc0 0x7f7aa81992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 >> 172.21.15.5:0/3064797320 conn(0x7f7aa80fe830 msgr2=0x7f7aa8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 shutdown_connections 2024-09-10T22:19:17.630 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:17.618+0000 7f7aad9e6640 1 -- 172.21.15.5:0/3064797320 wait complete. 2024-09-10T22:19:18.418 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-10T22:19:18.419 INFO:tasks.fwd_scrub:done joining 2024-09-10T22:19:18.419 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-10T22:19:18.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T22:19:18.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.536+0000 7ffa59085640 1 -- 172.21.15.5:0/534631671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa54102a00 msgr2=0x7ffa54102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.536+0000 7ffa59085640 1 --2- 172.21.15.5:0/534631671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa54102a00 0x7ffa54102e80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009930 tx=0x7ffa3c02a420 comp rx=0 tx=0).stop 2024-09-10T22:19:18.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 -- 172.21.15.5:0/534631671 shutdown_connections 2024-09-10T22:19:18.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 --2- 172.21.15.5:0/534631671 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa541033c0 0x7ffa54109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 --2- 172.21.15.5:0/534631671 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa54102a00 0x7ffa54102e80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.538 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 --2- 172.21.15.5:0/534631671 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 0x7ffa54101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 -- 172.21.15.5:0/534631671 >> 172.21.15.5:0/534631671 conn(0x7ffa540fd150 msgr2=0x7ffa540ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 -- 172.21.15.5:0/534631671 shutdown_connections 2024-09-10T22:19:18.539 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 -- 172.21.15.5:0/534631671 wait complete. 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 Processor -- start 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.537+0000 7ffa59085640 1 -- start start 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 0x7ffa5419afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa54102a00 0x7ffa5419b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 0x7ffa5419c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5410d500 con 0x7ffa541033c0 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5410d380 con 0x7ffa541018b0 2024-09-10T22:19:18.541 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5410d680 con 0x7ffa54102a00 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 0x7ffa5419c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 0x7ffa5419c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54298/0 (socket says 172.21.15.5:54298) 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 -- 172.21.15.5:0/1524639217 learned_addr learned my addr 172.21.15.5:0/1524639217 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa4bfff640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa54102a00 0x7ffa5419b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa52d9d640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 0x7ffa5419afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 -- 172.21.15.5:0/1524639217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa54102a00 msgr2=0x7ffa5419b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa54102a00 0x7ffa5419b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 -- 172.21.15.5:0/1524639217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 msgr2=0x7ffa5419afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 0x7ffa5419afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 -- 172.21.15.5:0/1524639217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5419cae0 con 0x7ffa541033c0 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa52d9d640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 0x7ffa5419afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa5359e640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 0x7ffa5419c220 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00eaa0 tx=0x7ffa4c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00cdb0 con 0x7ffa541033c0 2024-09-10T22:19:18.542 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5419cdd0 con 0x7ffa541033c0 2024-09-10T22:19:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa4c005020 con 0x7ffa541033c0 2024-09-10T22:19:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c01f060 con 0x7ffa541033c0 2024-09-10T22:19:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.538+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa541a34a0 con 0x7ffa541033c0 2024-09-10T22:19:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.539+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa541a3670 con 0x7ffa541033c0 2024-09-10T22:19:18.543 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.541+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7ffa4c00f040 con 0x7ffa541033c0 2024-09-10T22:19:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.542+0000 7ffa50d99640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffa400b52e0 0x7ffa400b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.542+0000 7ffa52d9d640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffa400b52e0 0x7ffa400b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.542+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7ffa4c0e5d80 con 0x7ffa541033c0 2024-09-10T22:19:18.544 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.542+0000 7ffa52d9d640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffa400b52e0 0x7ffa400b77a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa440058c0 tx=0x7ffa44005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:18.545 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.545+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffa4c016030 con 0x7ffa541033c0 2024-09-10T22:19:18.731 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.730+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa541a3840 con 0x7ffa541033c0 2024-09-10T22:19:18.732 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.731+0000 7ffa50d99640 1 -- 172.21.15.5:0/1524639217 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7ffa4c0acd00 con 0x7ffa541033c0 2024-09-10T22:19:18.733 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:19:18.733 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:19:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffa400b52e0 msgr2=0x7ffa400b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffa400b52e0 0x7ffa400b77a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa440058c0 tx=0x7ffa44005d30 comp rx=0 tx=0).stop 2024-09-10T22:19:18.735 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 msgr2=0x7ffa5419c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 0x7ffa5419c220 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00eaa0 tx=0x7ffa4c00ef60 comp rx=0 tx=0).stop 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 shutdown_connections 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7ffa400b52e0 0x7ffa400b77a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7ffa541033c0 0x7ffa5419c220 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7ffa54102a00 0x7ffa5419b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 --2- 172.21.15.5:0/1524639217 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7ffa541018b0 0x7ffa5419afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 >> 172.21.15.5:0/1524639217 conn(0x7ffa540fd150 msgr2=0x7ffa540febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 shutdown_connections 2024-09-10T22:19:18.736 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.734+0000 7ffa59085640 1 -- 172.21.15.5:0/1524639217 wait complete. 2024-09-10T22:19:18.747 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T22:10:20.089426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T22:14:58.643913+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T22:15:00.986202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T22:19:18.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T22:19:18.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 -- 172.21.15.5:0/3555183709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 msgr2=0x7f1bc0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.859 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3555183709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0109d10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009cd0 tx=0x7f1bb802a8e0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 -- 172.21.15.5:0/3555183709 shutdown_connections 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3555183709 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0109d10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3555183709 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc01029d0 0x7f1bc0102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3555183709 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc0101880 0x7f1bc0101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 -- 172.21.15.5:0/3555183709 >> 172.21.15.5:0/3555183709 conn(0x7f1bc00fd120 msgr2=0x7f1bc00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 -- 172.21.15.5:0/3555183709 shutdown_connections 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 -- 172.21.15.5:0/3555183709 wait complete. 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 Processor -- start 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 -- start start 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.855+0000 7f1bc6764640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc0101880 0x7f1bc0197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc01029d0 0x7f1bc0198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.860 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc010d4d0 con 0x7f1bc0103390 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc010d350 con 0x7f1bc0101880 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc010d650 con 0x7f1bc01029d0 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54306/0 (socket says 172.21.15.5:54306) 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 -- 172.21.15.5:0/3890796051 learned_addr learned my addr 172.21.15.5:0/3890796051 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bbffff640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc0101880 0x7f1bc0197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bb7fff640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc01029d0 0x7f1bc0198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 -- 172.21.15.5:0/3890796051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc01029d0 msgr2=0x7f1bc0198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc01029d0 0x7f1bc0198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 -- 172.21.15.5:0/3890796051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc0101880 msgr2=0x7f1bc0197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc0101880 0x7f1bc0197c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:18.861 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 -- 172.21.15.5:0/3890796051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc0199740 con 0x7f1bc0103390 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc4d01640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0198e80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8033040 tx=0x7f1bb8003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8004240 con 0x7f1bc0103390 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc01999d0 con 0x7f1bc0103390 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bb80305a0 con 0x7f1bc0103390 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80466e0 con 0x7f1bc0103390 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.856+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01a0100 con 0x7f1bc0103390 2024-09-10T22:19:18.862 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.858+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc0101c80 con 0x7f1bc0103390 2024-09-10T22:19:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.859+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f1bb804e070 con 0x7f1bc0103390 2024-09-10T22:19:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.859+0000 7f1bbdffb640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1bac0b52e0 0x7f1bac0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.860+0000 7f1bbffff640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1bac0b52e0 0x7f1bac0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.860+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f1bb802e030 con 0x7f1bc0103390 2024-09-10T22:19:18.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.860+0000 7f1bbffff640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1bac0b52e0 0x7f1bac0b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009bd0 tx=0x7f1bb0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:18.865 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:18.864+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1bb804b060 con 0x7f1bc0103390 2024-09-10T22:19:19.051 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.050+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1bc0063d50 con 0x7f1bc0103390 2024-09-10T22:19:19.052 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.051+0000 7f1bbdffb640 1 -- 172.21.15.5:0/3890796051 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f1bb80cde30 con 0x7f1bc0103390 2024-09-10T22:19:19.052 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-09-10T22:19:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.052+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1bac0b52e0 msgr2=0x7f1bac0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.052+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1bac0b52e0 0x7f1bac0b77a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009bd0 tx=0x7f1bb0005f90 comp rx=0 tx=0).stop 2024-09-10T22:19:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 msgr2=0x7f1bc0198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.054 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0198e80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8033040 tx=0x7f1bb8003b80 comp rx=0 tx=0).stop 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 shutdown_connections 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f1bac0b52e0 0x7f1bac0b77a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f1bc0103390 0x7f1bc0198e80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f1bc01029d0 0x7f1bc0198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 --2- 172.21.15.5:0/3890796051 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f1bc0101880 0x7f1bc0197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 >> 172.21.15.5:0/3890796051 conn(0x7f1bc00fd120 msgr2=0x7f1bc0105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 shutdown_connections 2024-09-10T22:19:19.055 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.053+0000 7f1bc6764640 1 -- 172.21.15.5:0/3890796051 wait complete. 2024-09-10T22:19:19.064 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:18 smithi005 ceph-mon[31115]: pgmap v420: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-10T22:19:19.064 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:18 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1524639217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:19:19.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 -- 172.21.15.5:0/648811768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 msgr2=0x7effc010ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 --2- 172.21.15.5:0/648811768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc010ab60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7effb8009ca0 tx=0x7effb802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 -- 172.21.15.5:0/648811768 shutdown_connections 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 --2- 172.21.15.5:0/648811768 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc010ab60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 --2- 172.21.15.5:0/648811768 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc0105af0 0x7effc0107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 --2- 172.21.15.5:0/648811768 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc006b0d0 0x7effc01055b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 -- 172.21.15.5:0/648811768 >> 172.21.15.5:0/648811768 conn(0x7effc00fd120 msgr2=0x7effc00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 -- 172.21.15.5:0/648811768 shutdown_connections 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.171+0000 7effc62b6640 1 -- 172.21.15.5:0/648811768 wait complete. 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 Processor -- start 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 -- start start 2024-09-10T22:19:19.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc006b0d0 0x7effc0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc0105af0 0x7effc0199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc0199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7effc010e620 con 0x7effc01086a0 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7effc010e4a0 con 0x7effc0105af0 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc62b6640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7effc010e7a0 con 0x7effc006b0d0 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc4853640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc0199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc4853640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc0199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54316/0 (socket says 172.21.15.5:54316) 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effc4853640 1 -- 172.21.15.5:0/484348926 learned_addr learned my addr 172.21.15.5:0/484348926 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.172+0000 7effbffff640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc006b0d0 0x7effc0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effbf7fe640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc0105af0 0x7effc0199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc4853640 1 -- 172.21.15.5:0/484348926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc006b0d0 msgr2=0x7effc0198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc4853640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc006b0d0 0x7effc0198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.177 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc4853640 1 -- 172.21.15.5:0/484348926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc0105af0 msgr2=0x7effc0199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc4853640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc0105af0 0x7effc0199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc4853640 1 -- 172.21.15.5:0/484348926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc019a880 con 0x7effc01086a0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effbf7fe640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc0105af0 0x7effc0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc4853640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc0199fc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7effb80097b0 tx=0x7effb8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb8004240 con 0x7effc01086a0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effb80317c0 con 0x7effc01086a0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb802fd80 con 0x7effc01086a0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effc019ab10 con 0x7effc01086a0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.173+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effc01a1240 con 0x7effc01086a0 2024-09-10T22:19:19.178 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.174+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effc0105f50 con 0x7effc01086a0 2024-09-10T22:19:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.176+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7effb80043e0 con 0x7effc01086a0 2024-09-10T22:19:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.176+0000 7effbd7fa640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7effa80b52e0 0x7effa80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.177+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7effb81073b0 con 0x7effc01086a0 2024-09-10T22:19:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.177+0000 7effbffff640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7effa80b52e0 0x7effa80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.179 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.177+0000 7effbffff640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7effa80b52e0 0x7effa80b77a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7effb0005d00 tx=0x7effb000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:19.181 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.179+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7effb80ce2a0 con 0x7effc01086a0 2024-09-10T22:19:19.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:18 smithi189 ceph-mon[35784]: pgmap v420: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-10T22:19:19.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:18 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1524639217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:19:19.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:18 smithi052 ceph-mon[34997]: pgmap v420: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 12 MiB/s wr, 14 op/s 2024-09-10T22:19:19.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:18 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1524639217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:19:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.365+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7effc002e5c0 con 0x7effc01086a0 2024-09-10T22:19:19.366 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.365+0000 7effbd7fa640 1 -- 172.21.15.5:0/484348926 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) ==== 104+0+11 (secure 0 0 0) 0x7effb80cdba0 con 0x7effc01086a0 2024-09-10T22:19:19.366 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 32 2024-09-10T22:19:19.369 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7effa80b52e0 msgr2=0x7effa80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7effa80b52e0 0x7effa80b77a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7effb0005d00 tx=0x7effb000b410 comp rx=0 tx=0).stop 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 msgr2=0x7effc0199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc0199fc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7effb80097b0 tx=0x7effb8003c20 comp rx=0 tx=0).stop 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 shutdown_connections 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7effa80b52e0 0x7effa80b77a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7effc01086a0 0x7effc0199fc0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7effc0105af0 0x7effc0199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 --2- 172.21.15.5:0/484348926 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7effc006b0d0 0x7effc0198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 >> 172.21.15.5:0/484348926 conn(0x7effc00fd120 msgr2=0x7effc0103e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 shutdown_connections 2024-09-10T22:19:19.370 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.368+0000 7effc62b6640 1 -- 172.21.15.5:0/484348926 wait complete. 2024-09-10T22:19:19.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T22:19:19.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- 172.21.15.5:0/2599467169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258103ac0 msgr2=0x7f5258103f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- 172.21.15.5:0/2599467169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258103ac0 0x7f5258103f40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5240009930 tx=0x7f524002a420 comp rx=0 tx=0).stop 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- 172.21.15.5:0/2599467169 shutdown_connections 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- 172.21.15.5:0/2599467169 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258104480 0x7f525810ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- 172.21.15.5:0/2599467169 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258103ac0 0x7f5258103f40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- 172.21.15.5:0/2599467169 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258102970 0x7f5258102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- 172.21.15.5:0/2599467169 >> 172.21.15.5:0/2599467169 conn(0x7f52580fe210 msgr2=0x7f5258100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- 172.21.15.5:0/2599467169 shutdown_connections 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- 172.21.15.5:0/2599467169 wait complete. 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 Processor -- start 2024-09-10T22:19:19.490 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- start start 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258102970 0x7f5258198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258103ac0 0x7f5258199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 0x7f5258199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f525810e5c0 con 0x7f5258104480 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f525810e440 con 0x7f5258103ac0 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.486+0000 7f525dc60640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f525810e740 con 0x7f5258102970 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 0x7f5258199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 0x7f5258199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54344/0 (socket says 172.21.15.5:54344) 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 -- 172.21.15.5:0/3182192062 learned_addr learned my addr 172.21.15.5:0/3182192062 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f524ffff640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258103ac0 0x7f5258199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.491 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f52577fe640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258102970 0x7f5258198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 -- 172.21.15.5:0/3182192062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258102970 msgr2=0x7f5258198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258102970 0x7f5258198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 -- 172.21.15.5:0/3182192062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258103ac0 msgr2=0x7f5258199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258103ac0 0x7f5258199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 -- 172.21.15.5:0/3182192062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525819a880 con 0x7f5258104480 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f524ffff640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258103ac0 0x7f5258199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f5257fff640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 0x7f5258199fc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f525000cce0 tx=0x7f525000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f525000f450 con 0x7f5258104480 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f525000faa0 con 0x7f5258104480 2024-09-10T22:19:19.492 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525819ab70 con 0x7f5258104480 2024-09-10T22:19:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5250018b70 con 0x7f5258104480 2024-09-10T22:19:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.487+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52581a1240 con 0x7f5258104480 2024-09-10T22:19:19.493 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.488+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5258109ce0 con 0x7f5258104480 2024-09-10T22:19:19.494 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.490+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f525000f5f0 con 0x7f5258104480 2024-09-10T22:19:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.491+0000 7f52557fa640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f52440b5360 0x7f52440b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.491+0000 7f52577fe640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f52440b5360 0x7f52440b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.491+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f52500e63f0 con 0x7f5258104480 2024-09-10T22:19:19.496 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.491+0000 7f52577fe640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f52440b5360 0x7f52440b7820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5248005fd0 tx=0x7f5248005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:19.497 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.494+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5250014030 con 0x7f5258104480 2024-09-10T22:19:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.677+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f525802e810 con 0x7f5258104480 2024-09-10T22:19:19.680 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.678+0000 7f52557fa640 1 -- 172.21.15.5:0/3182192062 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) ==== 100+0+11 (secure 0 0 0) 0x7f52500ad3f0 con 0x7f5258104480 2024-09-10T22:19:19.680 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 64 2024-09-10T22:19:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.679+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f52440b5360 msgr2=0x7f52440b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.679+0000 7f525dc60640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f52440b5360 0x7f52440b7820 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5248005fd0 tx=0x7f5248005850 comp rx=0 tx=0).stop 2024-09-10T22:19:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 msgr2=0x7f5258199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 0x7f5258199fc0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f525000cce0 tx=0x7f525000a620 comp rx=0 tx=0).stop 2024-09-10T22:19:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 shutdown_connections 2024-09-10T22:19:19.682 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f52440b5360 0x7f52440b7820 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f5258104480 0x7f5258199fc0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f5258103ac0 0x7f5258199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 --2- 172.21.15.5:0/3182192062 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f5258102970 0x7f5258198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 >> 172.21.15.5:0/3182192062 conn(0x7f52580fe210 msgr2=0x7f5258106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 shutdown_connections 2024-09-10T22:19:19.683 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.680+0000 7f525dc60640 1 -- 172.21.15.5:0/3182192062 wait complete. 2024-09-10T22:19:19.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- 172.21.15.5:0/3151615996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa4102a00 msgr2=0x7f9fa4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/3151615996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa4102a00 0x7f9fa4102e80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9f94009930 tx=0x7f9f9402a420 comp rx=0 tx=0).stop 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- 172.21.15.5:0/3151615996 shutdown_connections 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/3151615996 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41033c0 0x7f9fa4109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/3151615996 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa4102a00 0x7f9fa4102e80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/3151615996 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fa41018b0 0x7f9fa4101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- 172.21.15.5:0/3151615996 >> 172.21.15.5:0/3151615996 conn(0x7f9fa40fd150 msgr2=0x7f9fa40ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- 172.21.15.5:0/3151615996 shutdown_connections 2024-09-10T22:19:19.799 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- 172.21.15.5:0/3151615996 wait complete. 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 Processor -- start 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- start start 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 0x7f9fa4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fa4102a00 0x7f9fa4199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41033c0 0x7f9fa419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa410e650 con 0x7f9fa41018b0 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa410e4d0 con 0x7f9fa4102a00 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.795+0000 7f9fab9f3640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa410e7d0 con 0x7f9fa41033c0 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 0x7f9fa4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 0x7f9fa4198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:54366/0 (socket says 172.21.15.5:54366) 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 -- 172.21.15.5:0/6260765 learned_addr learned my addr 172.21.15.5:0/6260765 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 -- 172.21.15.5:0/6260765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41033c0 msgr2=0x7f9fa419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.800 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41033c0 0x7f9fa419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 -- 172.21.15.5:0/6260765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fa4102a00 msgr2=0x7f9fa4199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fa4102a00 0x7f9fa4199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 -- 172.21.15.5:0/6260765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa419a920 con 0x7f9fa41018b0 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fa978f640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 0x7f9fa4198de0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000eab0 tx=0x7f9fa000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000ce40 con 0x7f9fa41018b0 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa419ac10 con 0x7f9fa41018b0 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa0011920 con 0x7f9fa41018b0 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0010a30 con 0x7f9fa41018b0 2024-09-10T22:19:19.801 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.796+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41a12e0 con 0x7f9fa41018b0 2024-09-10T22:19:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.797+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa4108c20 con 0x7f9fa41018b0 2024-09-10T22:19:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.799+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f9fa000f040 con 0x7f9fa41018b0 2024-09-10T22:19:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.799+0000 7f9f9a7fc640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9f900b52e0 0x7f9f900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.799+0000 7f9fa8f8e640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9f900b52e0 0x7f9f900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:19.802 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.799+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f9fa00e5fc0 con 0x7f9fa41018b0 2024-09-10T22:19:19.803 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.800+0000 7f9fa8f8e640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9f900b52e0 0x7f9f900b77a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f940096c0 tx=0x7f9f94000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:19.804 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:19.802+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fa0016030 con 0x7f9fa41018b0 2024-09-10T22:19:20.041 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.039+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f9fa402e5c0 con 0x7f9fa41018b0 2024-09-10T22:19:20.049 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.047+0000 7f9f9a7fc640 1 -- 172.21.15.5:0/6260765 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+827934 (secure 0 0 0) 0x7f9fa00ace50 con 0x7f9fa41018b0 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 18, 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "active_gid": 14150, 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "active_name": "x", 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addrs": { 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-10T22:19:20.061 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2373125998 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2373125998 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "active_addr": "172.21.15.5:6801/2373125998", 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "active_change": "2024-09-10T22:07:33.618484+0000", 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "active_mgr_features": 4540719139924082687, 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "available": true, 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: "standbys": [ 2024-09-10T22:19:20.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24121, 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540719139924082687, 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.066 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.067 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.069 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-09-10T22:19:20.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-09-10T22:19:20.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-09-10T22:19:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:19:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:19:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:19:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:19:20.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:19:20.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:19:20.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.087 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-09-10T22:19:20.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.092 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-09-10T22:19:20.093 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.099 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-09-10T22:19:20.106 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.108 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:19:20.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nginx": { 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nginx", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:19:20.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nginx container image", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-09-10T22:19:20.127 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-09-10T22:19:20.128 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.129 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba_metrics": { 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-09-10T22:19:20.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.131 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.139 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.144 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:19:20.146 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.147 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.150 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.151 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-09-10T22:19:20.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-10T22:19:20.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.162 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.163 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.164 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:19:20.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.173 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-09-10T22:19:20.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:20.197 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "[]", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "{}", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.207 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.211 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.215 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.232 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.234 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-10T22:19:20.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-09-10T22:19:20.239 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.241 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-09-10T22:19:20.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-10T22:19:20.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-09-10T22:19:20.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.246 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.251 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-09-10T22:19:20.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-09-10T22:19:20.254 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.255 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-09-10T22:19:20.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.262 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.266 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.268 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-09-10T22:19:20.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-09-10T22:19:20.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.274 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.275 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.276 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.277 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.278 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.279 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.280 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-09-10T22:19:20.282 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:19:20.284 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:19:20.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.287 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.289 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.291 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.292 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.293 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.298 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-09-10T22:19:20.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.307 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.309 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.310 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:19:20.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.312 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.313 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.318 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.319 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.320 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.321 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.322 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.324 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.327 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.328 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.330 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.331 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.333 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.335 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.338 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.340 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-09-10T22:19:20.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.344 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.345 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.346 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.347 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.348 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.349 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.352 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.353 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.355 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.356 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.358 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.359 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.360 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.361 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.362 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.364 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.365 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.367 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.369 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.378 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.379 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-09-10T22:19:20.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.382 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.386 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.390 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-09-10T22:19:20.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-09-10T22:19:20.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-10T22:19:20.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.396 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.399 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.400 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-09-10T22:19:20.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:19:20.408 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.410 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-09-10T22:19:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.413 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.414 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.416 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.417 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max_requests": { 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_requests", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.420 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.422 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.423 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.424 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.428 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.434 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.436 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-09-10T22:19:20.438 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.439 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.441 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-09-10T22:19:20.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.450 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.452 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.453 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.456 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smb", 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "internal_store_backend": { 2024-09-10T22:19:20.457 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "internal_store_backend", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.459 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.460 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.462 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "update_orchestration": { 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "update_orchestration", 2024-09-10T22:19:20.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.468 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.469 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.470 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.471 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.472 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.473 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.475 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.476 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.478 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.480 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.484 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.485 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.487 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-09-10T22:19:20.488 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-09-10T22:19:20.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.492 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.495 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.496 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-09-10T22:19:20.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:19:20.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.503 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.505 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-09-10T22:19:20.509 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.510 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.511 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.516 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.516 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.516 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.522 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.523 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.524 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.525 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.526 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.527 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.528 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.529 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.531 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.532 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.534 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.535 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.536 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.537 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.538 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.539 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.540 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.541 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.542 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.543 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.544 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.546 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.547 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.549 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.550 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.551 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.552 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.554 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "gid": 24131, 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "y", 2024-09-10T22:19:20.555 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_features": 4540719139924082687, 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.556 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.557 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.560 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.561 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.562 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-09-10T22:19:20.563 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.564 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.565 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.566 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.567 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.568 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.569 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.570 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.571 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.572 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:19:20.573 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:19:20.574 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.575 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:19:20.576 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:19:20.577 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:19:20.578 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:19:20.579 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.580 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.581 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.582 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.583 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.584 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.585 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-09-10T22:19:20.586 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.587 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.588 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.589 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.590 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.591 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-09-10T22:19:20.592 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-09-10T22:19:20.593 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.594 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.595 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.596 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.598 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-09-10T22:19:20.599 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.600 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.601 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.602 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:19:20.603 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.604 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.605 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.606 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.607 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:19:20.609 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:19:20.610 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-09-10T22:19:20.611 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-09-10T22:19:20.612 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.613 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nginx": { 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nginx", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nginx container image", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.614 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.617 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.618 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.619 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:19:20.620 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba_metrics": { 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:19:20.621 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:19:20.622 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.623 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.624 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.625 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.626 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:19:20.627 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.628 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.629 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:19:20.630 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.631 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.632 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.633 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.634 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.635 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:19:20.636 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:19:20.637 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.638 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.639 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.640 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:19:20.641 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-09-10T22:19:20.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-09-10T22:19:20.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-09-10T22:19:20.644 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-10T22:19:20.645 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.646 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.647 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.648 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.650 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.651 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.653 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.654 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.655 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.657 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:19:20.658 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.659 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.660 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.661 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.662 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.663 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.665 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.666 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.667 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.668 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.670 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.671 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.672 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.673 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.674 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.676 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:19:20.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:19:20.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:19:20.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:19:20.680 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.681 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.682 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.683 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.684 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.686 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.689 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "[]", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "{}", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.696 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.697 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.698 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:19:20.699 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.704 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.705 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.706 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.707 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.708 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.709 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.710 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.711 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.712 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.713 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.714 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.715 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.716 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.717 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.718 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.720 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.721 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:19:20.722 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.723 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.724 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.725 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.726 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.727 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.728 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.729 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.730 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.731 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.732 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.733 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.734 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.735 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.736 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.737 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.738 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.739 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.740 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.741 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.742 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.743 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.744 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.746 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.747 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-09-10T22:19:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.751 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.752 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.753 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.754 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-09-10T22:19:20.756 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.757 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.758 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.759 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.760 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.761 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.762 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.763 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.764 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.765 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.766 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.767 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.768 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-09-10T22:19:20.769 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.770 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.772 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.773 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.774 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.775 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.776 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.777 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.778 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-09-10T22:19:20.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-09-10T22:19:20.780 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.781 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.782 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.783 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.784 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.785 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.786 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.788 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.789 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.790 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.791 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.792 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.793 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.794 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.795 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.796 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.797 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.798 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.799 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.800 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.801 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.802 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.803 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.804 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:19:20.805 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.806 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.807 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.809 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.810 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:19:20.811 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.812 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:19:20.813 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.814 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.815 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.816 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.818 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.819 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.820 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.821 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.822 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.824 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.831 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.832 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.833 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.834 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.835 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.837 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.838 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.839 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.840 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.841 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.842 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.844 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.846 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.849 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.850 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.851 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.853 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.854 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.855 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.856 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.857 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.859 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.860 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.861 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.862 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.863 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.864 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.865 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.866 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.867 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.870 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.871 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.872 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.873 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-09-10T22:19:20.874 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:20.875 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.878 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.879 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.880 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.881 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.882 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.883 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.884 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.885 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.886 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.887 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.888 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.889 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.890 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.891 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.892 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-10T22:19:20.893 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.894 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.895 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.896 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.897 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.898 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.899 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.900 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.901 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.902 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-09-10T22:19:20.903 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.904 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.905 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.906 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.908 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.909 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.910 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max_requests": { 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_requests", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.911 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.912 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.913 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.914 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.915 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.916 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.917 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.918 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.919 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:19:20.920 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.922 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.925 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.927 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.928 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.929 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.930 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-09-10T22:19:20.932 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.933 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.934 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.936 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.937 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.938 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.939 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.940 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.941 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.943 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.944 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.945 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.947 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.948 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.949 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.950 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smb", 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "internal_store_backend": { 2024-09-10T22:19:20.951 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "internal_store_backend", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.952 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.953 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.954 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.955 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.956 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.957 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "update_orchestration": { 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "update_orchestration", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.958 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.959 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:19:20.960 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:19:20.961 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.962 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.963 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.964 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.965 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.966 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.967 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.968 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.969 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.970 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.971 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.972 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-09-10T22:19:20.974 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.975 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.976 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.977 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.978 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.979 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.981 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.982 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.983 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.984 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.985 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:20.986 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.987 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:20.988 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-09-10T22:19:20.989 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.990 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.992 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:19:20.993 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:19:20.994 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.995 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.997 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:20.998 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:20.999 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.001 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.002 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.003 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.004 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.007 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.008 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.009 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.011 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.013 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.014 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.015 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.016 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.017 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.018 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.019 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.020 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.021 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.023 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.025 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.026 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.027 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.028 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.029 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.030 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.031 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.032 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.033 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.034 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.035 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.036 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.038 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.039 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.040 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.041 INFO:teuthology.orchestra.run.smithi005.stdout: "modules": [ 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "iostat", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "nfs", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "restful" 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "available_modules": [ 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "alerts", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:21.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How frequently to reexamine health status", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.043 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.045 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.046 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.047 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_destination": { 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_destination", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.048 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_from_name": { 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_from_name", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "Ceph", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Email From: name", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_host": { 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_host", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.050 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP server", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_password": { 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_password", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.051 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Password to authenticate with", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_port": { 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_port", 2024-09-10T22:19:21.052 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "465", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP port", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_sender": { 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_sender", 2024-09-10T22:19:21.053 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SMTP envelope sender", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_ssl": { 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_ssl", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.054 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "smtp_user": { 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smtp_user", 2024-09-10T22:19:21.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "User to authenticate as", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.056 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "balancer", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "active": { 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "active", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.058 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically balance PGs across cluster", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_time": { 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_time", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0000", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "beginning time of day to automatically balance", 2024-09-10T22:19:21.059 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "begin_weekday": { 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "begin_weekday", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.060 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_max_iterations": { 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_max_iterations", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "25", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "250", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-10T22:19:21.061 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_metrics": { 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_metrics", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "pgs,objects,bytes", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-10T22:19:21.062 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_compat_step": { 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crush_compat_step", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.5", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0.001", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "0.999", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "aggressiveness of optimization", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.063 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "end_time": { 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_time", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2359", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ending time of day to automatically balance", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.064 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "end_weekday": { 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "end_weekday", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "0", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "6", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-10T22:19:21.065 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.066 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.067 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.068 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.069 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.070 INFO:teuthology.orchestra.run.smithi005.stdout: "min_score": { 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_score", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.071 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "upmap", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-compat", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "none", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "read", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap", 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap-read" 2024-09-10T22:19:21.072 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Balancer mode", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_ids": { 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_ids", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.073 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_deviation": { 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_deviation", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.076 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "upmap_max_optimizations": { 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "upmap_max_optimizations", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.077 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm", 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_down_multiplier": { 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_down_multiplier", 2024-09-10T22:19:21.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_refresh_rate": { 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_refresh_rate", 2024-09-10T22:19:21.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "20", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "agent_starting_port": { 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "agent_starting_port", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.080 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4721", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_ptrace": { 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_ptrace", 2024-09-10T22:19:21.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_interval": { 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_interval", 2024-09-10T22:19:21.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "autotune_memory_target_ratio": { 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "autotune_memory_target_ratio", 2024-09-10T22:19:21.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0.7", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_log_destination": { 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cephadm_log_destination", 2024-09-10T22:19:21.084 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "file", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "file,syslog", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "syslog" 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.085 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "cgroups_split": { 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cgroups_split", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.086 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "config_checks_enabled": { 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_checks_enabled", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.087 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "config_dashboard": { 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_dashboard", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.088 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_alertmanager": { 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_alertmanager", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.089 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_base": { 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_base", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Container image name, without the tag", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_elasticsearch": { 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_elasticsearch", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "elasticsearch container image", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_grafana": { 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_grafana", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_haproxy": { 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_haproxy", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "HAproxy container image", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_agent": { 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_agent", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger agent container image", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.094 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_collector": { 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_collector", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger collector container image", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.095 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_jaeger_query": { 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_jaeger_query", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Jaeger query container image", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_keepalived": { 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_keepalived", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Keepalived container image", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_loki": { 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_loki", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Loki container image", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.098 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nginx": { 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nginx", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nginx container image", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.099 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_node_exporter": { 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_node_exporter", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_nvmeof": { 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_nvmeof", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Nvme-of container image", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_oauth2_proxy": { 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_oauth2_proxy", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "oauth2-proxy container image", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_prometheus": { 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_prometheus", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Prometheus container image", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_promtail": { 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_promtail", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Promtail container image", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba": { 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB container image", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_samba_metrics": { 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_samba_metrics", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image_snmp_gateway": { 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_image_snmp_gateway", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "SNMP Gateway container image", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "container_init": { 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "container_init", 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Run podman/docker with `--init`", 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "daemon_cache_timeout": { 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "daemon_cache_timeout", 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "default_cephadm_command_timeout": { 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_cephadm_command_timeout", 2024-09-10T22:19:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "900", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "default_registry": { 2024-09-10T22:19:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default_registry", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "docker.io", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "device_cache_timeout": { 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_cache_timeout", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1800", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache device inventory", 2024-09-10T22:19:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "device_enhanced_scan": { 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_enhanced_scan", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "facts_cache_timeout": { 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "facts_cache_timeout", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "seconds to cache host facts data", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "grafana_dashboards_path": { 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "grafana_dashboards_path", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "host_check_interval": { 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "host_check_interval", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to perform a host check", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "hw_monitoring": { 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hw_monitoring", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "inventory_list_all": { 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "inventory_list_all", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "log_refresh_metadata": { 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_refresh_metadata", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-10T22:19:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "*", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max_count_per_host": { 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_count_per_host", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of daemons per service per host", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd_draining_count": { 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_osd_draining_count", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "migration_current": { 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "migration_current", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "internal - do not modify", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "mode": { 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mode", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "root", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm-package", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "root" 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "mode for remote execution of cephadm", 2024-09-10T22:19:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "oob_default_addr": { 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "oob_default_addr", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "169.254.1.1", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-10T22:19:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "prometheus_alerts_path": { 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus_alerts_path", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-10T22:19:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_insecure": { 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_insecure", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_password": { 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_password", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_url": { 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_url", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "registry_username": { 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "registry_username", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "secure_monitoring_stack": { 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secure_monitoring_stack", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "service_discovery_port": { 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "service_discovery_port", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8765", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "cephadm service discovery port", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "ssh_config_file": { 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssh_config_file", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "use_agent": { 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_agent", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "use_repo_digest": { 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "use_repo_digest", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_failed_host_check": { 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_failed_host_check", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if the host check fails", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_daemons": { 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_daemons", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_on_stray_hosts": { 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_on_stray_hosts", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crash", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "retain_interval": { 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retain_interval", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "31536000", 2024-09-10T22:19:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_recent_interval": { 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_recent_interval", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1209600", 2024-09-10T22:19:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dashboard", 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_HOST": { 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_ENABLED": { 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_ENABLED", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "ENABLE_BROWSABLE_API": { 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_PASSWORD": { 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_URL": { 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_URL", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_API_USERNAME": { 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "[]", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "MULTICLUSTER_CONFIG": { 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "{}", 2024-09-10T22:19:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_HOST": { 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_ENABLED": { 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "45", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ACCESS_KEY": { 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.196 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "admin", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.197 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SECRET_KEY": { 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "RGW_API_SSL_VERIFY": { 2024-09-10T22:19:21.198 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "UNSAFE_TLS_v1_2": { 2024-09-10T22:19:21.199 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-10T22:19:21.200 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "cross_origin_url": { 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cross_origin_url", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.204 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "crt_file": { 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "crt_file", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.205 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "debug": { 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "debug", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Enable/disable debug options", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.206 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "jwt_token_ttl": { 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "jwt_token_ttl", 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "28800", 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.207 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.208 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.209 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.212 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.213 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "motd": { 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "motd", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.214 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "The message of the day", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_resolve_ip_addr": { 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "redirect_resolve_ip_addr", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.215 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.216 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8080", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.217 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.218 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.219 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl_server_port": { 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl_server_port", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8443", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.220 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "redirect", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.221 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect" 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.222 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "url_prefix": { 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url_prefix", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.223 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.224 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_monitoring": { 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_monitoring", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "monitor device health metrics", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.225 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.226 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.228 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.229 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.230 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "mark_out_threshold": { 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mark_out_threshold", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "2419200", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.231 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": { 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pool_name", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "device_health_metrics", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.232 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "retention_period": { 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "retention_period", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15552000", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.233 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long to retain device health metrics", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_frequency": { 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_frequency", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.234 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "self_heal": { 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "self_heal", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.235 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.236 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how frequently to wake up and check device health", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.237 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "warn_threshold": { 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "warn_threshold", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7257600", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.238 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "diskprediction_local", 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.239 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.240 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.241 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.242 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.243 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.244 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "predict_interval": { 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predict_interval", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "86400", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.245 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "predictor_model": { 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "predictor_model", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "prophetstor", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.246 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "600", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.247 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.248 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "influx", 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": false, 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "influxdb python module not found", 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "batch_size": { 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "batch_size", 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5000", 2024-09-10T22:19:21.249 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "database": { 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "database", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "ceph", 2024-09-10T22:19:21.250 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "hostname": { 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "hostname", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.251 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server hostname", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "30", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "5", 2024-09-10T22:19:21.252 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.253 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.254 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.255 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.256 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.257 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "password": { 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "password", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "password of InfluxDB server user", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.258 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "port": { 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "port", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "8086", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "InfluxDB server port", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "ssl": { 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ssl", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "false", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "threads": { 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threads", 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "32", 2024-09-10T22:19:21.262 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "username": { 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "username", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.263 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "username of InfluxDB server user", 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "verify_ssl": { 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "verify_ssl", 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.264 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "true", 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.265 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "insights", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.266 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.267 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.268 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.269 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.270 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.271 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.272 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "iostat", 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.273 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.274 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.275 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.276 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.277 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.278 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "k8sevents", 2024-09-10T22:19:21.279 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph_event_retention_days": { 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "ceph_event_retention_days", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "7", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-10T22:19:21.280 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "config_check_secs": { 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "config_check_secs", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "10", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-10T22:19:21.281 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.282 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.285 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.286 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.287 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "localpool", 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "failure_domain": { 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "failure_domain", 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.288 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "host", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "failure domain for any created local pool", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.290 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.291 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.292 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.293 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.294 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": { 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "min_size", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default min_size for any created local pool", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-10T22:19:21.295 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "num_rep": { 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "num_rep", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default replica count for any created local pool", 2024-09-10T22:19:21.296 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": { 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_num", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "128", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "default pg_num for any created local pool", 2024-09-10T22:19:21.297 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "prefix": { 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prefix", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "name prefix for any created local pool", 2024-09-10T22:19:21.298 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.299 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "subtree": { 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "subtree", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "rack", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-10T22:19:21.300 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mds_autoscaler", 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.302 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.303 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirroring", 2024-09-10T22:19:21.307 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.308 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.309 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.310 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.311 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.312 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.313 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "nfs", 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.315 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.316 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.317 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.319 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.320 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "fail_fs": { 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "fail_fs", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.321 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.322 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.323 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.325 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.326 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator": { 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "orchestrator", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.327 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "rook", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "test_orchestrator" 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Orchestrator backend", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.328 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_perf_query", 2024-09-10T22:19:21.329 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.330 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.331 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.332 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.333 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.334 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.335 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "osd_support", 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.336 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.337 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.338 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.339 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.340 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.341 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "pg_autoscaler", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.343 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.344 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.346 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "threshold": { 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "threshold", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.350 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "3.0", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1.0", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "scaling threshold", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "progress", 2024-09-10T22:19:21.351 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_pg_recovery_event": { 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_pg_recovery_event", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-10T22:19:21.352 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.353 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.354 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.355 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.356 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.357 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.358 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max_completed_events": { 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_completed_events", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "50", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "number of past completed events to remember", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.359 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "sleep_interval": { 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sleep_interval", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "how long the module is going to sleep", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.361 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "prometheus", 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "cache": { 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "cache", 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "exclude_perf_counters": { 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "exclude_perf_counters", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.363 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.364 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.365 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.366 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.367 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.368 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools": { 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.369 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "300", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.370 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "scrape_interval": { 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "scrape_interval", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15.0", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.371 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "::", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.372 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "9283", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.373 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.374 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "stale_cache_strategy": { 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stale_cache_strategy", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "log", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.375 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_behaviour": { 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_behaviour", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "default", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.376 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "error" 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "standby_error_status_code": { 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "standby_error_status_code", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:21.377 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "400", 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "599", 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.378 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.379 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.380 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.382 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.383 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_snap_create": { 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_snap_create", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.384 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "mirror_snapshot_schedule": { 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mirror_snapshot_schedule", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.385 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.386 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "trash_purge_schedule": { 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "trash_purge_schedule", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.387 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "restful", 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.388 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_auth": { 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enable_auth", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "key_file": { 2024-09-10T22:19:21.389 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "key_file", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.390 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.391 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.392 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.393 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.394 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "max_requests": { 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_requests", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "500", 2024-09-10T22:19:21.395 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "server_addr": { 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_addr", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.396 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "server_port": { 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "server_port", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.397 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.398 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rgw", 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.399 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.400 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.401 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.402 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.403 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "secondary_zone_period_retry_limit": { 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "5", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rook", 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.407 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.409 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.410 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_class": { 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "storage_class", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.413 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "local", 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "selftest", 2024-09-10T22:19:21.414 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.415 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.416 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.417 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.418 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "roption1": { 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption1", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.420 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "roption2": { 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "roption2", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "xyz", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption1": { 2024-09-10T22:19:21.421 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption1", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption2": { 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption2", 2024-09-10T22:19:21.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption3": { 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption3", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "float", 2024-09-10T22:19:21.423 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption4": { 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption4", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.424 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption5": { 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption5", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.425 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption6": { 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption6", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "rwoption7": { 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rwoption7", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.427 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "1", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "42", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.428 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "testkey": { 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testkey", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.429 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "testlkey": { 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testlkey", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "testnewline": { 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "testnewline", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.431 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "smb", 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.432 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "internal_store_backend": { 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "internal_store_backend", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-10T22:19:21.433 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.434 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.435 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.436 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.437 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.438 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.439 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "update_orchestration": { 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "update_orchestration", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.440 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snap_schedule", 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.441 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_m_granularity": { 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "allow_m_granularity", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "allow minute scheduled snapshots", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "dump_on_update": { 2024-09-10T22:19:21.442 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "dump_on_update", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "dump database to debug log on update", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.443 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.444 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.445 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.446 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.447 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.448 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "stats", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.450 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.451 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.452 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.453 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.454 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.455 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "status", 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.458 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.459 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.460 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.461 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telegraf", 2024-09-10T22:19:21.462 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "address": { 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "address", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.463 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "15", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.464 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.465 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.466 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.467 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.468 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.469 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "telemetry", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.470 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_basic": { 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_basic", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_crash": { 2024-09-10T22:19:21.471 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_crash", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_device": { 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_device", 2024-09-10T22:19:21.472 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_ident": { 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_ident", 2024-09-10T22:19:21.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "channel_perf": { 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "channel_perf", 2024-09-10T22:19:21.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "contact": { 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "contact", 2024-09-10T22:19:21.475 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "description": { 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "description", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.476 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "device_url": { 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "device_url", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.477 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": { 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "enabled", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.478 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "24", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "8", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "last_opt_revision": { 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "last_opt_revision", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.480 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "1", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard": { 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.481 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "leaderboard_description": { 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "leaderboard_description", 2024-09-10T22:19:21.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.484 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.485 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.486 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "organization": { 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "organization", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.488 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "proxy": { 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "proxy", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.489 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.490 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "url": { 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "url", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-10T22:19:21.491 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "test_orchestrator", 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.492 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.493 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.494 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.495 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.496 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.497 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.498 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.499 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.502 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.503 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max_concurrent_clones": { 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "max_concurrent_clones", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "4", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-10T22:19:21.504 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "periodic_async_work": { 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "periodic_async_work", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.505 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Periodically check for async work", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_delay": { 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_delay", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.506 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "snapshot_clone_no_wait": { 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "snapshot_clone_no_wait", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "True", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.507 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.508 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix", 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "can_run": true, 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "error_string": "", 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "module_options": { 2024-09-10T22:19:21.509 INFO:teuthology.orchestra.run.smithi005.stdout: "discovery_interval": { 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "discovery_interval", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "uint", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "100", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.510 INFO:teuthology.orchestra.run.smithi005.stdout: "identifier": { 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "identifier", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.511 INFO:teuthology.orchestra.run.smithi005.stdout: "interval": { 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "interval", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "secs", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "60", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "log_level": { 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_level", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.513 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster": { 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.514 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_cluster_level": { 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_cluster_level", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "info", 2024-09-10T22:19:21.515 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [ 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "critical", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "debug", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "error", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "info", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "warning" 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": { 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "log_to_file", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "bool", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "False", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "sqlite3_killpoint": { 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "sqlite3_killpoint", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "dev", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "0", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_host": { 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_host", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.519 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_port": { 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_port", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "int", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "10051", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.520 INFO:teuthology.orchestra.run.smithi005.stdout: "zabbix_sender": { 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "zabbix_sender", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "str", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "level": "advanced", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 0, 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "min": "", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "max": "", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "enum_allowed": [], 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "desc": "", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "long_desc": "", 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: "see_also": [] 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.521 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "services": { 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "dashboard": "https://172.21.15.5:8443/" 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "always_on_modules": { 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "octopus": [ 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-10T22:19:21.522 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "pacific": [ 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-10T22:19:21.523 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "quincy": [ 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.524 INFO:teuthology.orchestra.run.smithi005.stdout: "reef": [ 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "squid": [ 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "balancer", 2024-09-10T22:19:21.525 INFO:teuthology.orchestra.run.smithi005.stdout: "crash", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "devicehealth", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "orchestrator", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscaler", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "progress", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_support", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "status", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "telemetry", 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "volumes" 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "force_disabled_modules": {}, 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "last_failure_osd_epoch": 3, 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: "active_clients": [ 2024-09-10T22:19:21.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "devicehealth", 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2227085846 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "libcephsqlite", 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.527 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 296780087 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "rbd_support", 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2639910305 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "volumes", 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:0", 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 570612030 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-10T22:19:21.529 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:19:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9f900b52e0 msgr2=0x7f9f900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9f900b52e0 0x7f9f900b77a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9f940096c0 tx=0x7f9f94000bc0 comp rx=0 tx=0).stop 2024-09-10T22:19:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 msgr2=0x7f9fa4198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:21.530 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 0x7f9fa4198de0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000eab0 tx=0x7f9fa000ef70 comp rx=0 tx=0).stop 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 shutdown_connections 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f9f900b52e0 0x7f9f900b77a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f9fa41033c0 0x7f9fa419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f9fa4102a00 0x7f9fa4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 --2- 172.21.15.5:0/6260765 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f9fa41018b0 0x7f9fa4198de0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.053+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 >> 172.21.15.5:0/6260765 conn(0x7f9fa40fd150 msgr2=0x7f9fa4105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.054+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 shutdown_connections 2024-09-10T22:19:21.531 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:20.054+0000 7f9fab9f3640 1 -- 172.21.15.5:0/6260765 wait complete. 2024-09-10T22:19:21.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3890796051' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/484348926' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.531 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:19 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3182192062' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.539 DEBUG:tasks.check_counter:Getting stats from a 2024-09-10T22:19:21.539 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-10T22:19:21.540 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:20 smithi005 ceph-mon[31115]: pgmap v421: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-09-10T22:19:21.540 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:20 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/6260765' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:19 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3890796051' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:19 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/484348926' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:19 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3182192062' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:20 smithi052 ceph-mon[34997]: pgmap v421: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:20 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/6260765' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3890796051' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/484348926' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:19 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3182192062' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-10T22:19:21.541 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:20 smithi189 ceph-mon[35784]: pgmap v421: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.0 MiB/s wr, 12 op/s 2024-09-10T22:19:21.542 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:20 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/6260765' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-10T22:19:21.809 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:22.304 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:19:22.304 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.001537179, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000255837, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:22.305 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 80, 2024-09-10T22:19:22.306 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 77, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 484496, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 46272, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.013947461, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.006062432, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.011854434, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 76, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.003897723, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000051285 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.307 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 484496, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 46272 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 5, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 60, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3104, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 90848, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:22.308 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.008116009, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.004151213, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.003441392, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 59, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.006721048, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000113916 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:22.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 90848 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:22.310 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:22.311 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:22.312 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148863, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 28, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:22.313 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 968, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:22.314 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 81, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 473221, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 81, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 81, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 473221, 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-10T22:19:22.315 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:22.316 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:22.316 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:22.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:22.316 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:22.316 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:19:22.949 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:22 smithi005 ceph-mon[31115]: pgmap v422: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-09-10T22:19:23.075 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-10T22:19:23.076 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-10T22:19:23.076 DEBUG:tasks.check_counter:Getting stats from d 2024-09-10T22:19:23.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-10T22:19:23.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:22 smithi189 ceph-mon[35784]: pgmap v422: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-09-10T22:19:23.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:22 smithi052 ceph-mon[34997]: pgmap v422: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-09-10T22:19:23.332 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:23.782 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:19:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2024-09-10T22:19:23.782 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.001217708, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000189545, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.783 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 86, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 83, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 486192, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 49632, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-10T22:19:23.784 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.014235589, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.006188785, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.011585181, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 82, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.004145866, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000050559 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:23.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 486192, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 49632 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 5, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 64, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 3104, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 91552, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.008456445, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.004600687, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.003270385, 2024-09-10T22:19:23.786 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 63, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.006765216, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000107384 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 91552 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-10T22:19:23.787 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:23.788 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:23.789 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148823, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 27, 2024-09-10T22:19:23.790 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 968, 2024-09-10T22:19:23.791 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 87, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 474065, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 87, 2024-09-10T22:19:23.792 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 87, 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 474065, 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:23.793 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:19:24.574 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-10T22:19:24.574 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-10T22:19:24.574 DEBUG:tasks.check_counter:Getting stats from g 2024-09-10T22:19:24.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-10T22:19:24.837 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:25.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:24 smithi189 ceph-mon[35784]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-09-10T22:19:25.204 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:24 smithi005 ceph-mon[31115]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-09-10T22:19:25.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:24 smithi052 ceph-mon[34997]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.001448205, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:19:25.463 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000293806, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:19:25.464 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 59, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 90576, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.006014401, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.004160328, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001244622, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:25.465 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 57, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.002607253, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000045741 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 90576 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 86, 2024-09-10T22:19:25.466 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 81, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 488048, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 47504, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.015682828, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.006012017, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.013196131, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 81, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.007949954, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000098147 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:25.467 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 488048, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 47504 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:25.468 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:25.469 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:25.470 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148863, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 28, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-10T22:19:25.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 968, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:25.472 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 83, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 473545, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 83, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 83, 2024-09-10T22:19:25.473 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 473545, 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:25.474 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:19:26.256 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-10T22:19:26.256 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-10T22:19:26.256 DEBUG:tasks.check_counter:Getting stats from j 2024-09-10T22:19:26.256 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-10T22:19:26.517 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:26.906 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:26 smithi005 ceph-mon[31115]: pgmap v424: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 0, 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 2, 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 0, 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:27.013 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 0, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.001114651, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.000161181, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.014 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 1, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 64, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 91456, 2024-09-10T22:19:27.015 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.007100198, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.005032470, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.001394145, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 62, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.002588813, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000041755 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:27.016 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 91456 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_messages": 92, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages": 87, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_bytes": 489680, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_bytes": 51360, 2024-09-10T22:19:27.017 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_created_connections": 2, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_total_time": 0.017376974, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_send_time": 0.006864214, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_recv_time": 0.014533757, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 87, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.008448312, 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000097107 2024-09-10T22:19:27.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_recv_encrypted_bytes": 489680, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "msgr_send_encrypted_bytes": 51360 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "cct": { 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "total_workers": 0, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "unhealthy_workers": 0 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.019 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool": { 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:27.020 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:27.021 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_items": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:27.022 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_bytes": 148823, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_anon_items": 27, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bytes": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_items": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:27.023 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_bytes": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_items": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "pgmap_items": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_bytes": 968, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_co_items": 2, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_1_items": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "unittest_2_items": 0 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:27.024 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 0, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "max": 104857600, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_started": 0, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get": 89, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_sum": 474325, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "get_or_fail_success": 89, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "take": 0, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "take_sum": 0, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "put": 89, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "put_sum": 474325, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "wait": { 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "avgcount": 0, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "sum": 0.000000000, 2024-09-10T22:19:27.025 INFO:teuthology.orchestra.run.smithi005.stdout: "avgtime": 0.000000000 2024-09-10T22:19:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:27.026 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-10T22:19:27.026 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-10T22:19:27.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:26 smithi189 ceph-mon[35784]: pgmap v424: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T22:19:27.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:26 smithi052 ceph-mon[34997]: pgmap v424: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-10T22:19:27.802 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-10T22:19:27.802 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-10T22:19:27.802 DEBUG:tasks.check_counter:Getting stats from b 2024-09-10T22:19:27.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-10T22:19:28.068 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:19:28.573 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T22:19:28.573 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:28.573 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 679, 2024-09-10T22:19:28.573 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 637, 2024-09-10T22:19:28.573 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 179329, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 1425615, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 55, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.082873380, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.032025817, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.036516590, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.010618836, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 639, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.349131983, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000546372 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.574 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 369, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000077637, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000210 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 583, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 507, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 640295, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 194302, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 7, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 5, 2024-09-10T22:19:28.575 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.057091121, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.023668017, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.033504560, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.009416929, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 509, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1.160570818, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002280099 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 280, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000062845, 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000224 2024-09-10T22:19:28.576 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 528880, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 58144 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 666, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 553, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 228745, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 450015, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 15, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 8, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.083674895, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.028951672, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.031072220, 2024-09-10T22:19:28.577 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.023104751, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 545, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.586490719, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001076129 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 620, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000131738, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000212 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 51824, 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 218352 2024-09-10T22:19:28.578 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 478, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.117004043, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000244778 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T22:19:28.579 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 89, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.002815541, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000031635 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 53, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 53, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 53, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.061376663, 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001158050 2024-09-10T22:19:28.580 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 53, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 24, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 5, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 19, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 16, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T22:19:28.581 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 3, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 3, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 95, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 88, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 10, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T22:19:28.582 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 58, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 4, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 234, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 58, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 34, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 4, 2024-09-10T22:19:28.583 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 30, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 24, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 30, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 39, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 114, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 82, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 3, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 25 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T22:19:28.584 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 3, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 6, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 6, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:19:28.585 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 4, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.586 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 176, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 135, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 135, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 41, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 22, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 10, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 9, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 9, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 1, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 1, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 1, 2024-09-10T22:19:28.587 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4708796, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4841364, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 149, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.310983630, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002087138 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 23, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 33, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 10, 2024-09-10T22:19:28.588 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 18, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 20, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 2, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 24, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 35, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 11, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 3, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 20, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 17, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 52632, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 268161024 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 70, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T22:19:28.589 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 53, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 10, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005927906, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000740988 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 16, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003676639, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000229789 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T22:19:28.590 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.591 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000400507, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000200253 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.592 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T22:19:28.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 8, 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.012558236, 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001569779 2024-09-10T22:19:28.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000219122, 2024-09-10T22:19:28.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000219122 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003295979, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001647989 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001908333, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000954166 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T22:19:28.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.008517995, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.004258997 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.597 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001285309, 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001285309 2024-09-10T22:19:28.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.599 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 7, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.018328763, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.002618394 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 4, 2024-09-10T22:19:28.600 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005257874, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001314468 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 1, 2024-09-10T22:19:28.601 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 2, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 1, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 1, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 15, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 15, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 156, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:28.602 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:28.603 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:28.604 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 290186, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 112, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 440, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 5, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7400, 2024-09-10T22:19:28.605 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 152, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 94514, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 594, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T22:19:28.606 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 959, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 715415, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 37, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 959, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 959, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 20.040759187, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.020897559 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 959, 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 1115 2024-09-10T22:19:28.607 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 959, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 69, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 890, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 33, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 28, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 7, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 152, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 42, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-10T22:19:28.608 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 581, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 62, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 56, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:19:28.609 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T22:19:28.610 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 78, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 12, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 12, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 140, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 14 2024-09-10T22:19:28.611 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 64, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 4, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 69, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 6, 2024-09-10T22:19:28.612 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 1924, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 859587, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 1924, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 1924, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 859587, 2024-09-10T22:19:28.613 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:28.614 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 959, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 716021, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 959, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 716021, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:28.615 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 959, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 959, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 959, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 959, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:19:28.616 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 6, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 606, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 6, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 606, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.617 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x559e8f860960": { 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 176, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 647060, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 176, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 149, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 647060, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:28.618 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:28.619 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T22:19:28.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:28 smithi052 ceph-mon[34997]: pgmap v425: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:19:29.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:28 smithi189 ceph-mon[35784]: pgmap v425: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:19:29.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:28 smithi005 ceph-mon[31115]: pgmap v425: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:19:29.509 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-10T22:19:29.509 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-10T22:19:29.509 DEBUG:tasks.check_counter:Getting stats from e 2024-09-10T22:19:29.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-10T22:19:29.765 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:19:30.297 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T22:19:30.297 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:30.297 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 265, 2024-09-10T22:19:30.297 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 265, 2024-09-10T22:19:30.297 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 72537, 2024-09-10T22:19:30.297 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 83510, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 6, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.033397994, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.016171096, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.008020774, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.005846872, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 264, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.016728227, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000063364 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.298 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 3, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 65, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 674, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 185617, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-10T22:19:30.299 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.005525257, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.003514430, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.001315016, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000054563, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 63, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003548017, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000056317 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.300 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 184976 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 353, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 348, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 595552, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 133182, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.054880018, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.023667642, 2024-09-10T22:19:30.301 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.023758687, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.009841008, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 347, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.021773609, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000062748 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 509200, 2024-09-10T22:19:30.302 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 51456 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1033, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.030443473, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000029470 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T22:19:30.303 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 0, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 0, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.304 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T22:19:30.305 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 1, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-10T22:19:30.306 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:19:30.307 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:19:30.308 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 0 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-10T22:19:30.309 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T22:19:30.310 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 2, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-10T22:19:30.311 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4194892, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 4194352, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 2 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.312 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 3, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 3, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 1, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 1, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 0, 2024-09-10T22:19:30.313 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 48612, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 248238080 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 0, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 0, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 0, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.314 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.315 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.316 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T22:19:30.317 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.318 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.319 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.320 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T22:19:30.321 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.322 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.323 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T22:19:30.324 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.325 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T22:19:30.326 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:30.327 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:30.328 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:30.329 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 182190, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 45, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7400, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 152, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:30.330 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 8672, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 13, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 520, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 21, 2024-09-10T22:19:30.331 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 3, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 520, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 520, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.263996814, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000507686 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 520, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 521 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 520, 2024-09-10T22:19:30.332 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 520, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 257, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 261, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T22:19:30.333 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 1, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T22:19:30.334 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T22:19:30.335 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 78, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 4, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 4, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 0, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 2, 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 0 2024-09-10T22:19:30.336 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-10T22:19:30.337 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 617, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 605351, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 617, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 617, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 605351, 2024-09-10T22:19:30.338 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:30.339 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.339 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:30.340 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 520, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 593, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 520, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 593, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T22:19:30.341 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 520, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 520, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 520, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 520, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.342 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.343 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x556851ce6c80": { 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:30.344 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:30.345 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T22:19:31.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:30 smithi005 ceph-mon[31115]: pgmap v426: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:31.167 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:30 smithi052 ceph-mon[34997]: pgmap v426: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:31.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:30 smithi189 ceph-mon[35784]: pgmap v426: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:31.197 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-10T22:19:31.197 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-10T22:19:31.197 DEBUG:tasks.check_counter:Getting stats from h 2024-09-10T22:19:31.197 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-10T22:19:31.452 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 286, 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 316, 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 564704, 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 113437, 2024-09-10T22:19:32.000 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 7, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 3, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.045396690, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.020989655, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.027126826, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.001679089, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 315, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.030516772, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000096878 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 332, 2024-09-10T22:19:32.001 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000098063, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000295 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 521936, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 54656 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 32, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 93, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 12581, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 225627, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 11, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 5, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.013520832, 2024-09-10T22:19:32.002 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.007053952, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.005603243, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000234305, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 91, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.019010133, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000208902 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 37, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000007607, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000205 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.003 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 1744, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 187888 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 28, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 28, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 8257, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 136036, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 17, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 6, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.009773872, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000964511, 2024-09-10T22:19:32.004 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.008087901, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000347757, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 27, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.022430340, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000830753 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 10, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000001181, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000118 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T22:19:32.005 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 1, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-MDSRank": { 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 43, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.001609369, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000037427 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "finisher-PurgeQueue": { 2024-09-10T22:19:32.006 INFO:teuthology.orchestra.run.smithi052.stdout: "queue_len": 0, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "complete_latency": { 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 2, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000012083, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000006041 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "mds": { 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "request": 2, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "reply": 1, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "reply_latency": { 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000179080, 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000179080 2024-09-10T22:19:32.007 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_reply": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "forward": 1, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_complete": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_fetch_keys": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_commit": 11, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_split": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_merge": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes": 11, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_top": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_bottom": 11, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pin_tail": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_pinned": 10, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_expired": 0, 2024-09-10T22:19:32.008 INFO:teuthology.orchestra.run.smithi052.stdout: "inodes_with_caps": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "caps": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "subtrees": 2, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse": 4, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_hit": 2, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_forward": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_discover": 1, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_remote_ino": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "traverse_lock": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "load_cent": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "q": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "exported": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "exported_inodes": 0, 2024-09-10T22:19:32.009 INFO:teuthology.orchestra.run.smithi052.stdout: "imported": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "imported_inodes": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_dir_fetch": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "openino_peer_discover": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rfiles": 8, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rbytes": 269505890, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "root_rsnaps": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_set_tag": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:19:32.010 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "scrub_file_inodes": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_cap_release": 0, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "process_request_cap_release": 1 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache": { 2024-09-10T22:19:32.011 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_update_receipt": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_try_discover": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_send_discover": 2, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "dir_handle_discover": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_delayed": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_created": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_enqueued": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_reintegrated": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "strays_migrated": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_processing": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:19:32.012 INFO:teuthology.orchestra.run.smithi052.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_started": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_completed": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_exportdir": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_flush": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_fragstats": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "ireq_inodestats": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_started": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_succeeded": 0, 2024-09-10T22:19:32.013 INFO:teuthology.orchestra.run.smithi052.stdout: "uninline_write_failed": 0 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log": { 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "evlrg": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "evadd": 4, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "evex": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "evtrm": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "ev": 4, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "evexg": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "evexd": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "segadd": 2, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "segex": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "segtrm": 0, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "seg": 2, 2024-09-10T22:19:32.014 INFO:teuthology.orchestra.run.smithi052.stdout: "segmjr": 2, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "segexg": 0, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "segexd": 0, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "expos": 4194304, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "wrpos": 4195424, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "rdpos": 0, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "jlat": { 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 3, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.005449123, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.001816374 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "replayed": 0 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mem": { 2024-09-10T22:19:32.015 INFO:teuthology.orchestra.run.smithi052.stdout: "ino": 14, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "ino+": 14, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "ino-": 0, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "dir": 12, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "dir+": 13, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "dir-": 1, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "dn": 11, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "dn+": 11, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "dn-": 0, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "cap": 0, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "cap+": 1, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "cap-": 1, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "rss": 49760, 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: "heap": 257683456 2024-09-10T22:19:32.016 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_server": { 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_client_request": 3, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "dispatch_server_request": 0, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_request": 2, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_client_session": 4, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "handle_peer_request": 0, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "req_create_latency": { 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getattr_latency": { 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 1, 2024-09-10T22:19:32.017 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000179080, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000179080 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getfilelock_latency": { 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "req_link_latency": { 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookup_latency": { 2024-09-10T22:19:32.018 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookuphash_latency": { 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupino_latency": { 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.019 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupname_latency": { 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupparent_latency": { 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lookupsnap_latency": { 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.020 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: "req_lssnap_latency": { 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.021 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mkdir_latency": { 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mknod_latency": { 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "req_mksnap_latency": { 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.022 INFO:teuthology.orchestra.run.smithi052.stdout: "req_open_latency": { 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "req_readdir_latency": { 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rename_latency": { 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.023 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "req_renamesnap_latency": { 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "req_snapdiff_latency": { 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmdir_latency": { 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.024 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmsnap_latency": { 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "req_rmxattr_latency": { 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setattr_latency": { 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.025 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setdirlayout_latency": { 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setfilelock_latency": { 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setlayout_latency": { 2024-09-10T22:19:32.026 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "req_setxattr_latency": { 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "req_symlink_latency": { 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.027 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "req_unlink_latency": { 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "req_getvxattr_latency": { 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.028 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessions": { 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "session_count": 0, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "session_add": 1, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "session_remove": 1, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_open": 0, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "sessions_stale": 0, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "total_load": 1, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "average_load": 1, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "avg_session_uptime": 73, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mdthresh_evicted": 0 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T22:19:32.029 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:32.030 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:32.031 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 254599, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 83, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T22:19:32.032 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 7400, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 152, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 55416, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 213, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T22:19:32.033 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter": { 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_active": 0, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_laggy": 0, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send": 38, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_send_bytes": 11332, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_resend": 27, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_reply": 38, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_latency": { 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 38, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.265996808, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.006999916 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.034 INFO:teuthology.orchestra.run.smithi052.stdout: "op_inflight": 0, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "oplen_avg": { 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 38, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 60 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "op": 38, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "op_r": 0, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "op_w": 38, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "op_rmw": 0, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "op_pg": 0, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_stat": 0, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_create": 10, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_read": 0, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_write": 3, 2024-09-10T22:19:32.035 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writefull": 6, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_writesame": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_append": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_zero": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_truncate": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_delete": 6, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_mapext": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_sparse_read": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_clonerange": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_getxattr": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_setxattr": 20, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:19:32.036 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_rmxattr": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_call": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_watch": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_notify": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "osdop_other": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_active": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_send": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_resend": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ping": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_active": 0, 2024-09-10T22:19:32.037 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_send": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "poolop_resend": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_active": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_send": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "poolstat_resend": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_active": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_send": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_resend": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "command_active": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "command_send": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "command_resend": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "map_epoch": 78, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "map_full": 0, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "map_inc": 2, 2024-09-10T22:19:32.038 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_sessions": 9, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_open": 9, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_session_close": 0, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_laggy": 0, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_wr": 14, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_rd": 0, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_del": 1 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "oft": { 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_objs": 1, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_updates": 0, 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: "omap_total_removes": 0 2024-09-10T22:19:32.039 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "purge_queue": { 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executing_high_water": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed_ops": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_executed": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "pq_item_in_journal": 0 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:32.040 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 342, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 545381, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 342, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 342, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 545381, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.041 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_bytes": { 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 38, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 11332, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 38, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 11332, 2024-09-10T22:19:32.042 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-objecter_ops": { 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 1024, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:32.043 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 38, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 38, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 38, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 38, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T22:19:32.044 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.045 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-write_buf_throttle-0x5623bc140960": { 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 3758096384, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 4, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 1120, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 4, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 3, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 1120, 2024-09-10T22:19:32.046 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: "trackedop": { 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: "slow_ops_count": 0 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:32.047 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T22:19:32.809 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-10T22:19:32.809 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-10T22:19:32.809 DEBUG:tasks.check_counter:Getting stats from k 2024-09-10T22:19:32.809 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-10T22:19:33.059 INFO:teuthology.orchestra.run.smithi052.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.b/config 2024-09-10T22:19:33.179 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:32 smithi052 ceph-mon[34997]: pgmap v427: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:19:33.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:32 smithi189 ceph-mon[35784]: pgmap v427: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:19:33.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:32 smithi005 ceph-mon[31115]: pgmap v427: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 0, 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 2, 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 0, 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 0, 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 0, 2024-09-10T22:19:33.592 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.001145894, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.000000000, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.000276591, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:33.593 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 1, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 66, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 91808, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.006028180, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.004360052, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.000783803, 2024-09-10T22:19:33.594 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 64, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.003915799, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000061184 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 91808 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_messages": 94, 2024-09-10T22:19:33.595 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages": 89, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_bytes": 490224, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_bytes": 52640, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_created_connections": 2, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_total_time": 0.019781646, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_send_time": 0.007673041, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_recv_time": 0.016179205, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 89, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.009434432, 2024-09-10T22:19:33.596 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000106004 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_recv_encrypted_bytes": 490224, 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "msgr_send_encrypted_bytes": 52640 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.597 INFO:teuthology.orchestra.run.smithi052.stdout: "cct": { 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "total_workers": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "unhealthy_workers": 0 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool": { 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:33.598 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:33.599 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_bytes": 148863, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_anon_items": 28, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_items": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:33.600 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_bytes": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_items": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "pgmap_items": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_bytes": 968, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_co_items": 2, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_1_items": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: "unittest_2_items": 0 2024-09-10T22:19:33.601 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "val": 0, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "max": 104857600, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "get_started": 0, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "get": 91, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "get_sum": 474585, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "get_or_fail_success": 91, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "take": 0, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "take_sum": 0, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "put": 91, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "put_sum": 474585, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "wait": { 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "avgcount": 0, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "sum": 0.000000000, 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: "avgtime": 0.000000000 2024-09-10T22:19:33.602 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:33.603 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-09-10T22:19:33.603 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-09-10T22:19:34.286 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-10T22:19:34.287 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-10T22:19:34.287 DEBUG:tasks.check_counter:Getting stats from c 2024-09-10T22:19:34.287 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-10T22:19:34.553 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:19:34.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:34 smithi189 ceph-mon[35784]: pgmap v428: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:35.083 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T22:19:35.083 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:35.083 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 705, 2024-09-10T22:19:35.083 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 700, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1334346, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 244964, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.085709851, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.038554048, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.029415887, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.016624979, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 699, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.028081762, 2024-09-10T22:19:35.084 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000040174 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 509360, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 51616 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 5, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 67, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 1816, 2024-09-10T22:19:35.085 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 187962, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 5, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.006200434, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.003523374, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001782258, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000133357, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 65, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.006875128, 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000105771 2024-09-10T22:19:35.086 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 186624 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 263, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 263, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 66764, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 82817, 2024-09-10T22:19:35.087 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.033137295, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.014444612, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.008389116, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.008015200, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 262, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.015888208, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000060642 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.088 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1453, 2024-09-10T22:19:35.089 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.038917540, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000026784 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-10T22:19:35.090 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 20, 2024-09-10T22:19:35.091 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 4, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 16, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 13, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 2, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:19:35.092 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 4, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 234, 2024-09-10T22:19:35.093 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:19:35.094 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:19:35.095 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-10T22:19:35.096 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_started": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_succeeded": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_write_failed": 0 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 176, 2024-09-10T22:19:35.097 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 10, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4708796, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4841364, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4838867, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.098 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 176 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 14, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 20, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 6, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 9, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 11, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 2, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 20, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 25, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 5, 2024-09-10T22:19:35.099 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 48504, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 248242176 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.100 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.101 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.102 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.103 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.104 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.105 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.106 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-10T22:19:35.107 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.108 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.109 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.110 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:19:35.111 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 1, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 2, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-10T22:19:35.112 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 1498, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:35.113 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:35.114 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:35.115 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 189273, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 50, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:35.116 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7400, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 152, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 57050, 2024-09-10T22:19:35.117 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 269, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 871, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 26, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 4, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 871, 2024-09-10T22:19:35.118 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 871, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.413991824, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000475306 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 871, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 872 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 871, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 871, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-10T22:19:35.119 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 518, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 350, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-10T22:19:35.120 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 2, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-10T22:19:35.121 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-10T22:19:35.122 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 78, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 5, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 5, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-10T22:19:35.123 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-10T22:19:35.124 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 969, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 1307788, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 969, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:35.125 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 969, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1307788, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:35.126 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 871, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 647070, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 871, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 647070, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-10T22:19:35.127 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 871, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 871, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 871, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 871, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.128 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:35.129 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.130 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x560071488c80": { 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:35.131 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: "trackedop": { 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:35.132 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T22:19:35.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:34 smithi052 ceph-mon[34997]: pgmap v428: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:35.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:34 smithi005 ceph-mon[31115]: pgmap v428: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:36.034 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-10T22:19:36.034 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-10T22:19:36.034 DEBUG:tasks.check_counter:Getting stats from f 2024-09-10T22:19:36.035 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-10T22:19:36.292 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:19:36.841 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 716, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 718, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 205863, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 227695, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 6, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.081499686, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.037079537, 2024-09-10T22:19:36.842 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.017380833, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.021041068, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 716, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.032583982, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000045508 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 0 2024-09-10T22:19:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 3, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 66, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 716, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 189146, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.005552158, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.003547217, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.001235593, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000070695, 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:36.844 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 64, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.004756448, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000074319 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 188448 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 102, 2024-09-10T22:19:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 95, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 512684, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 52862, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.019553316, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.007846561, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.015443980, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000053018, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 95, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.011261615, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000118543 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:36.846 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 512416, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 52544 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T22:19:36.847 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1248, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.034403777, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000027567 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.848 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-10T22:19:36.849 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-10T22:19:36.850 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 0, 2024-09-10T22:19:36.851 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:19:36.852 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-10T22:19:36.853 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-10T22:19:36.854 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_started": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_succeeded": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_write_failed": 0 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 4, 2024-09-10T22:19:36.855 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4195424, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 4195283, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.856 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 4 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 3, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 3, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 1, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 1, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 0, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 0, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 0, 2024-09-10T22:19:36.857 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 48428, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 248242176 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.858 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.859 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-10T22:19:36.860 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.861 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.862 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.863 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.863 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-10T22:19:36.863 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.863 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.863 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.863 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.864 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-10T22:19:36.865 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.866 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.867 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.868 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-10T22:19:36.869 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 0, 2024-09-10T22:19:36.870 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 1, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 1, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 1, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 1315, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:36.871 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:36.872 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:36.873 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 181176, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 45, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T22:19:36.874 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7400, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 152, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 8672, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 13, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:36.875 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 719, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 21, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 3, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 719, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 719, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.364992802, 2024-09-10T22:19:36.876 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000507639 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 719, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 720 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 719, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 719, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 0, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 447, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 0, 2024-09-10T22:19:36.877 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 270, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 1, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:19:36.878 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-10T22:19:36.879 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 78, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 4, 2024-09-10T22:19:36.880 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 4, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 0, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 2, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 0 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 0, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.881 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 817, 2024-09-10T22:19:36.882 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 637799, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 817, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 817, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 637799, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.883 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 719, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 1125, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 719, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 1125, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.884 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 719, 2024-09-10T22:19:36.885 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 719, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 719, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 719, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:36.886 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x557998a3cc80": { 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:36.887 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:36.888 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.889 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:36.889 INFO:teuthology.orchestra.run.smithi189.stdout: "trackedop": { 2024-09-10T22:19:36.889 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-10T22:19:36.889 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:36.889 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T22:19:37.157 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:36 smithi189 ceph-mon[35784]: pgmap v429: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:19:37.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:36 smithi052 ceph-mon[34997]: pgmap v429: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:19:37.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:36 smithi005 ceph-mon[31115]: pgmap v429: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-10T22:19:37.821 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-10T22:19:37.822 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-10T22:19:37.822 DEBUG:tasks.check_counter:Getting stats from i 2024-09-10T22:19:37.822 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-10T22:19:38.070 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:19:38.574 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 28, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 30, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 8460, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 107108, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 16, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 4, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.008886212, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000679354, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.005642597, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000511837, 2024-09-10T22:19:38.575 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 27, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.016743183, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000620117 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 8, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000717, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000089 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.576 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 132, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 256, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 35318, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 239241, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 7, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 5, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.027644435, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.014324324, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.010103418, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.001967010, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 254, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.024115321, 2024-09-10T22:19:38.577 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000094942 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 292, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000067884, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000232 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 188080 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 146, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 137, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 528413, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 115941, 2024-09-10T22:19:38.578 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 10, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 3, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.022162354, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.008870728, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.017722682, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000102059, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 138, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.011992888, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000086904 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 31, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000006049, 2024-09-10T22:19:38.579 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000195 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 518400, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 55456 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 1, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-MDSRank": { 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 44, 2024-09-10T22:19:38.580 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001205571, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000027399 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "finisher-PurgeQueue": { 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "queue_len": 0, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "complete_latency": { 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 2, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000013208, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000006604 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "mds": { 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "request": 0, 2024-09-10T22:19:38.581 INFO:teuthology.orchestra.run.smithi189.stdout: "reply": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "reply_latency": { 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_reply": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "forward": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_complete": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_fetch_keys": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_commit": 11, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_split": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_merge": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes": 10, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_top": 0, 2024-09-10T22:19:38.582 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_bottom": 10, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pin_tail": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_pinned": 10, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_expired": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "inodes_with_caps": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "caps": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "subtrees": 1, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_hit": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_forward": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_discover": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_dir_fetch": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_remote_ino": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "traverse_lock": 0, 2024-09-10T22:19:38.583 INFO:teuthology.orchestra.run.smithi189.stdout: "load_cent": 1000, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "q": 1, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "exported": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "exported_inodes": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "imported": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "imported_inodes": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_dir_fetch": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_backtrace_fetch": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "openino_peer_discover": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rfiles": 8, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rbytes": 269505890, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "root_rsnaps": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_fetch": 0, 2024-09-10T22:19:38.584 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_set_tag": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_backtrace_repaired": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_inotable_repaired": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_inodes": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dir_base_inodes": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_dirfrag_rstats": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "scrub_file_inodes": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_inode_file_caps": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_revoke": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_grant": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_trunc": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps": 0, 2024-09-10T22:19:38.585 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_caps_dirty": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_cap_release": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "process_request_cap_release": 0 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_cache": { 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_update_receipt": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_try_discover": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_send_discover": 1, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "dir_handle_discover": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_delayed": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "num_strays_enqueuing": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_created": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_enqueued": 0, 2024-09-10T22:19:38.586 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_reintegrated": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "strays_migrated": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_processing": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_enqueued": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "num_recovering_prioritized": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_started": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "recovery_completed": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_path": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_quiesce_inode": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_enqueue_scrub": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_exportdir": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_flush": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragmentdir": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_fragstats": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "ireq_inodestats": 0, 2024-09-10T22:19:38.587 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_started": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_succeeded": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "uninline_write_failed": 0 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_log": { 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "evlrg": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "evadd": 2, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "evex": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "evtrm": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "ev": 2, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "evexg": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "evexd": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "segadd": 2, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "segex": 0, 2024-09-10T22:19:38.588 INFO:teuthology.orchestra.run.smithi189.stdout: "segtrm": 0, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "seg": 2, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "segmjr": 2, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "segexg": 0, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "segexd": 0, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "expos": 4194304, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "wrpos": 4194892, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "rdpos": 0, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "jlat": { 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 1, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.001461507, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001461507 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: "replayed": 0 2024-09-10T22:19:38.589 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_mem": { 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "ino": 13, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "ino+": 13, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "ino-": 0, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "dir": 11, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "dir+": 12, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "dir-": 1, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "dn": 10, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "dn+": 10, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "dn-": 0, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "cap": 0, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "cap+": 0, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "cap-": 0, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "rss": 48580, 2024-09-10T22:19:38.590 INFO:teuthology.orchestra.run.smithi189.stdout: "heap": 257683456 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_server": { 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_client_request": 0, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "dispatch_server_request": 0, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_request": 0, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_client_session": 0, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "handle_peer_request": 0, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "req_create_latency": { 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getattr_latency": { 2024-09-10T22:19:38.591 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getfilelock_latency": { 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "req_link_latency": { 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookup_latency": { 2024-09-10T22:19:38.592 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookuphash_latency": { 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupino_latency": { 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.593 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupname_latency": { 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupparent_latency": { 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lookupsnap_latency": { 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.594 INFO:teuthology.orchestra.run.smithi189.stdout: "req_lssnap_latency": { 2024-09-10T22:19:38.595 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.595 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.595 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.595 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.595 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mkdir_latency": { 2024-09-10T22:19:38.595 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mknod_latency": { 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "req_mksnap_latency": { 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.596 INFO:teuthology.orchestra.run.smithi189.stdout: "req_open_latency": { 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "req_readdir_latency": { 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rename_latency": { 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.597 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "req_renamesnap_latency": { 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "req_snapdiff_latency": { 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmdir_latency": { 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.598 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmsnap_latency": { 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "req_rmxattr_latency": { 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setattr_latency": { 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.599 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setdirlayout_latency": { 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setfilelock_latency": { 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.600 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setlayout_latency": { 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "req_setxattr_latency": { 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "req_symlink_latency": { 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.601 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "req_unlink_latency": { 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_revoke_eviction": 0, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "cap_acquisition_throttle": 0, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "req_getvxattr_latency": { 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.602 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_sessions": { 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "session_count": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "session_add": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "session_remove": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_open": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "sessions_stale": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "total_load": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "average_load": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "avg_session_uptime": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "mdthresh_evicted": 0 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:38.603 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:38.604 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:38.605 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 229713, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 69, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:38.606 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 7400, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 152, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 51192, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 198, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "objecter": { 2024-09-10T22:19:38.607 INFO:teuthology.orchestra.run.smithi189.stdout: "op_active": 0, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_laggy": 0, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send": 35, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_send_bytes": 10710, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_resend": 28, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_reply": 35, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_latency": { 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 35, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.189996269, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.005428464 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "op_inflight": 0, 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "oplen_avg": { 2024-09-10T22:19:38.608 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 35, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 57 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "op": 35, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "op_r": 0, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "op_w": 35, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "op_rmw": 0, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "op_pg": 0, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_stat": 0, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_create": 10, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_read": 0, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_write": 1, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writefull": 5, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_writesame": 0, 2024-09-10T22:19:38.609 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_append": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_zero": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_truncate": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_delete": 6, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_mapext": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_sparse_read": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_clonerange": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_getxattr": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_setxattr": 20, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_cmpxattr": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_rmxattr": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_resetxattrs": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_call": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_watch": 0, 2024-09-10T22:19:38.610 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_notify": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_src_cmpxattr": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_pgls_filter": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "osdop_other": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_active": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_send": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_resend": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "linger_ping": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_active": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_send": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "poolop_resend": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_active": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_send": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "poolstat_resend": 0, 2024-09-10T22:19:38.611 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_active": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_send": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "statfs_resend": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "command_active": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "command_send": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "command_resend": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "map_epoch": 78, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "map_full": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "map_inc": 2, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_sessions": 8, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_open": 8, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_session_close": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_laggy": 0, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_wr": 14, 2024-09-10T22:19:38.612 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_rd": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_del": 1 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "oft": { 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_objs": 1, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_kv_pairs": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_updates": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "omap_total_removes": 0 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "purge_queue": { 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_ops_high_water": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executing_high_water": 0, 2024-09-10T22:19:38.613 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed_ops": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_executed": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "pq_item_in_journal": 0 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 302, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 535883, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 302, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 302, 2024-09-10T22:19:38.614 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 535883, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_bytes": { 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:38.615 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 35, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 10710, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 35, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 10710, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-objecter_ops": { 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 1024, 2024-09-10T22:19:38.616 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 35, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 35, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 35, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 35, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.617 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle": { 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 0, 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:38.618 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-write_buf_throttle-0x557b2f4a6960": { 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 3758096384, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 2, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 588, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 2, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:38.619 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 1, 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 588, 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "trackedop": { 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: "slow_ops_count": 0 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:38.620 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T22:19:39.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:38 smithi189 ceph-mon[35784]: pgmap v430: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:19:39.223 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:38 smithi052 ceph-mon[34997]: pgmap v430: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:19:39.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:38 smithi005 ceph-mon[31115]: pgmap v430: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-10T22:19:39.398 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-10T22:19:39.399 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-10T22:19:39.399 DEBUG:tasks.check_counter:Getting stats from l 2024-09-10T22:19:39.399 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-10T22:19:39.646 INFO:teuthology.orchestra.run.smithi189.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.c/config 2024-09-10T22:19:40.175 INFO:teuthology.orchestra.run.smithi189.stdout:{ 2024-09-10T22:19:40.175 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-0": { 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 93, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 90, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 488096, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 54112, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 4, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 0, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.017424732, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.007641813, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.013696716, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 89, 2024-09-10T22:19:40.176 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.005839578, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000065613 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 488096, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 54112 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-1": { 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 1, 2024-09-10T22:19:40.177 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 68, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 160, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 92160, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 3, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 2, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.005593985, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.004065494, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.000803125, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 66, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.002650699, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000040162 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:40.178 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 92160 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "AsyncMessenger::Worker-2": { 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_messages": 4, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages": 4, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_bytes": 2944, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_bytes": 448, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_created_connections": 2, 2024-09-10T22:19:40.179 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_active_connections": 1, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_total_time": 0.002286239, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_send_time": 0.000033722, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_recv_time": 0.002240771, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_messages_queue_lat": { 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 3, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.004063507, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.001354502 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_handle_ack_lat": { 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:40.180 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "msgr_send_encrypted_bytes": 448 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "cct": { 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "total_workers": 0, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "unhealthy_workers": 0 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "mempool": { 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_bytes": 0, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "bloom_filter_items": 0, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_bytes": 0, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_alloc_items": 0, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_bytes": 0, 2024-09-10T22:19:40.181 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_data_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_onode_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_meta_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_bytes": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_other_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_cache_buffer_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_bytes": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_extent_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_bytes": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_blob_items": 0, 2024-09-10T22:19:40.182 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_shared_blob_items": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_inline_bl_items": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_bytes": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_fsck_items": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_bytes": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_txc_items": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-10T22:19:40.183 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_deferred_items": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_bytes": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluestore_writing_items": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_bytes": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_items": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_bytes": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_reader_items": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_bytes": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "bluefs_file_writer_items": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_bytes": 148840, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_anon_items": 28, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_bytes": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "buffer_meta_items": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_bytes": 0, 2024-09-10T22:19:40.184 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_bytes": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_mapbl_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_bytes": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osd_pglog_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_bytes": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_bytes": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "osdmap_mapping_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_bytes": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "pgmap_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_bytes": 968, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "mds_co_items": 2, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_bytes": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_1_items": 0, 2024-09-10T22:19:40.185 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_bytes": 0, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "unittest_2_items": 0 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: }, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "val": 0, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "max": 104857600, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "get_started": 0, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "get": 94, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "get_sum": 474975, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_fail": 0, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "get_or_fail_success": 94, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "take": 0, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "take_sum": 0, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "put": 94, 2024-09-10T22:19:40.186 INFO:teuthology.orchestra.run.smithi189.stdout: "put_sum": 474975, 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout: "wait": { 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout: "avgcount": 0, 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout: "sum": 0.000000000, 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout: "avgtime": 0.000000000 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout: } 2024-09-10T22:19:40.187 INFO:teuthology.orchestra.run.smithi189.stdout:} 2024-09-10T22:19:40.918 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-10T22:19:40.918 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-10T22:19:40.918 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T22:19:40.927 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T22:19:40.927 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:19:40.927 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:19:40.951 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-10T22:19:40.951 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T22:19:41.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-10T22:19:41.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:40 smithi189 ceph-mon[35784]: pgmap v431: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:41.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:40 smithi052 ceph-mon[34997]: pgmap v431: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:41.328 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:41.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:40 smithi005 ceph-mon[31115]: pgmap v431: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 -- 172.21.15.5:0/1299168545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 msgr2=0x7f10b410f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 --2- 172.21.15.5:0/1299168545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b410f5a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009ca0 tx=0x7f10ac02a8c0 comp rx=0 tx=0).stop 2024-09-10T22:19:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 -- 172.21.15.5:0/1299168545 shutdown_connections 2024-09-10T22:19:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 --2- 172.21.15.5:0/1299168545 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b410f5a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:41.809 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 --2- 172.21.15.5:0/1299168545 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b4104600 0x7f10b410caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 --2- 172.21.15.5:0/1299168545 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4103ce0 0x7f10b41040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.792+0000 7f10ba776640 1 -- 172.21.15.5:0/1299168545 >> 172.21.15.5:0/1299168545 conn(0x7f10b40fd700 msgr2=0x7f10b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.793+0000 7f10ba776640 1 -- 172.21.15.5:0/1299168545 shutdown_connections 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.793+0000 7f10ba776640 1 -- 172.21.15.5:0/1299168545 wait complete. 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.793+0000 7f10ba776640 1 Processor -- start 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.793+0000 7f10ba776640 1 -- start start 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.793+0000 7f10ba776640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b4103ce0 0x7f10b41993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4104600 0x7f10b41998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b419ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4112e90 con 0x7f10b410d140 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4112d10 con 0x7f10b4104600 2024-09-10T22:19:41.810 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f10b4113010 con 0x7f10b4103ce0 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b419ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b419ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36750/0 (socket says 172.21.15.5:36750) 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 -- 172.21.15.5:0/3117937980 learned_addr learned my addr 172.21.15.5:0/3117937980 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b3fff640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b4103ce0 0x7f10b41993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b37fe640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4104600 0x7f10b41998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 -- 172.21.15.5:0/3117937980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b4103ce0 msgr2=0x7f10b41993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b4103ce0 0x7f10b41993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 -- 172.21.15.5:0/3117937980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4104600 msgr2=0x7f10b41998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4104600 0x7f10b41998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 -- 172.21.15.5:0/3117937980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b419f450 con 0x7f10b410d140 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b37fe640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4104600 0x7f10b41998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b8d13640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b419ec80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005cc0 tx=0x7f10ac02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac003cf0 con 0x7f10b410d140 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10ac0044f0 con 0x7f10b410d140 2024-09-10T22:19:41.811 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b419f6e0 con 0x7f10b410d140 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac02fd10 con 0x7f10b410d140 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.794+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b41a5e80 con 0x7f10b410d140 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.795+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b4104140 con 0x7f10b410d140 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.797+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f10ac004040 con 0x7f10b410d140 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.797+0000 7f10b17fa640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f109c0b52e0 0x7f109c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.798+0000 7f10b3fff640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f109c0b52e0 0x7f109c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.798+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f10ac1072e0 con 0x7f10b410d140 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.798+0000 7f10b3fff640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f109c0b52e0 0x7f109c0b77a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009890 tx=0x7f10a4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:41.812 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.802+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10ac0ce170 con 0x7f10b410d140 2024-09-10T22:19:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.999+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f10b402e5c0 con 0x7f10b410d140 2024-09-10T22:19:42.000 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:41.999+0000 7f10b17fa640 1 -- 172.21.15.5:0/3117937980 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v78) ==== 81+0+580 (secure 0 0 0) 0x7f10ac0cda70 con 0x7f10b410d140 2024-09-10T22:19:42.000 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/907757444 2024-09-11T22:07:33.618373+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/2665728769 2024-09-11T22:07:33.618373+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3915014878 2024-09-11T22:07:33.618373+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/3420450808 2024-09-11T22:07:08.650376+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/907757444 2024-09-11T22:07:33.618373+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6801/3919804850 2024-09-11T22:07:08.650376+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1897492228 2024-09-11T22:07:33.618373+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:6800/3919804850 2024-09-11T22:07:08.650376+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/4269601080 2024-09-11T22:07:08.650376+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5:0/1643809040 2024-09-11T22:07:08.650376+0000 2024-09-10T22:19:42.001 INFO:teuthology.orchestra.run.smithi005.stderr:listed 10 entries 2024-09-10T22:19:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f109c0b52e0 msgr2=0x7f109c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f109c0b52e0 0x7f109c0b77a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009890 tx=0x7f10a4008040 comp rx=0 tx=0).stop 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 msgr2=0x7f10b419ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b419ec80 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005cc0 tx=0x7f10ac02f470 comp rx=0 tx=0).stop 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 shutdown_connections 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f109c0b52e0 0x7f109c0b77a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f10b410d140 0x7f10b419ec80 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f10b4104600 0x7f10b41998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 --2- 172.21.15.5:0/3117937980 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f10b4103ce0 0x7f10b41993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 >> 172.21.15.5:0/3117937980 conn(0x7f10b40fd700 msgr2=0x7f10b40fe360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 shutdown_connections 2024-09-10T22:19:42.003 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:42.001+0000 7f10ba776640 1 -- 172.21.15.5:0/3117937980 wait complete. 2024-09-10T22:19:42.812 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T22:19:42.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:19:42.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T22:19:42.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:19:42.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:19:42.857 DEBUG:teuthology.orchestra.run.smithi005:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T22:19:42.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:19:42.891 DEBUG:teuthology.orchestra.run.smithi005:> ip netns list 2024-09-10T22:19:42.947 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T22:19:42.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:19:42.948 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T22:19:43.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T22:19:43.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo ip link delete ceph-brx 2024-09-10T22:19:43.077 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:42 smithi005 ceph-mon[31115]: pgmap v432: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:19:43.077 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:42 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/3117937980' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:19:43.106 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-10T22:19:43.116 INFO:tasks.cephadm:Teardown begin 2024-09-10T22:19:43.116 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T22:19:43.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:19:43.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:42 smithi189 ceph-mon[35784]: pgmap v432: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:19:43.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:42 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/3117937980' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:19:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:42 smithi052 ceph-mon[34997]: pgmap v432: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-10T22:19:43.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:42 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/3117937980' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-10T22:19:43.406 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 -- 172.21.15.5:0/2626658793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 msgr2=0x7f81c810e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2626658793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c810e860 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009ca0 tx=0x7f81c002a8c0 comp rx=0 tx=0).stop 2024-09-10T22:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 -- 172.21.15.5:0/2626658793 shutdown_connections 2024-09-10T22:19:43.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2626658793 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c810e860 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2626658793 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 0x7f81c8107b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2626658793 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c8101cd0 0x7f81c81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 -- 172.21.15.5:0/2626658793 >> 172.21.15.5:0/2626658793 conn(0x7f81c80fd700 msgr2=0x7f81c80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 -- 172.21.15.5:0/2626658793 shutdown_connections 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.940+0000 7f81ce34d640 1 -- 172.21.15.5:0/2626658793 wait complete. 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 Processor -- start 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 -- start start 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c8101cd0 0x7f81c81981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 0x7f81c81986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c819da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8111ce0 con 0x7f81c8108060 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8111b60 con 0x7f81c81076e0 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81ce34d640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7f81c8111e60 con 0x7f81c8101cd0 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81cc8ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c819da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:43.963 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81cc8ea640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c819da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36906/0 (socket says 172.21.15.5:36906) 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.941+0000 7f81cc8ea640 1 -- 172.21.15.5:0/2678131699 learned_addr learned my addr 172.21.15.5:0/2678131699 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81c77fe640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 0x7f81c81986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81c7fff640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c8101cd0 0x7f81c81981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81cc8ea640 1 -- 172.21.15.5:0/2678131699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c8101cd0 msgr2=0x7f81c81981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81cc8ea640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c8101cd0 0x7f81c81981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81cc8ea640 1 -- 172.21.15.5:0/2678131699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 msgr2=0x7f81c81986f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81cc8ea640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 0x7f81c81986f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81cc8ea640 1 -- 172.21.15.5:0/2678131699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c819e260 con 0x7f81c8108060 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81c77fe640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 0x7f81c81986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81cc8ea640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c819da90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f81c0005cc0 tx=0x7f81c002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c0003bf0 con 0x7f81c8108060 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c819e4f0 con 0x7f81c8108060 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81c0003d90 con 0x7f81c8108060 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c002fbc0 con 0x7f81c8108060 2024-09-10T22:19:43.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.942+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c81a4c10 con 0x7f81c8108060 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.943+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c81020b0 con 0x7f81c8108060 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.945+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7f81c0004610 con 0x7f81c8108060 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.945+0000 7f81c57fa640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f81b00b52e0 0x7f81b00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.946+0000 7f81c7fff640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f81b00b52e0 0x7f81b00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.946+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7f81c0107210 con 0x7f81c8108060 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.946+0000 7f81c7fff640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f81b00b52e0 0x7f81b00b77a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81b800bbe0 tx=0x7f81b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:43.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:43.949+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f81c00ce100 con 0x7f81c8108060 2024-09-10T22:19:44.172 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.171+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81c81992e0 con 0x7f81c8108060 2024-09-10T22:19:44.173 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.172+0000 7f81c57fa640 1 -- 172.21.15.5:0/2678131699 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7f81c81992e0 con 0x7f81c8108060 2024-09-10T22:19:44.173 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:19:44.174 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:19:44.174 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f81b00b52e0 msgr2=0x7f81b00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f81b00b52e0 0x7f81b00b77a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81b800bbe0 tx=0x7f81b800b390 comp rx=0 tx=0).stop 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 msgr2=0x7f81c819da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c819da90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f81c0005cc0 tx=0x7f81c002f380 comp rx=0 tx=0).stop 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 shutdown_connections 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7f81b00b52e0 0x7f81b00b77a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7f81c8108060 0x7f81c819da90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7f81c81076e0 0x7f81c81986f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 --2- 172.21.15.5:0/2678131699 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7f81c8101cd0 0x7f81c81981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.174+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 >> 172.21.15.5:0/2678131699 conn(0x7f81c80fd700 msgr2=0x7f81c80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.175+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 shutdown_connections 2024-09-10T22:19:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:44.175+0000 7f81ce34d640 1 -- 172.21.15.5:0/2678131699 wait complete. 2024-09-10T22:19:44.997 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-10T22:19:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:44 smithi189 ceph-mon[35784]: pgmap v433: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:45.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:44 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2678131699' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:45.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:44 smithi052 ceph-mon[34997]: pgmap v433: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:45.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:44 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2678131699' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:45.264 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:45.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:44 smithi005 ceph-mon[31115]: pgmap v433: 97 pgs: 97 active+clean; 1.2 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-10T22:19:45.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:44 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2678131699' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 -- 172.21.15.5:0/1375212718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 msgr2=0x7fd4f010e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:45.764 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/1375212718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f010e820 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8009ca0 tx=0x7fd4e802a8c0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 -- 172.21.15.5:0/1375212718 shutdown_connections 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/1375212718 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f010e820 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/1375212718 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f01076a0 0x7fd4f0107ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/1375212718 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0101c90 0x7fd4f0102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 -- 172.21.15.5:0/1375212718 >> 172.21.15.5:0/1375212718 conn(0x7fd4f00fd700 msgr2=0x7fd4f00ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 -- 172.21.15.5:0/1375212718 shutdown_connections 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.729+0000 7fd4f49f4640 1 -- 172.21.15.5:0/1375212718 wait complete. 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 Processor -- start 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 -- start start 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0101c90 0x7fd4f0198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f01076a0 0x7fd4f01987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:45.765 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0111d20 con 0x7fd4f0108020 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0111ba0 con 0x7fd4f01076a0 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4f49f4640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0111ea0 con 0x7fd4f0101c90 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4eed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4eed9d640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36926/0 (socket says 172.21.15.5:36926) 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4eed9d640 1 -- 172.21.15.5:0/772850873 learned_addr learned my addr 172.21.15.5:0/772850873 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.730+0000 7fd4ee59c640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0101c90 0x7fd4f0198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4e7fff640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f01076a0 0x7fd4f01987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4eed9d640 1 -- 172.21.15.5:0/772850873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0101c90 msgr2=0x7fd4f0198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4eed9d640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0101c90 0x7fd4f0198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4eed9d640 1 -- 172.21.15.5:0/772850873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f01076a0 msgr2=0x7fd4f01987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4eed9d640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f01076a0 0x7fd4f01987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4eed9d640 1 -- 172.21.15.5:0/772850873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f019e340 con 0x7fd4f0108020 2024-09-10T22:19:45.766 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4eed9d640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f019db70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8005cc0 tx=0x7fd4e802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8003cf0 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f019e5d0 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4e80044f0 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e802fc30 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.731+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f006ab30 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.732+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f01020f0 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.735+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fd4e8004040 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.735+0000 7fd4e77fe640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd4dc0b74f0 0x7fd4dc0b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.735+0000 7fd4ee59c640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd4dc0b74f0 0x7fd4dc0b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.735+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fd4e8107240 con 0x7fd4f0108020 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.736+0000 7fd4ee59c640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd4dc0b74f0 0x7fd4dc0b99b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009990 tx=0x7fd4e0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:45.767 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.738+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd4e80ce1c0 con 0x7fd4f0108020 2024-09-10T22:19:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.960+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4f006b610 con 0x7fd4f0108020 2024-09-10T22:19:45.962 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.961+0000 7fd4e77fe640 1 -- 172.21.15.5:0/772850873 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11896 (secure 0 0 0) 0x7fd4e80cdac0 con 0x7fd4f0108020 2024-09-10T22:19:45.962 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:19:45.962 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":25,"btime":"2024-09-10T22:16:51:792938+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14682,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6835/1828396706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6834","nonce":1828396706},{"type":"v1","addr":"172.21.15.5:6835","nonce":1828396706}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14694,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6837/2877300563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6836","nonce":2877300563},{"type":"v1","addr":"172.21.15.5:6837","nonce":2877300563}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14736,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6839/738059047","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6838","nonce":738059047},{"type":"v1","addr":"172.21.15.5:6839","nonce":738059047}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14748,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.5:6841/4233870863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6840","nonce":4233870863},{"type":"v1","addr":"172.21.15.5:6841","nonce":4233870863}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24508,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.189:6833/1255852386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6832","nonce":1255852386},{"type":"v1","addr":"172.21.15.189:6833","nonce":1255852386}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24518,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6833/3402874625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6832","nonce":3402874625},{"type":"v1","addr":"172.21.15.52:6833","nonce":3402874625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-10T22:15:03.043229+0000","modified":"2024-09-10T22:16:51.146739+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24563,"mds_2":24562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24536":{"gid":24536,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.52:6835/4020193542","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6834","nonce":4020193542},{"type":"v1","addr":"172.21.15.52:6835","nonce":4020193542}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24538":{"gid":24538,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6835/1432375899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6834","nonce":1432375899},{"type":"v1","addr":"172.21.15.189:6835","nonce":1432375899}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24544":{"gid":24544,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.189:6837/2390982285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6836","nonce":2390982285},{"type":"v1","addr":"172.21.15.189:6837","nonce":2390982285}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24562":{"gid":24562,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.189:6839/3637381557","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6838","nonce":3637381557},{"type":"v1","addr":"172.21.15.189:6839","nonce":3637381557}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24563":{"gid":24563,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":9,"addr":"172.21.15.52:6837/992786234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6836","nonce":992786234},{"type":"v1","addr":"172.21.15.52:6837","nonce":992786234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.52:6839/3172231401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6838","nonce":3172231401},{"type":"v1","addr":"172.21.15.52:6839","nonce":3172231401}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24578,"qdb_cluster":[24578,24563,24562]},"id":1}]} 2024-09-10T22:19:45.963 INFO:teuthology.orchestra.run.smithi005.stderr:dumped fsmap epoch 25 2024-09-10T22:19:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd4dc0b74f0 msgr2=0x7fd4dc0b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:45.964 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd4dc0b74f0 0x7fd4dc0b99b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009990 tx=0x7fd4e0009110 comp rx=0 tx=0).stop 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 msgr2=0x7fd4f019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f019db70 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8005cc0 tx=0x7fd4e802f470 comp rx=0 tx=0).stop 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 shutdown_connections 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fd4dc0b74f0 0x7fd4dc0b99b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fd4f0108020 0x7fd4f019db70 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fd4f01076a0 0x7fd4f01987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 --2- 172.21.15.5:0/772850873 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fd4f0101c90 0x7fd4f0198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 >> 172.21.15.5:0/772850873 conn(0x7fd4f00fd700 msgr2=0x7fd4f00ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 shutdown_connections 2024-09-10T22:19:45.965 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:45.963+0000 7fd4f49f4640 1 -- 172.21.15.5:0/772850873 wait complete. 2024-09-10T22:19:46.760 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-10T22:19:47.017 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:47.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:46 smithi005 ceph-mon[31115]: pgmap v434: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:19:47.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:46 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/772850873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:47.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:46 smithi189 ceph-mon[35784]: pgmap v434: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:19:47.194 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:46 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/772850873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:47.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:46 smithi052 ceph-mon[34997]: pgmap v434: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-10T22:19:47.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:46 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/772850873' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-10T22:19:47.486 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 -- 172.21.15.5:0/429224904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec181076e0 msgr2=0x7fec18107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 --2- 172.21.15.5:0/429224904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec181076e0 0x7fec18107b20 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fec08009900 tx=0x7fec0802a410 comp rx=0 tx=0).stop 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 -- 172.21.15.5:0/429224904 shutdown_connections 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 --2- 172.21.15.5:0/429224904 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec18108060 0x7fec1810e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 --2- 172.21.15.5:0/429224904 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec181076e0 0x7fec18107b20 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 --2- 172.21.15.5:0/429224904 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec18101cd0 0x7fec181020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.463+0000 7fec20241640 1 -- 172.21.15.5:0/429224904 >> 172.21.15.5:0/429224904 conn(0x7fec180fd700 msgr2=0x7fec180ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.464+0000 7fec20241640 1 -- 172.21.15.5:0/429224904 shutdown_connections 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.464+0000 7fec20241640 1 -- 172.21.15.5:0/429224904 wait complete. 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.464+0000 7fec20241640 1 Processor -- start 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 -- start start 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 0x7fec18199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec181076e0 0x7fec18199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec18108060 0x7fec1819ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:47.487 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fec1806ba60 con 0x7fec18101cd0 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fec1806b8e0 con 0x7fec181076e0 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec20241640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fec1806bbe0 con 0x7fec18108060 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 0x7fec18199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 0x7fec18199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36944/0 (socket says 172.21.15.5:36944) 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 -- 172.21.15.5:0/124947092 learned_addr learned my addr 172.21.15.5:0/124947092 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1d7dc640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec181076e0 0x7fec18199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1e7de640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec18108060 0x7fec1819ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 -- 172.21.15.5:0/124947092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec18108060 msgr2=0x7fec1819ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec18108060 0x7fec1819ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 -- 172.21.15.5:0/124947092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec181076e0 msgr2=0x7fec18199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec181076e0 0x7fec18199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.465+0000 7fec1dfdd640 1 -- 172.21.15.5:0/124947092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1819f3e0 con 0x7fec18101cd0 2024-09-10T22:19:47.488 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.466+0000 7fec1dfdd640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 0x7fec18199330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec1400b4a0 tx=0x7fec1400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.466+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14014070 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.466+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec14010ac0 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.466+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1819f6d0 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.466+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec14017c30 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.466+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec181a5e10 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.467+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec181020b0 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.468+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fec14010610 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.469+0000 7fec0effd640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec040b5360 0x7fec040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.469+0000 7fec1d7dc640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec040b5360 0x7fec040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.469+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fec140e4ff0 con 0x7fec18101cd0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.470+0000 7fec1d7dc640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec040b5360 0x7fec040b7820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec08005ab0 tx=0x7fec08005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:47.489 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.472+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fec140ab890 con 0x7fec18101cd0 2024-09-10T22:19:47.661 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.660+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec181a61a0 con 0x7fec18101cd0 2024-09-10T22:19:47.663 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.662+0000 7fec0effd640 1 -- 172.21.15.5:0/124947092 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+22583 (secure 0 0 0) 0x7fec140b02c0 con 0x7fec18101cd0 2024-09-10T22:19:47.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-10T22:19:47.663 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":78,"fsid":"ca2ddb2e-6fc0-11ef-bcea-c7b262605968","created":"2024-09-10T22:06:46.142379+0000","modified":"2024-09-10T22:15:35.469355+0000","last_up_change":"2024-09-10T22:14:10.386655+0000","last_in_change":"2024-09-10T22:13:46.736124+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T22:10:20.089426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T22:14:58.643913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T22:15:00.986202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0222d8dd-610f-4eea-9c9f-2beea3a602b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6803","nonce":3696075683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6805","nonce":3696075683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6809","nonce":3696075683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3696075683},{"type":"v1","addr":"172.21.15.5:6807","nonce":3696075683}]},"public_addr":"172.21.15.5:6803/3696075683","cluster_addr":"172.21.15.5:6805/3696075683","heartbeat_back_addr":"172.21.15.5:6809/3696075683","heartbeat_front_addr":"172.21.15.5:6807/3696075683","state":["exists","up"]},{"osd":1,"uuid":"5a473b05-b36a-4011-91d0-e93a9190a8b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6801","nonce":1933409756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6803","nonce":1933409756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6806","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6807","nonce":1933409756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6804","nonce":1933409756},{"type":"v1","addr":"172.21.15.52:6805","nonce":1933409756}]},"public_addr":"172.21.15.52:6801/1933409756","cluster_addr":"172.21.15.52:6803/1933409756","heartbeat_back_addr":"172.21.15.52:6807/1933409756","heartbeat_front_addr":"172.21.15.52:6805/1933409756","state":["exists","up"]},{"osd":2,"uuid":"025f8eb8-11e9-4f44-a07e-bc09e476780d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6800","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6801","nonce":3820297552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6802","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6803","nonce":3820297552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6806","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6807","nonce":3820297552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6804","nonce":3820297552},{"type":"v1","addr":"172.21.15.189:6805","nonce":3820297552}]},"public_addr":"172.21.15.189:6801/3820297552","cluster_addr":"172.21.15.189:6803/3820297552","heartbeat_back_addr":"172.21.15.189:6807/3820297552","heartbeat_front_addr":"172.21.15.189:6805/3820297552","state":["exists","up"]},{"osd":3,"uuid":"d2de667c-2627-47c7-a890-837a819b62ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6811","nonce":2032049707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6813","nonce":2032049707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6817","nonce":2032049707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2032049707},{"type":"v1","addr":"172.21.15.5:6815","nonce":2032049707}]},"public_addr":"172.21.15.5:6811/2032049707","cluster_addr":"172.21.15.5:6813/2032049707","heartbeat_back_addr":"172.21.15.5:6817/2032049707","heartbeat_front_addr":"172.21.15.5:6815/2032049707","state":["exists","up"]},{"osd":4,"uuid":"adfeb2e3-b099-4406-8934-6cc24e759c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6808","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6809","nonce":2372406744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6810","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6811","nonce":2372406744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6814","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6815","nonce":2372406744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6812","nonce":2372406744},{"type":"v1","addr":"172.21.15.52:6813","nonce":2372406744}]},"public_addr":"172.21.15.52:6809/2372406744","cluster_addr":"172.21.15.52:6811/2372406744","heartbeat_back_addr":"172.21.15.52:6815/2372406744","heartbeat_front_addr":"172.21.15.52:6813/2372406744","state":["exists","up"]},{"osd":5,"uuid":"496d4b82-cf16-4c60-98d4-904b66a06fe9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6808","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6809","nonce":3637282250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6810","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6811","nonce":3637282250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6814","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6815","nonce":3637282250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6812","nonce":3637282250},{"type":"v1","addr":"172.21.15.189:6813","nonce":3637282250}]},"public_addr":"172.21.15.189:6809/3637282250","cluster_addr":"172.21.15.189:6811/3637282250","heartbeat_back_addr":"172.21.15.189:6815/3637282250","heartbeat_front_addr":"172.21.15.189:6813/3637282250","state":["exists","up"]},{"osd":6,"uuid":"c454304c-d9fb-4962-b760-e10c257f6ea1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6819","nonce":785003891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6821","nonce":785003891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6825","nonce":785003891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":785003891},{"type":"v1","addr":"172.21.15.5:6823","nonce":785003891}]},"public_addr":"172.21.15.5:6819/785003891","cluster_addr":"172.21.15.5:6821/785003891","heartbeat_back_addr":"172.21.15.5:6825/785003891","heartbeat_front_addr":"172.21.15.5:6823/785003891","state":["exists","up"]},{"osd":7,"uuid":"d9f735c7-7b27-48ab-89e3-57076f0b2ee0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6816","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6817","nonce":3246361291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6818","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6819","nonce":3246361291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6822","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6823","nonce":3246361291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6820","nonce":3246361291},{"type":"v1","addr":"172.21.15.52:6821","nonce":3246361291}]},"public_addr":"172.21.15.52:6817/3246361291","cluster_addr":"172.21.15.52:6819/3246361291","heartbeat_back_addr":"172.21.15.52:6823/3246361291","heartbeat_front_addr":"172.21.15.52:6821/3246361291","state":["exists","up"]},{"osd":8,"uuid":"3bf416f0-d03c-486d-98ff-7a40d2920d99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6816","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6817","nonce":2630630352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6818","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6819","nonce":2630630352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6822","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6823","nonce":2630630352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6820","nonce":2630630352},{"type":"v1","addr":"172.21.15.189:6821","nonce":2630630352}]},"public_addr":"172.21.15.189:6817/2630630352","cluster_addr":"172.21.15.189:6819/2630630352","heartbeat_back_addr":"172.21.15.189:6823/2630630352","heartbeat_front_addr":"172.21.15.189:6821/2630630352","state":["exists","up"]},{"osd":9,"uuid":"d9abfd78-d3e7-4506-8c2d-5c5050fd2913","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6827","nonce":416812838}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6829","nonce":416812838}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6833","nonce":416812838}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":416812838},{"type":"v1","addr":"172.21.15.5:6831","nonce":416812838}]},"public_addr":"172.21.15.5:6827/416812838","cluster_addr":"172.21.15.5:6829/416812838","heartbeat_back_addr":"172.21.15.5:6833/416812838","heartbeat_front_addr":"172.21.15.5:6831/416812838","state":["exists","up"]},{"osd":10,"uuid":"cd4c7c17-9bb8-4f3c-951f-3482e24c16fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6824","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6825","nonce":1898218403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6826","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6827","nonce":1898218403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6830","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6831","nonce":1898218403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6828","nonce":1898218403},{"type":"v1","addr":"172.21.15.52:6829","nonce":1898218403}]},"public_addr":"172.21.15.52:6825/1898218403","cluster_addr":"172.21.15.52:6827/1898218403","heartbeat_back_addr":"172.21.15.52:6831/1898218403","heartbeat_front_addr":"172.21.15.52:6829/1898218403","state":["exists","up"]},{"osd":11,"uuid":"91aae414-bd19-4b39-a93f-d4705df0a491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6824","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6825","nonce":4080775547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6826","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6827","nonce":4080775547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6830","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6831","nonce":4080775547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.189:6828","nonce":4080775547},{"type":"v1","addr":"172.21.15.189:6829","nonce":4080775547}]},"public_addr":"172.21.15.189:6825/4080775547","cluster_addr":"172.21.15.189:6827/4080775547","heartbeat_back_addr":"172.21.15.189:6831/4080775547","heartbeat_front_addr":"172.21.15.189:6829/4080775547","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:27.140104+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:09:53.319200+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:16.481112+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:10:42.732517+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:08.808341+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:34.065006+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:11:59.893773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:25.227662+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:12:50.695762+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:16.418049+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:13:42.775931+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T22:14:08.175410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.5:6800/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/2665728769":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3915014878":"2024-09-11T22:07:33.618373+0000","172.21.15.5:0/3420450808":"2024-09-11T22:07:08.650376+0000","172.21.15.5:6801/907757444":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6801/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1897492228":"2024-09-11T22:07:33.618373+0000","172.21.15.5:6800/3919804850":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/4269601080":"2024-09-11T22:07:08.650376+0000","172.21.15.5:0/1643809040":"2024-09-11T22:07:08.650376+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T22:19:47.665 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec040b5360 msgr2=0x7fec040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec040b5360 0x7fec040b7820 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec08005ab0 tx=0x7fec08005a20 comp rx=0 tx=0).stop 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 msgr2=0x7fec18199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 0x7fec18199330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fec1400b4a0 tx=0x7fec1400b960 comp rx=0 tx=0).stop 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 shutdown_connections 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fec040b5360 0x7fec040b7820 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fec18108060 0x7fec1819ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fec181076e0 0x7fec18199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 --2- 172.21.15.5:0/124947092 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fec18101cd0 0x7fec18199330 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 >> 172.21.15.5:0/124947092 conn(0x7fec180fd700 msgr2=0x7fec181054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 shutdown_connections 2024-09-10T22:19:47.666 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:47.664+0000 7fec20241640 1 -- 172.21.15.5:0/124947092 wait complete. 2024-09-10T22:19:48.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:47 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/124947092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:19:48.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:47 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/124947092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:19:48.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:47 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/124947092' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-10T22:19:48.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-10T22:19:48.741 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:49.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:48 smithi005 ceph-mon[31115]: pgmap v435: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:19:49.193 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:48 smithi189 ceph-mon[35784]: pgmap v435: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:19:49.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:48 smithi052 ceph-mon[34997]: pgmap v435: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-10T22:19:49.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 -- 172.21.15.5:0/3778327159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 msgr2=0x7fb120107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:49.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 --2- 172.21.15.5:0/3778327159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120107b20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb110009900 tx=0x7fb11002a3f0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 -- 172.21.15.5:0/3778327159 shutdown_connections 2024-09-10T22:19:49.260 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 --2- 172.21.15.5:0/3778327159 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb120108060 0x7fb12010e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 --2- 172.21.15.5:0/3778327159 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120107b20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 --2- 172.21.15.5:0/3778327159 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb120101cd0 0x7fb1201020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 -- 172.21.15.5:0/3778327159 >> 172.21.15.5:0/3778327159 conn(0x7fb1200fd700 msgr2=0x7fb1200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 -- 172.21.15.5:0/3778327159 shutdown_connections 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.233+0000 7fb1282a1640 1 -- 172.21.15.5:0/3778327159 wait complete. 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 Processor -- start 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 -- start start 2024-09-10T22:19:49.261 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb120101cd0 0x7fb120199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb120108060 0x7fb12019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fb120112e00 con 0x7fb1201076e0 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fb120112c80 con 0x7fb120101cd0 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb1282a1640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fb120112f80 con 0x7fb120108060 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb12583c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb12583c640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36964/0 (socket says 172.21.15.5:36964) 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb12583c640 1 -- 172.21.15.5:0/33337637 learned_addr learned my addr 172.21.15.5:0/33337637 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb12603d640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb120101cd0 0x7fb120199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb12683e640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb120108060 0x7fb12019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.234+0000 7fb12583c640 1 -- 172.21.15.5:0/33337637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb120108060 msgr2=0x7fb12019eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:49.262 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb12583c640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb120108060 0x7fb12019eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb12583c640 1 -- 172.21.15.5:0/33337637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb120101cd0 msgr2=0x7fb120199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb12583c640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb120101cd0 0x7fb120199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb12583c640 1 -- 172.21.15.5:0/33337637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12019f2e0 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb12583c640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120199770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb110006010 tx=0x7fb1100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11003f030 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb110003800 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12019f570 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110035070 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.235+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1201a5c90 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.236+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1201020b0 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.237+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fb110003cb0 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.238+0000 7fb1177fe640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb10c0b52e0 0x7fb10c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.238+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8182+0+0 (secure 0 0 0) 0x7fb1101064e0 con 0x7fb1201076e0 2024-09-10T22:19:49.263 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.238+0000 7fb12603d640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb10c0b52e0 0x7fb10c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:49.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.239+0000 7fb12603d640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb10c0b52e0 0x7fb10c0b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00abe0 tx=0x7fb11c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:49.264 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.242+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb1100cd3d0 con 0x7fb1201076e0 2024-09-10T22:19:49.468 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.466+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb1201a5ef0 con 0x7fb1201076e0 2024-09-10T22:19:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.469+0000 7fb1177fe640 1 -- 172.21.15.5:0/33337637 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7fb1100cccd0 con 0x7fb1201076e0 2024-09-10T22:19:49.470 INFO:teuthology.orchestra.run.smithi005.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb10c0b52e0 msgr2=0x7fb10c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb10c0b52e0 0x7fb10c0b77a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00abe0 tx=0x7fb11c00a2d0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 msgr2=0x7fb120199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120199770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb110006010 tx=0x7fb1100042f0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 shutdown_connections 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fb10c0b52e0 0x7fb10c0b77a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fb120108060 0x7fb12019eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fb1201076e0 0x7fb120199770 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.473 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 --2- 172.21.15.5:0/33337637 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fb120101cd0 0x7fb120199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:49.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 >> 172.21.15.5:0/33337637 conn(0x7fb1200fd700 msgr2=0x7fb1200ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:49.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 shutdown_connections 2024-09-10T22:19:49.474 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:49.472+0000 7fb1282a1640 1 -- 172.21.15.5:0/33337637 wait complete. 2024-09-10T22:19:49.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a[31111]: 2024-09-10T22:19:49.467+0000 7f40b3e98640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:19:49.905 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f[65144]: ignoring --setuser ceph since I am not root 2024-09-10T22:19:49.905 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f[65144]: ignoring --setgroup ceph since I am not root 2024-09-10T22:19:49.905 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mds[65148]: -- 172.21.15.189:0/306760088 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55e7312d8ea0 con 0x55e7312ad400 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mds[65148]: -- 172.21.15.189:0/306760088 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7312cf860 con 0x55e7312ad400 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f[65144]: starting mds.f at 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c[65446]: ignoring --setuser ceph since I am not root 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c[65446]: ignoring --setgroup ceph since I am not root 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mds[65450]: -- 172.21.15.189:0/3527540494 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b970b9860 con 0x558b97097400 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c[65446]: starting mds.c at 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i[65748]: ignoring --setuser ceph since I am not root 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i[65748]: ignoring --setgroup ceph since I am not root 2024-09-10T22:19:49.906 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mds[65752]: -- 172.21.15.189:0/3880805727 <== mon.1 v2:172.21.15.189:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ebb8f4d860 con 0x55ebb8f2b400 2024-09-10T22:19:49.907 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i[65748]: starting mds.i at 2024-09-10T22:19:49.907 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: ignoring --setuser ceph since I am not root 2024-09-10T22:19:49.907 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: ignoring --setgroup ceph since I am not root 2024-09-10T22:19:49.907 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mds[65148]: -- 172.21.15.52:0/2388150303 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557c4d7ed860 con 0x557c4d7ca800 2024-09-10T22:19:49.907 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: starting mds.b at 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e[64539]: ignoring --setuser ceph since I am not root 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e[64539]: ignoring --setgroup ceph since I am not root 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mds[64543]: -- 172.21.15.52:0/568526382 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b6377fc20 con 0x555b6375c800 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e[64539]: starting mds.e at 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h[64841]: ignoring --setuser ceph since I am not root 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h[64841]: ignoring --setgroup ceph since I am not root 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mds[64845]: -- 172.21.15.52:0/3141696928 <== mon.2 v2:172.21.15.52:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e3bf4f9c20 con 0x55e3bf4d6800 2024-09-10T22:19:49.908 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h[64841]: starting mds.h at 2024-09-10T22:19:50.196 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/33337637' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:19:50.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mon[35784]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:19:50.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mon[35784]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:19:50.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/33337637' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:19:50.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mon[35784]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T22:19:50.197 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:49 smithi189 ceph-mon[35784]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T22:19:50.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/33337637' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:19:50.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mon[34997]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:19:50.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mon[34997]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:19:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/33337637' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:19:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mon[34997]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T22:19:50.250 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:49 smithi052 ceph-mon[34997]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T22:19:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/33337637' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-10T22:19:50.332 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-mon[31115]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-10T22:19:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-mon[31115]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T22:19:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/33337637' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-10T22:19:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-mon[31115]: osdmap e79: 12 total, 12 up, 12 in 2024-09-10T22:19:50.333 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:49 smithi005 ceph-mon[31115]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-10T22:19:50.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T22:19:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:51.089 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 -- 172.21.15.5:0/364045680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e41087d0 msgr2=0x7fc0e4108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 --2- 172.21.15.5:0/364045680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e41087d0 0x7fc0e4108c10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009900 tx=0x7fc0d802a410 comp rx=0 tx=0).stop 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 -- 172.21.15.5:0/364045680 shutdown_connections 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 --2- 172.21.15.5:0/364045680 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4109150 0x7fc0e410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 --2- 172.21.15.5:0/364045680 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e41087d0 0x7fc0e4108c10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 --2- 172.21.15.5:0/364045680 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4102dc0 0x7fc0e41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 -- 172.21.15.5:0/364045680 >> 172.21.15.5:0/364045680 conn(0x7fc0e40fe870 msgr2=0x7fc0e4100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 -- 172.21.15.5:0/364045680 shutdown_connections 2024-09-10T22:19:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.088+0000 7fc0ea498640 1 -- 172.21.15.5:0/364045680 wait complete. 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 Processor -- start 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 -- start start 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4102dc0 0x7fc0e4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e41087d0 0x7fc0e4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 0x7fc0e419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4112dd0 con 0x7fc0e4109150 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4112c50 con 0x7fc0e4102dc0 2024-09-10T22:19:51.092 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0ea498640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4112f50 con 0x7fc0e41087d0 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0e8a35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 0x7fc0e419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0e8a35640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 0x7fc0e419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:36988/0 (socket says 172.21.15.5:36988) 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0e8a35640 1 -- 172.21.15.5:0/1869766338 learned_addr learned my addr 172.21.15.5:0/1869766338 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.089+0000 7fc0e3fff640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4102dc0 0x7fc0e4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e37fe640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e41087d0 0x7fc0e4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e8a35640 1 -- 172.21.15.5:0/1869766338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e41087d0 msgr2=0x7fc0e4199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e8a35640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e41087d0 0x7fc0e4199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e8a35640 1 -- 172.21.15.5:0/1869766338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4102dc0 msgr2=0x7fc0e4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e8a35640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4102dc0 0x7fc0e4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e8a35640 1 -- 172.21.15.5:0/1869766338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e419f2f0 con 0x7fc0e4109150 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e37fe640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e41087d0 0x7fc0e4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e8a35640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 0x7fc0e419eb20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00eb10 tx=0x7fc0dc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:51.093 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc004b20 con 0x7fc0e4109150 2024-09-10T22:19:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0dc004cc0 con 0x7fc0e4109150 2024-09-10T22:19:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e419f5e0 con 0x7fc0e4109150 2024-09-10T22:19:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc010670 con 0x7fc0e4109150 2024-09-10T22:19:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.090+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e41a5ca0 con 0x7fc0e4109150 2024-09-10T22:19:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.091+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e41031a0 con 0x7fc0e4109150 2024-09-10T22:19:51.094 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.093+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc0dc005000 con 0x7fc0e4109150 2024-09-10T22:19:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.094+0000 7fc0e17fa640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0cc0b52e0 0x7fc0cc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.094+0000 7fc0e3fff640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0cc0b52e0 0x7fc0cc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.094+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8440+0+0 (secure 0 0 0) 0x7fc0dc0e64c0 con 0x7fc0e4109150 2024-09-10T22:19:51.095 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.094+0000 7fc0e3fff640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0cc0b52e0 0x7fc0cc0b77a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4005d00 tx=0x7fc0d400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:51.097 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.097+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0dc056220 con 0x7fc0e4109150 2024-09-10T22:19:51.319 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.317+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc0e402e5c0 con 0x7fc0e4109150 2024-09-10T22:19:51.477 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.476+0000 7fc0e17fa640 1 -- 172.21.15.5:0/1869766338 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fc0dc0ad250 con 0x7fc0e4109150 2024-09-10T22:19:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0cc0b52e0 msgr2=0x7fc0cc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0cc0b52e0 0x7fc0cc0b77a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4005d00 tx=0x7fc0d400b410 comp rx=0 tx=0).stop 2024-09-10T22:19:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 msgr2=0x7fc0e419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 0x7fc0e419eb20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00eb10 tx=0x7fc0dc00c2d0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.480 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 shutdown_connections 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0cc0b52e0 0x7fc0cc0b77a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4109150 0x7fc0e419eb20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e41087d0 0x7fc0e4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 --2- 172.21.15.5:0/1869766338 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4102dc0 0x7fc0e4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 >> 172.21.15.5:0/1869766338 conn(0x7fc0e40fe870 msgr2=0x7fc0e4100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 shutdown_connections 2024-09-10T22:19:51.481 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:51.479+0000 7fc0ea498640 1 -- 172.21.15.5:0/1869766338 wait complete. 2024-09-10T22:19:51.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: pgmap v437: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6834/3467862457,v1:172.21.15.52:6835/3467862457] up:boot 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6834/803612922,v1:172.21.15.189:6837/803612922] up:boot 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6836/457925404,v1:172.21.15.189:6839/457925404] up:boot 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.189:6835/1511278455,v1:172.21.15.189:6838/1511278455] up:boot 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6837/925352752,v1:172.21.15.52:6839/925352752] up:boot 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: mds.? [v2:172.21.15.52:6836/3154679315,v1:172.21.15.52:6838/3154679315] up:boot 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:19:51.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:19:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:19:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:19:51.751 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:51 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1869766338' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: pgmap v437: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T22:19:51.757 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6834/3467862457,v1:172.21.15.52:6835/3467862457] up:boot 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6834/803612922,v1:172.21.15.189:6837/803612922] up:boot 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6836/457925404,v1:172.21.15.189:6839/457925404] up:boot 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.189:6835/1511278455,v1:172.21.15.189:6838/1511278455] up:boot 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6837/925352752,v1:172.21.15.52:6839/925352752] up:boot 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: mds.? [v2:172.21.15.52:6836/3154679315,v1:172.21.15.52:6838/3154679315] up:boot 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:19:51.758 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:51 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1869766338' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: pgmap v437: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T22:19:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6834/3467862457,v1:172.21.15.52:6835/3467862457] up:boot 2024-09-10T22:19:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6834/803612922,v1:172.21.15.189:6837/803612922] up:boot 2024-09-10T22:19:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6836/457925404,v1:172.21.15.189:6839/457925404] up:boot 2024-09-10T22:19:51.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.189:6835/1511278455,v1:172.21.15.189:6838/1511278455] up:boot 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6837/925352752,v1:172.21.15.52:6839/925352752] up:boot 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: mds.? [v2:172.21.15.52:6836/3154679315,v1:172.21.15.52:6838/3154679315] up:boot 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='mgr.14150 172.21.15.5:0/812599231' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-10T22:19:51.944 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:51 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1869766338' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-10T22:19:52.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T22:19:52.436 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:52.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:52 smithi052 ceph-mon[34997]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:19:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:52 smithi052 ceph-mon[34997]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:19:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:52 smithi052 ceph-mon[34997]: Cluster is now healthy 2024-09-10T22:19:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:52 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1869766338' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:52.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:52 smithi052 ceph-mon[34997]: fsmap 12 up:standby 2024-09-10T22:19:52.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:52 smithi005 ceph-mon[31115]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:19:52.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:52 smithi005 ceph-mon[31115]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:19:52.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:52 smithi005 ceph-mon[31115]: Cluster is now healthy 2024-09-10T22:19:52.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:52 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1869766338' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:52.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:52 smithi005 ceph-mon[31115]: fsmap 12 up:standby 2024-09-10T22:19:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/835204126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4102190 msgr2=0x7fc0e410eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/835204126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4102190 0x7fc0e410eee0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009900 tx=0x7fc0d402a480 comp rx=0 tx=0).stop 2024-09-10T22:19:52.922 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/835204126 shutdown_connections 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/835204126 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e410f420 0x7fc0e4111810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/835204126 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e4102190 0x7fc0e410eee0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/835204126 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e4101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/835204126 >> 172.21.15.5:0/835204126 conn(0x7fc0e40fd720 msgr2=0x7fc0e40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/835204126 shutdown_connections 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/835204126 wait complete. 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 Processor -- start 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.899+0000 7fc0ebb0e640 1 -- start start 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ebb0e640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ebb0e640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4102190 0x7fc0e419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ebb0e640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e410f420 0x7fc0e41a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:52.923 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ebb0e640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4114f80 con 0x7fc0e410f420 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ebb0e640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4114e00 con 0x7fc0e4101870 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ebb0e640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e4115100 con 0x7fc0e4102190 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ea0ab640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e410f420 0x7fc0e41a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.52:3300/0 says I am v2:172.21.15.5:33372/0 (socket says 172.21.15.5:33372) 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 -- 172.21.15.5:0/1985140826 learned_addr learned my addr 172.21.15.5:0/1985140826 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e90a9640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4102190 0x7fc0e419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 -- 172.21.15.5:0/1985140826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4102190 msgr2=0x7fc0e419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4102190 0x7fc0e419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 -- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e410f420 msgr2=0x7fc0e41a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e410f420 0x7fc0e41a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 -- 172.21.15.5:0/1985140826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e41a15a0 con 0x7fc0e4101870 2024-09-10T22:19:52.924 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0ea0ab640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e410f420 0x7fc0e41a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e90a9640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4102190 0x7fc0e419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0e98aa640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e419b4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000e9f0 tx=0x7fc0e000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.900+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e000cd80 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.901+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e41a1890 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.901+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0e00108e0 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.901+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0018980 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.901+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e41a7f50 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.901+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e4101c50 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.903+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7fc0e0010430 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.904+0000 7fc0daffd640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0d00b52e0 0x7fc0d00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.904+0000 7fc0e90a9640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0d00b52e0 0x7fc0d00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.904+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8440+0+0 (secure 0 0 0) 0x7fc0e00e65e0 con 0x7fc0e4101870 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.904+0000 7fc0e90a9640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0d00b52e0 0x7fc0d00b77a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4031440 tx=0x7fc0d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:52.925 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:52.907+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc0e00ad370 con 0x7fc0e4101870 2024-09-10T22:19:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:52 smithi189 ceph-mon[35784]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-10T22:19:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:52 smithi189 ceph-mon[35784]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-10T22:19:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:52 smithi189 ceph-mon[35784]: Cluster is now healthy 2024-09-10T22:19:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:52 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1869766338' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-10T22:19:52.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:52 smithi189 ceph-mon[35784]: fsmap 12 up:standby 2024-09-10T22:19:53.098 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.097+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc0e402e5c0 con 0x7fc0e4101870 2024-09-10T22:19:53.495 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.494+0000 7fc0daffd640 1 -- 172.21.15.5:0/1985140826 <== mon.2 v2:172.21.15.52:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) ==== 181+0+0 (secure 0 0 0) 0x7fc0e00acc70 con 0x7fc0e4101870 2024-09-10T22:19:53.495 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_metadata' removed 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0d00b52e0 msgr2=0x7fc0d00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0d00b52e0 0x7fc0d00b77a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4031440 tx=0x7fc0d4005a20 comp rx=0 tx=0).stop 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 msgr2=0x7fc0e419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e419b4f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc0e000e9f0 tx=0x7fc0e000eeb0 comp rx=0 tx=0).stop 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 shutdown_connections 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7fc0d00b52e0 0x7fc0d00b77a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fc0e410f420 0x7fc0e41a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7fc0e4102190 0x7fc0e419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:53.498 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 --2- 172.21.15.5:0/1985140826 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7fc0e4101870 0x7fc0e419b4f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:53.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 >> 172.21.15.5:0/1985140826 conn(0x7fc0e40fd720 msgr2=0x7fc0e4110780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:53.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 shutdown_connections 2024-09-10T22:19:53.499 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:53.497+0000 7fc0ebb0e640 1 -- 172.21.15.5:0/1985140826 wait complete. 2024-09-10T22:19:53.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:53 smithi052 ceph-mon[34997]: pgmap v438: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T22:19:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:53 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/1985140826' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:53.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:53 smithi052 ceph-mon[34997]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:53.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:53 smithi005 ceph-mon[31115]: pgmap v438: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T22:19:53.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:53 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/1985140826' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:53.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:53 smithi005 ceph-mon[31115]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:53.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:53 smithi189 ceph-mon[35784]: pgmap v438: 97 pgs: 97 active+clean; 1.2 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 307 B/s wr, 6 op/s 2024-09-10T22:19:53.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:53 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/1985140826' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:53.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:53 smithi189 ceph-mon[35784]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:54.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T22:19:54.459 INFO:teuthology.orchestra.run.smithi005.stderr:Inferring config /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/mon.a/config 2024-09-10T22:19:54.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:54 smithi052 ceph-mon[34997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:19:54.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:54 smithi052 ceph-mon[34997]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T22:19:54.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:54 smithi005 ceph-mon[31115]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:19:54.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:54 smithi005 ceph-mon[31115]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T22:19:54.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:54 smithi189 ceph-mon[35784]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:19:54.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:54 smithi189 ceph-mon[35784]: osdmap e80: 12 total, 12 up, 12 in 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 -- 172.21.15.5:0/3787749318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 msgr2=0x7efc0410caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 --2- 172.21.15.5:0/3787749318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc0410caf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009900 tx=0x7efbf802a410 comp rx=0 tx=0).stop 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 -- 172.21.15.5:0/3787749318 shutdown_connections 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 --2- 172.21.15.5:0/3787749318 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc0410d140 0x7efc0410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 --2- 172.21.15.5:0/3787749318 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc0410caf0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 --2- 172.21.15.5:0/3787749318 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc04103ce0 0x7efc041040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 -- 172.21.15.5:0/3787749318 >> 172.21.15.5:0/3787749318 conn(0x7efc040fd720 msgr2=0x7efc040ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 -- 172.21.15.5:0/3787749318 shutdown_connections 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 -- 172.21.15.5:0/3787749318 wait complete. 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 Processor -- start 2024-09-10T22:19:54.949 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.936+0000 7efc09652640 1 -- start start 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc09652640 1 --2- >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc04103ce0 0x7efc04101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc09652640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc04101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc09652640 1 --2- >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc0410d140 0x7efc04102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc09652640 1 -- --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_getmap magic: 0 -- 0x7efc04112db0 con 0x7efc04104600 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc09652640 1 -- --> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] -- mon_getmap magic: 0 -- 0x7efc04112c30 con 0x7efc04103ce0 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc09652640 1 -- --> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] -- mon_getmap magic: 0 -- 0x7efc04112f30 con 0x7efc0410d140 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc04101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 --2- >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc04101ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.5:3300/0 says I am v2:172.21.15.5:35390/0 (socket says 172.21.15.5:35390) 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 -- 172.21.15.5:0/2669177991 learned_addr learned my addr 172.21.15.5:0/2669177991 (peer_addr_for_me v2:172.21.15.5:0/0) 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc02ffd640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc04103ce0 0x7efc04101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc037fe640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc0410d140 0x7efc04102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 -- 172.21.15.5:0/2669177991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc0410d140 msgr2=0x7efc04102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:54.950 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc0410d140 0x7efc04102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 -- 172.21.15.5:0/2669177991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc04103ce0 msgr2=0x7efc04101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc04103ce0 0x7efc04101990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 -- 172.21.15.5:0/2669177991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc041a7680 con 0x7efc04104600 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc02ffd640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc04103ce0 0x7efc04101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.937+0000 7efc027fc640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc04101ed0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efbf8006010 tx=0x7efbf8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.938+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf803f030 con 0x7efc04104600 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.938+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efbf8003aa0 con 0x7efc04104600 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.938+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc041a7910 con 0x7efc04104600 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.938+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8035070 con 0x7efc04104600 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.938+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc041a7df0 con 0x7efc04104600 2024-09-10T22:19:54.951 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.939+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc041040c0 con 0x7efc04104600 2024-09-10T22:19:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.940+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 4 ==== mgrmap(e 18) ==== 153249+0+0 (secure 0 0 0) 0x7efbf80035f0 con 0x7efc04104600 2024-09-10T22:19:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.941+0000 7efbebfff640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efbec0b52e0 0x7efbec0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T22:19:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.941+0000 7efc02ffd640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efbec0b52e0 0x7efbec0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T22:19:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.941+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7944+0+0 (secure 0 0 0) 0x7efbf8105fb0 con 0x7efc04104600 2024-09-10T22:19:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.941+0000 7efc02ffd640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efbec0b52e0 0x7efbec0b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007e70 tx=0x7efbf4007850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T22:19:54.952 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:54.945+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7efbf80ccf40 con 0x7efc04104600 2024-09-10T22:19:55.135 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.133+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 --> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7efc0402e5c0 con 0x7efc04104600 2024-09-10T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.502+0000 7efbebfff640 1 -- 172.21.15.5:0/2669177991 <== mon.0 v2:172.21.15.5:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) ==== 169+0+0 (secure 0 0 0) 0x7efbf80cc840 con 0x7efc04104600 2024-09-10T22:19:55.503 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'cephfs_data' removed 2024-09-10T22:19:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efbec0b52e0 msgr2=0x7efbec0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efbec0b52e0 0x7efbec0b77a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007e70 tx=0x7efbf4007850 comp rx=0 tx=0).stop 2024-09-10T22:19:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 msgr2=0x7efc04101ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T22:19:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc04101ed0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efbf8006010 tx=0x7efbf8004060 comp rx=0 tx=0).stop 2024-09-10T22:19:55.506 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 shutdown_connections 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:6800/2373125998,v1:172.21.15.5:6801/2373125998] conn(0x7efbec0b52e0 0x7efbec0b77a0 secure :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7efbf4007e70 tx=0x7efbf4007850 comp rx=0 tx=0).stop 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.189:3300/0,v1:172.21.15.189:6789/0] conn(0x7efc0410d140 0x7efc04102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7efc04104600 0x7efc04101ed0 secure :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efbf8006010 tx=0x7efbf8004060 comp rx=0 tx=0).stop 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 --2- 172.21.15.5:0/2669177991 >> [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] conn(0x7efc04103ce0 0x7efc04101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 >> 172.21.15.5:0/2669177991 conn(0x7efc040fd720 msgr2=0x7efc040fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.505+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 shutdown_connections 2024-09-10T22:19:55.507 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-10T22:19:55.506+0000 7efc09652640 1 -- 172.21.15.5:0/2669177991 wait complete. 2024-09-10T22:19:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:55 smithi052 ceph-mon[34997]: pgmap v440: 65 pgs: 65 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:19:55.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:55 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2669177991' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:55.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:55 smithi005 ceph-mon[31115]: pgmap v440: 65 pgs: 65 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:19:55.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:55 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2669177991' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:55.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:55 smithi189 ceph-mon[35784]: pgmap v440: 65 pgs: 65 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:19:55.943 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:55 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2669177991' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-10T22:19:56.285 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:19:56.314 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:19:56.348 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:19:56.381 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-10T22:19:56.381 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:19:56.397 DEBUG:teuthology.orchestra.run.smithi052:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:19:56.415 DEBUG:teuthology.orchestra.run.smithi189:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-10T22:19:56.439 INFO:tasks.cephadm:Stopping all daemons... 2024-09-10T22:19:56.440 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-10T22:19:56.440 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a 2024-09-10T22:19:56.508 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 systemd[1]: Stopping Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:19:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:56 smithi189 ceph-mon[35784]: from='client.? 172.21.15.5:0/2669177991' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:19:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:56 smithi189 ceph-mon[35784]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T22:19:56.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:56 smithi189 ceph-mon[35784]: pgmap v442: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:19:56.749 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:56 smithi052 ceph-mon[34997]: from='client.? 172.21.15.5:0/2669177991' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:19:56.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:56 smithi052 ceph-mon[34997]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T22:19:56.750 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:56 smithi052 ceph-mon[34997]: pgmap v442: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:19:56.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 ceph-mon[31115]: from='client.? 172.21.15.5:0/2669177991' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-10T22:19:56.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 ceph-mon[31115]: osdmap e81: 12 total, 12 up, 12 in 2024-09-10T22:19:56.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 ceph-mon[31115]: pgmap v442: 1 pgs: 1 active+clean; 577 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-10T22:19:56.832 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a[31111]: 2024-09-10T22:19:56.749+0000 7f40b96a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:19:56.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a[31111]: 2024-09-10T22:19:56.749+0000 7f40b96a3640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-10T22:19:57.226 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:56 smithi005 podman[92305]: 2024-09-10 22:19:56.91385158 +0000 UTC m=+0.277275122 container died a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-10T22:19:57.582 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:57 smithi005 podman[92305]: 2024-09-10 22:19:57.425740264 +0000 UTC m=+0.789163804 container cleanup a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2) 2024-09-10T22:19:57.583 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:57 smithi005 bash[92305]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a 2024-09-10T22:19:57.915 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service' 2024-09-10T22:19:57.937 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:57 smithi005 podman[92317]: 2024-09-10 22:19:57.669630012 +0000 UTC m=+0.758407644 container remove a756bc48a70a1f3e71c1ce1c831be0a78a27bccb2ad07e2e76139bde760f9ccc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:19:57.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:57 smithi005 systemd[1]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-10T22:19:57.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:57 smithi005 systemd[1]: Stopped Ceph mon.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:19:57.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Sep 10 22:19:57 smithi005 systemd[1]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.a.service: Consumed 12.808s CPU time. 2024-09-10T22:19:57.963 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:19:57.963 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-10T22:19:57.964 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-10T22:19:57.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.b 2024-09-10T22:19:58.249 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:58 smithi052 systemd[1]: Stopping Ceph mon.b for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:19:58.635 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-b[34993]: 2024-09-10T22:19:58.283+0000 7f17063ec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:19:58.636 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-b[34993]: 2024-09-10T22:19:58.283+0000 7f17063ec640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-10T22:19:58.636 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:58 smithi052 podman[67828]: 2024-09-10 22:19:58.334367385 +0000 UTC m=+0.174164759 container died 9a004c76f3f10b40b82d47933d5d4e2be3fbb16dd2bd613969297647b86e4516 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-b, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T22:19:58.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:58 smithi052 podman[67828]: 2024-09-10 22:19:58.826031906 +0000 UTC m=+0.665829318 container cleanup 9a004c76f3f10b40b82d47933d5d4e2be3fbb16dd2bd613969297647b86e4516 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T22:19:58.999 INFO:journalctl@ceph.mon.b.smithi052.stdout:Sep 10 22:19:58 smithi052 bash[67828]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-b 2024-09-10T22:19:59.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.b.service' 2024-09-10T22:19:59.370 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:19:59.370 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-10T22:19:59.370 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-10T22:19:59.370 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.c 2024-09-10T22:19:59.693 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:59 smithi189 systemd[1]: Stopping Ceph mon.c for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:00.073 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-c[35780]: 2024-09-10T22:19:59.738+0000 7f1de7005640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:00.073 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-c[35780]: 2024-09-10T22:19:59.738+0000 7f1de7005640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-10T22:20:00.073 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:19:59 smithi189 podman[68501]: 2024-09-10 22:19:59.872294118 +0000 UTC m=+0.303690866 container died e7d643b897dc8f3657fcdacf214da1995ee23fc9cfbc2ca19e7d23ee92fbed06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-10T22:20:00.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:20:00 smithi189 podman[68501]: 2024-09-10 22:20:00.339174427 +0000 UTC m=+0.770571181 container cleanup e7d643b897dc8f3657fcdacf214da1995ee23fc9cfbc2ca19e7d23ee92fbed06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-c, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:20:00.608 INFO:journalctl@ceph.mon.c.smithi189.stdout:Sep 10 22:20:00 smithi189 bash[68501]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mon-c 2024-09-10T22:20:00.778 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mon.c.service' 2024-09-10T22:20:00.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:00.822 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-10T22:20:00.822 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-10T22:20:00.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x 2024-09-10T22:20:01.141 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:20:00 smithi005 systemd[1]: Stopping Ceph mgr.x for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:01.467 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:20:01 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x[31343]: 2024-09-10T22:20:01.139+0000 7f9cbf8af640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:01.467 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:20:01 smithi005 podman[92429]: 2024-09-10 22:20:01.170544422 +0000 UTC m=+0.152022132 container died 91187bfe8cd9facdf75312ffed5ec78f7f9114078d1c7d5caa6e0f139f929a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True) 2024-09-10T22:20:02.119 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:20:01 smithi005 podman[92429]: 2024-09-10 22:20:01.85783752 +0000 UTC m=+0.839315221 container cleanup 91187bfe8cd9facdf75312ffed5ec78f7f9114078d1c7d5caa6e0f139f929a58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-10T22:20:02.119 INFO:journalctl@ceph.mgr.x.smithi005.stdout:Sep 10 22:20:01 smithi005 bash[92429]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-x 2024-09-10T22:20:02.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-10T22:20:02.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:02.339 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-10T22:20:02.339 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-10T22:20:02.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.y 2024-09-10T22:20:02.703 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:20:02 smithi052 systemd[1]: Stopping Ceph mgr.y for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:02.999 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:20:02 smithi052 podman[67957]: 2024-09-10 22:20:02.70274377 +0000 UTC m=+0.160350337 container died 211f7d5ca89b51988574706b439cdd004c0dc3a9e3fae4087d103b6912538088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-y, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T22:20:03.343 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:20:03 smithi052 podman[67957]: 2024-09-10 22:20:03.107536054 +0000 UTC m=+0.565142622 container cleanup 211f7d5ca89b51988574706b439cdd004c0dc3a9e3fae4087d103b6912538088 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0) 2024-09-10T22:20:03.343 INFO:journalctl@ceph.mgr.y.smithi052.stdout:Sep 10 22:20:03 smithi052 bash[67957]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-y 2024-09-10T22:20:03.484 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-10T22:20:03.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:03.521 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-10T22:20:03.521 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-10T22:20:03.522 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.z 2024-09-10T22:20:03.841 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:20:03 smithi189 systemd[1]: Stopping Ceph mgr.z for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:04.161 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:20:03 smithi189 podman[68627]: 2024-09-10 22:20:03.840675213 +0000 UTC m=+0.117603547 container died 4db7ef2f0d5505df2b2f4f16e9ce8f37b5276267640aa02d3419598f10c2be59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T22:20:04.443 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:20:04 smithi189 podman[68627]: 2024-09-10 22:20:04.26054843 +0000 UTC m=+0.537476750 container cleanup 4db7ef2f0d5505df2b2f4f16e9ce8f37b5276267640aa02d3419598f10c2be59 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-z, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T22:20:04.443 INFO:journalctl@ceph.mgr.z.smithi189.stdout:Sep 10 22:20:04 smithi189 bash[68627]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mgr-z 2024-09-10T22:20:04.627 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-10T22:20:04.662 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:04.663 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-10T22:20:04.663 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-10T22:20:04.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.0 2024-09-10T22:20:04.957 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:04 smithi005 systemd[1]: Stopping Ceph osd.0 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:05.332 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0[47307]: 2024-09-10T22:20:04.955+0000 7f9b032ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:05.332 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0[47307]: 2024-09-10T22:20:04.955+0000 7f9b032ef640 -1 osd.0 81 *** Got signal Terminated *** 2024-09-10T22:20:05.332 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0[47307]: 2024-09-10T22:20:04.955+0000 7f9b032ef640 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:10.582 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:10 smithi005 podman[92563]: 2024-09-10 22:20:10.314249055 +0000 UTC m=+5.451799343 container died bc4beb3b7d0bc2cd37d794c0bcfac468f4ee3df54850feaf97b5a80364e34ee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-10T22:20:11.075 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:10 smithi005 podman[92563]: 2024-09-10 22:20:10.797456649 +0000 UTC m=+5.935006936 container cleanup bc4beb3b7d0bc2cd37d794c0bcfac468f4ee3df54850feaf97b5a80364e34ee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T22:20:11.075 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:10 smithi005 bash[92563]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0 2024-09-10T22:20:11.332 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92578]: 2024-09-10 22:20:11.074362175 +0000 UTC m=+0.756795545 container remove bc4beb3b7d0bc2cd37d794c0bcfac468f4ee3df54850feaf97b5a80364e34ee1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-10T22:20:11.587 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92671]: 2024-09-10 22:20:11.32213631 +0000 UTC m=+0.016501146 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:20:11.587 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92671]: 2024-09-10 22:20:11.442567748 +0000 UTC m=+0.136932583 container create aa2a3c080b3a76e7c04f832cb43a0a06d25afb30238073b7debfc8a3dd88f4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-10T22:20:11.912 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92671]: 2024-09-10 22:20:11.712068596 +0000 UTC m=+0.406433432 container init aa2a3c080b3a76e7c04f832cb43a0a06d25afb30238073b7debfc8a3dd88f4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T22:20:11.912 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92671]: 2024-09-10 22:20:11.715481332 +0000 UTC m=+0.409846168 container start aa2a3c080b3a76e7c04f832cb43a0a06d25afb30238073b7debfc8a3dd88f4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T22:20:11.912 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92671]: 2024-09-10 22:20:11.812096079 +0000 UTC m=+0.506460927 container attach aa2a3c080b3a76e7c04f832cb43a0a06d25afb30238073b7debfc8a3dd88f4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:20:12.332 INFO:journalctl@ceph.osd.0.smithi005.stdout:Sep 10 22:20:11 smithi005 podman[92671]: 2024-09-10 22:20:11.912026414 +0000 UTC m=+0.606391262 container died aa2a3c080b3a76e7c04f832cb43a0a06d25afb30238073b7debfc8a3dd88f4b9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T22:20:12.838 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.0.service' 2024-09-10T22:20:12.881 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:12.882 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-10T22:20:12.882 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-10T22:20:12.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.1 2024-09-10T22:20:13.205 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:12 smithi052 systemd[1]: Stopping Ceph osd.1 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:13.499 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1[39410]: 2024-09-10T22:20:13.203+0000 7f2934698640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:13.499 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1[39410]: 2024-09-10T22:20:13.203+0000 7f2934698640 -1 osd.1 81 *** Got signal Terminated *** 2024-09-10T22:20:13.499 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1[39410]: 2024-09-10T22:20:13.203+0000 7f2934698640 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:18.964 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:18 smithi052 podman[68084]: 2024-09-10 22:20:18.555632132 +0000 UTC m=+5.472220508 container died e4f6f495ec97a8740fd4504f56a77752a132f77f174ee4979bd79b473d5ea231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T22:20:19.249 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:19 smithi052 podman[68084]: 2024-09-10 22:20:19.062637806 +0000 UTC m=+5.979226179 container cleanup e4f6f495ec97a8740fd4504f56a77752a132f77f174ee4979bd79b473d5ea231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:20:19.249 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:19 smithi052 bash[68084]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1 2024-09-10T22:20:19.745 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:19 smithi052 podman[68102]: 2024-09-10 22:20:19.331178173 +0000 UTC m=+0.771729263 container remove e4f6f495ec97a8740fd4504f56a77752a132f77f174ee4979bd79b473d5ea231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:20:19.999 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:19 smithi052 podman[68189]: 2024-09-10 22:20:19.647718709 +0000 UTC m=+0.016221946 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:20:20.000 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:19 smithi052 podman[68189]: 2024-09-10 22:20:19.765429665 +0000 UTC m=+0.133932901 container create 7f8196fc0009564fcbbb50b66d2d9ac4ac68e8c15eeba2bd84551da2e5d0431b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:20:20.264 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:20 smithi052 podman[68189]: 2024-09-10 22:20:20.043580952 +0000 UTC m=+0.412084188 container init 7f8196fc0009564fcbbb50b66d2d9ac4ac68e8c15eeba2bd84551da2e5d0431b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T22:20:20.265 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:20 smithi052 podman[68189]: 2024-09-10 22:20:20.046955424 +0000 UTC m=+0.415458661 container start 7f8196fc0009564fcbbb50b66d2d9ac4ac68e8c15eeba2bd84551da2e5d0431b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T22:20:20.265 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:20 smithi052 podman[68189]: 2024-09-10 22:20:20.126952931 +0000 UTC m=+0.495456172 container attach 7f8196fc0009564fcbbb50b66d2d9ac4ac68e8c15eeba2bd84551da2e5d0431b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-10T22:20:20.265 INFO:journalctl@ceph.osd.1.smithi052.stdout:Sep 10 22:20:20 smithi052 podman[68189]: 2024-09-10 22:20:20.242183125 +0000 UTC m=+0.610686363 container died 7f8196fc0009564fcbbb50b66d2d9ac4ac68e8c15eeba2bd84551da2e5d0431b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T22:20:20.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.1.service' 2024-09-10T22:20:20.984 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:20.984 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-10T22:20:20.984 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-10T22:20:20.984 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.2 2024-09-10T22:20:21.290 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:21 smithi189 systemd[1]: Stopping Ceph osd.2 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:21.693 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2[40755]: 2024-09-10T22:20:21.288+0000 7f4ba5b48640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:21.693 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2[40755]: 2024-09-10T22:20:21.288+0000 7f4ba5b48640 -1 osd.2 81 *** Got signal Terminated *** 2024-09-10T22:20:21.693 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2[40755]: 2024-09-10T22:20:21.288+0000 7f4ba5b48640 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:26.907 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:26 smithi189 podman[68750]: 2024-09-10 22:20:26.603796047 +0000 UTC m=+5.422732228 container died 63bd245be75ac8a144e2cf8dda27bae876ef6f7aa384f97717e771d9eeaf61a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T22:20:27.193 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:26 smithi189 podman[68750]: 2024-09-10 22:20:26.997077188 +0000 UTC m=+5.816013370 container cleanup 63bd245be75ac8a144e2cf8dda27bae876ef6f7aa384f97717e771d9eeaf61a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-10T22:20:27.193 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:26 smithi189 bash[68750]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2 2024-09-10T22:20:27.553 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:27 smithi189 podman[68765]: 2024-09-10 22:20:27.240168796 +0000 UTC m=+0.635034126 container remove 63bd245be75ac8a144e2cf8dda27bae876ef6f7aa384f97717e771d9eeaf61a8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:20:27.820 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:27 smithi189 podman[68853]: 2024-09-10 22:20:27.455280146 +0000 UTC m=+0.015882927 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:20:27.820 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:27 smithi189 podman[68853]: 2024-09-10 22:20:27.582925082 +0000 UTC m=+0.143527905 container create ea61c64997d98eab3a85053211ab7a3ffec534fd0c901c2c169d23c3d9c0bc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-10T22:20:28.193 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:27 smithi189 podman[68853]: 2024-09-10 22:20:27.818885327 +0000 UTC m=+0.379488119 container init ea61c64997d98eab3a85053211ab7a3ffec534fd0c901c2c169d23c3d9c0bc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-10T22:20:28.194 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:27 smithi189 podman[68853]: 2024-09-10 22:20:27.822995031 +0000 UTC m=+0.383597812 container start ea61c64997d98eab3a85053211ab7a3ffec534fd0c901c2c169d23c3d9c0bc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T22:20:28.194 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:27 smithi189 podman[68853]: 2024-09-10 22:20:27.918669055 +0000 UTC m=+0.479271850 container attach ea61c64997d98eab3a85053211ab7a3ffec534fd0c901c2c169d23c3d9c0bc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-10T22:20:28.194 INFO:journalctl@ceph.osd.2.smithi189.stdout:Sep 10 22:20:28 smithi189 podman[68853]: 2024-09-10 22:20:28.015748177 +0000 UTC m=+0.576350960 container died ea61c64997d98eab3a85053211ab7a3ffec534fd0c901c2c169d23c3d9c0bc89 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-10T22:20:28.641 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.2.service' 2024-09-10T22:20:28.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:28.681 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-10T22:20:28.681 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-10T22:20:28.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.3 2024-09-10T22:20:28.997 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:28 smithi005 systemd[1]: Stopping Ceph osd.3 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:29.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:28 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:20:28.995+0000 7f5ddf833640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:29.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:28 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:20:28.995+0000 7f5ddf833640 -1 osd.3 81 *** Got signal Terminated *** 2024-09-10T22:20:29.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:28 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:20:28.995+0000 7f5ddf833640 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:31.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:31.382+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:32.193 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:31.702+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:32.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:31 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:20:31.908+0000 7f5ddbe48640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:04.127086+0000 front 2024-09-10T22:20:04.127115+0000 (oldest deadline 2024-09-10T22:20:31.127585+0000) 2024-09-10T22:20:32.660 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:32.395+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:32.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:32 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:32.282+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:32.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:32.658+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:33.321 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:32 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:20:32.887+0000 7f5ddbe48640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:04.127086+0000 front 2024-09-10T22:20:04.127115+0000 (oldest deadline 2024-09-10T22:20:31.127585+0000) 2024-09-10T22:20:33.582 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:33 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:33.382+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:33.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:33 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:33.471+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:33.669 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:33.375+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:33.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:33 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:33.328+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:33.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:33.668+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:34.332 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:33 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3[54182]: 2024-09-10T22:20:33.854+0000 7f5ddbe48640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:04.127086+0000 front 2024-09-10T22:20:04.127115+0000 (oldest deadline 2024-09-10T22:20:31.127585+0000) 2024-09-10T22:20:34.672 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:34.377+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:34.697 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:34 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:34.362+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:34.698 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:34 smithi005 podman[92789]: 2024-09-10 22:20:34.373375784 +0000 UTC m=+5.485170580 container died f9bbcf0df8e3c28b5a7669b8afdbe0ef70364afa4e8915b09c600b80c197fd82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T22:20:34.698 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:34 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:34.424+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:34.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:34 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:34.288+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:34.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:34.671+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:35.082 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:34 smithi005 podman[92789]: 2024-09-10 22:20:34.912925651 +0000 UTC m=+6.024720446 container cleanup f9bbcf0df8e3c28b5a7669b8afdbe0ef70364afa4e8915b09c600b80c197fd82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:20:35.082 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:34 smithi005 bash[92789]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3 2024-09-10T22:20:35.398 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:35.345+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:35.398 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92817]: 2024-09-10 22:20:35.131654363 +0000 UTC m=+0.752238955 container remove f9bbcf0df8e3c28b5a7669b8afdbe0ef70364afa4e8915b09c600b80c197fd82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-10T22:20:35.648 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:35 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:35.396+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:35.649 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92906]: 2024-09-10 22:20:35.436993922 +0000 UTC m=+0.016390834 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:20:35.649 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92906]: 2024-09-10 22:20:35.540967919 +0000 UTC m=+0.120364825 container create f5f6d2cf0da0b7cfa9241e7d60f6ef1dc3f988c222b2d31d796cb301dea5f53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:20:35.653 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:35.358+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:35.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:35 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:35.294+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:35.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:35.651+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:35.974 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92906]: 2024-09-10 22:20:35.777020367 +0000 UTC m=+0.356417269 container init f5f6d2cf0da0b7cfa9241e7d60f6ef1dc3f988c222b2d31d796cb301dea5f53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T22:20:35.974 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92906]: 2024-09-10 22:20:35.780543864 +0000 UTC m=+0.359940769 container start f5f6d2cf0da0b7cfa9241e7d60f6ef1dc3f988c222b2d31d796cb301dea5f53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:20:35.974 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92906]: 2024-09-10 22:20:35.877111726 +0000 UTC m=+0.456508640 container attach f5f6d2cf0da0b7cfa9241e7d60f6ef1dc3f988c222b2d31d796cb301dea5f53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:20:36.281 INFO:journalctl@ceph.osd.3.smithi005.stdout:Sep 10 22:20:35 smithi005 podman[92906]: 2024-09-10 22:20:35.9731799 +0000 UTC m=+0.552576809 container died f5f6d2cf0da0b7cfa9241e7d60f6ef1dc3f988c222b2d31d796cb301dea5f53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T22:20:36.582 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:36 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:36.369+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:36.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:36 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:36.446+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:36.628 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:36.376+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:36.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.3.service' 2024-09-10T22:20:36.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:36 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:36.333+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:36.757 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:36.757 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-10T22:20:36.758 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-10T22:20:36.758 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.4 2024-09-10T22:20:36.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:36.627+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:37.104 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:36 smithi052 systemd[1]: Stopping Ceph osd.4 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:37.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:37 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:37.318+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:37.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:37 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:20:37.101+0000 7f6da4773640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:37.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:37 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:20:37.101+0000 7f6da4773640 -1 osd.4 81 *** Got signal Terminated *** 2024-09-10T22:20:37.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:37 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:20:37.101+0000 7f6da4773640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:37.641 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:37.384+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:37.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:37 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:37.415+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:37.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:37 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:37.375+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:37.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:37.640+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:38.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:38.430+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:38.693 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:38.657+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:38.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:38 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:38.317+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:38.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:38 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:38.438+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:38.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:38 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:38.344+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:39.647 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:39 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:39.276+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:39.676 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:39 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:39.393+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:39.676 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:39 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:39.393+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:39.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:39 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:39.429+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:39.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:39 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:39.355+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:39.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:39 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:39.355+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:39.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:39 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:39.675+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:39.999 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:39 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:20:39.768+0000 7f6da0d88640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.196569+0000 front 2024-09-10T22:20:17.196541+0000 (oldest deadline 2024-09-10T22:20:39.496624+0000) 2024-09-10T22:20:40.000 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:39 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:39.645+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:40.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:40 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:40.451+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:40.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:40 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:40.451+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:40.582 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:40 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:40.331+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:40.583 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:40 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:40.331+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:40.645 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:40 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:40.278+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:40.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:40 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:40.406+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:40.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:40 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:40.406+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:40.693 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:40 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:40.633+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:40.693 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:40 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:40.633+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:40.999 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:40 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:20:40.752+0000 7f6da0d88640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.196569+0000 front 2024-09-10T22:20:17.196541+0000 (oldest deadline 2024-09-10T22:20:39.496624+0000) 2024-09-10T22:20:40.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:40 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:40.643+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:41.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:41 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:41.245+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:41.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:41 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:41.245+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:41.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:41.501+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:41.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:41.501+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:41.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:41.340+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:41.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:41.340+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:41.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:41 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:41.610+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:41.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:41 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:41.610+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:41.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:41 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:41.453+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:41.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:41 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:41.453+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:41.999 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:41 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4[46175]: 2024-09-10T22:20:41.711+0000 7f6da0d88640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.196569+0000 front 2024-09-10T22:20:17.196541+0000 (oldest deadline 2024-09-10T22:20:39.496624+0000) 2024-09-10T22:20:42.000 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:41 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:41.647+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:42.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:42 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:42.216+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:42.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:42 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:42.216+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:42.793 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:42 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:42.600+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:42.793 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:42 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:42.600+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:42.793 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:42 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:42.481+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:42.793 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:42 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:42.481+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:42.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:42 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:42.337+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:42.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:42 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:42.337+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:42.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:42 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:42.452+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:42.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:42 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:42.452+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:42.946 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:42 smithi052 podman[68305]: 2024-09-10 22:20:42.631140536 +0000 UTC m=+5.676769196 container died fe15f227ca91224b9a875bdb3f5611e20ef9286556ffa69de2addb409e28785b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-10T22:20:42.946 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:42 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:42.603+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:43.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:42 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:42.791+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:43.250 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:43 smithi052 podman[68305]: 2024-09-10 22:20:43.051955438 +0000 UTC m=+6.097584104 container cleanup fe15f227ca91224b9a875bdb3f5611e20ef9286556ffa69de2addb409e28785b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T22:20:43.250 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:43 smithi052 bash[68305]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4 2024-09-10T22:20:43.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:43 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:43.191+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:43.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:43 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:43.191+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:43.723 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:43 smithi052 podman[68320]: 2024-09-10 22:20:43.319994011 +0000 UTC m=+0.680571672 container remove fe15f227ca91224b9a875bdb3f5611e20ef9286556ffa69de2addb409e28785b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-10T22:20:43.723 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:43 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:43.564+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:43.822 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:43 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:43.367+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:43.822 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:43 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:43.367+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:43.823 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:43 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:43.464+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:43.823 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:43 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:43.464+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:43.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:43 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:43.750+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:43.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:43 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:43.508+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:43.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:43 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:43.508+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:43.944 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:43 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:43.582+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:43.944 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:43 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:43.582+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:44.001 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:43 smithi052 podman[68409]: 2024-09-10 22:20:43.625141557 +0000 UTC m=+0.015602655 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:20:44.001 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:43 smithi052 podman[68409]: 2024-09-10 22:20:43.745912597 +0000 UTC m=+0.136373731 container create 898416e36aaba7f33340213b4beee41079f0fd1aefad7d0566e08b4996576b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T22:20:44.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:44 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:44.189+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:44.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:44 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:44.189+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:44.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:44 smithi052 podman[68409]: 2024-09-10 22:20:44.02812013 +0000 UTC m=+0.418581216 container init 898416e36aaba7f33340213b4beee41079f0fd1aefad7d0566e08b4996576b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-10T22:20:44.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:44 smithi052 podman[68409]: 2024-09-10 22:20:44.031485663 +0000 UTC m=+0.421946749 container start 898416e36aaba7f33340213b4beee41079f0fd1aefad7d0566e08b4996576b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-10T22:20:44.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:44 smithi052 podman[68409]: 2024-09-10 22:20:44.14057988 +0000 UTC m=+0.531040990 container attach 898416e36aaba7f33340213b4beee41079f0fd1aefad7d0566e08b4996576b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-10T22:20:44.500 INFO:journalctl@ceph.osd.4.smithi052.stdout:Sep 10 22:20:44 smithi052 podman[68409]: 2024-09-10 22:20:44.236379334 +0000 UTC m=+0.626840425 container died 898416e36aaba7f33340213b4beee41079f0fd1aefad7d0566e08b4996576b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:20:44.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:44 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:44.491+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:44.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:44 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:44.491+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:44.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:44 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:44.376+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:44.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:44 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:44.376+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:44.912 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:44 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:44.545+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:44.931 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.4.service' 2024-09-10T22:20:44.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:44 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:44.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:44.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:44 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:44.544+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:44.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:44 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:44.544+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:44.944 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:44 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:44.572+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:44.944 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:44 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:44.572+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:44.972 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:44.972 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-10T22:20:44.972 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-10T22:20:44.972 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.5 2024-09-10T22:20:45.310 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:45 smithi189 systemd[1]: Stopping Ceph osd.5 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:45.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:45 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:45.210+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:45.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:45 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:45.210+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:45.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:45.557+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:45.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:45.557+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:45.694 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:45.307+0000 7f141a3d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:45.694 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:45.307+0000 7f141a3d7640 -1 osd.5 81 *** Got signal Terminated *** 2024-09-10T22:20:45.694 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:45.307+0000 7f141a3d7640 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:45.694 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:45.553+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:45.694 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:45.553+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:45.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:45 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:45.356+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:45.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:45 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:45.356+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:45.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:45 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:45.454+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:45.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:45 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:45.454+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:45.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:45 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:45.580+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:46.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:45 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:45.746+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:46.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:46 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:46.166+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:46.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:46 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:46.166+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:46.796 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:46 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:46.508+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:46.797 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:46 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:46.508+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:46.797 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:46 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:46.547+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:46.797 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:46 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:46.547+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:46.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:46 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:46.361+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:46.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:46 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:46.361+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:46.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:46 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:46.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:46.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:46 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:46.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:46.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:46 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:46.554+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:47.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:46 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:46.795+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:47.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:47 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:47.132+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:47.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:47 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:47.132+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:47.828 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:47.558+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:47.829 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:47.558+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:47.829 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:47.568+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:47.829 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:47.568+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:47.829 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:47.568+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.245664+0000 front 2024-09-10T22:20:25.245701+0000 (oldest deadline 2024-09-10T22:20:46.846435+0000) 2024-09-10T22:20:47.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:47 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:47.391+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:47.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:47 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:47.391+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:47.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:47 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:47.389+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:47.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:47 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:47.389+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:47.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:47 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:47.514+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:48.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:47.826+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:48.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:47 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:47.826+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:48.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:48 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:48.143+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:48.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:48 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:48.143+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:48.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:48 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:48.143+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:48.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:48 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:48.434+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:48.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:48 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:48.434+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:48.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:48 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:48.438+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:48.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:48 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:48.438+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:48.833 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:48.564+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:48.833 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:48.564+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:48.834 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:48.548+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:48.834 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:48.548+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:48.834 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:48.548+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.245664+0000 front 2024-09-10T22:20:25.245701+0000 (oldest deadline 2024-09-10T22:20:46.846435+0000) 2024-09-10T22:20:48.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:48 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:48.539+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:49.000 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:48 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:48.539+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:49.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:48.832+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:49.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:48 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:48.832+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:49.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:49.160+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:49.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:49.160+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:49.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:49.160+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:49.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:49.442+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:49.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:49.442+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:49.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:49.459+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:49.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:49.459+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:49.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:49 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:49.459+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:49.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:49.585+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.542405+0000 front 2024-09-10T22:20:08.542290+0000 (oldest deadline 2024-09-10T22:20:31.442521+0000) 2024-09-10T22:20:49.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:49.585+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:14.744430+0000 front 2024-09-10T22:20:14.744550+0000 (oldest deadline 2024-09-10T22:20:40.044513+0000) 2024-09-10T22:20:49.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5[47348]: 2024-09-10T22:20:49.585+0000 7f14129e4640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.245664+0000 front 2024-09-10T22:20:25.245701+0000 (oldest deadline 2024-09-10T22:20:46.846435+0000) 2024-09-10T22:20:49.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:49.790+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:49.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:49.790+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:49.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:49.601+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:49.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:49 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:49.601+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:49.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:49.516+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:49.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:49 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:49.516+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:50.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:50 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:50.111+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:50.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:50 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:50.111+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:50.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:50 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:50.111+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:50.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:50.440+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:50.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:50.440+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:50.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:50.474+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:50.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:50.474+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:50.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:50 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:50.474+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:50.943 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:50 smithi189 podman[68968]: 2024-09-10 22:20:50.759634808 +0000 UTC m=+5.593186504 container died 22bb2fcf7ac2b1b1cdeda4f753bf4234f8e92b0abc8c59151284647dec10313e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-09-10T22:20:50.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:50 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:50.768+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:50.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:50 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:50.768+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:50.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:50 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:50.587+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:50.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:50 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:50.587+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:50.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:50 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:50.587+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:50.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:50 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:50.540+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:50.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:50 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:50.540+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:51.410 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 podman[68968]: 2024-09-10 22:20:51.125361079 +0000 UTC m=+5.958912757 container cleanup 22bb2fcf7ac2b1b1cdeda4f753bf4234f8e92b0abc8c59151284647dec10313e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-10T22:20:51.411 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 bash[68968]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5 2024-09-10T22:20:51.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:51 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:51.109+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:51.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:51 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:51.109+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:51.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:51 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:51.109+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:51.693 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 podman[68985]: 2024-09-10 22:20:51.410051859 +0000 UTC m=+0.650401394 container remove 22bb2fcf7ac2b1b1cdeda4f753bf4234f8e92b0abc8c59151284647dec10313e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-10T22:20:51.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:51.548+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:51.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:51.548+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:51.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:51.548+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:51.780 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:51 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:51.543+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:51.781 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:51 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:51.543+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:51.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:51.514+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:51.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:51.514+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:51.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:51.514+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:51.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:51.421+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:51.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:51.421+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:51.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:51.421+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:51.735+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:51 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:51.735+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 podman[69075]: 2024-09-10 22:20:51.640517489 +0000 UTC m=+0.016278040 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 podman[69075]: 2024-09-10 22:20:51.744234064 +0000 UTC m=+0.119994601 container create 3980893f87ad14234a6b54d2367a893df52c05a16ebcc468c9037de4f9362751 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 podman[69075]: 2024-09-10 22:20:51.947445824 +0000 UTC m=+0.323206365 container init 3980893f87ad14234a6b54d2367a893df52c05a16ebcc468c9037de4f9362751 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:51 smithi189 podman[69075]: 2024-09-10 22:20:51.950729736 +0000 UTC m=+0.326490279 container start 3980893f87ad14234a6b54d2367a893df52c05a16ebcc468c9037de4f9362751 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-10T22:20:52.039 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:52 smithi189 podman[69075]: 2024-09-10 22:20:52.038410339 +0000 UTC m=+0.414170886 container attach 3980893f87ad14234a6b54d2367a893df52c05a16ebcc468c9037de4f9362751 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:20:52.433 INFO:journalctl@ceph.osd.5.smithi189.stdout:Sep 10 22:20:52 smithi189 podman[69075]: 2024-09-10 22:20:52.139101203 +0000 UTC m=+0.514861751 container died 3980893f87ad14234a6b54d2367a893df52c05a16ebcc468c9037de4f9362751 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-10T22:20:52.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:52.070+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:52.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:52.070+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:52.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:52.070+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:52.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:52 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:52.546+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:52.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:52 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:52.546+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:52.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:52 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:52.546+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:52.794 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.5.service' 2024-09-10T22:20:52.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:52 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:52.562+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:52.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:52 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:52.562+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:52.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:52 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:52.562+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:52.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:52 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:52.386+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:52.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:52 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:52.386+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:52.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:52 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:52.386+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:52.835 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:20:52.836 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-10T22:20:52.836 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-10T22:20:52.836 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.6 2024-09-10T22:20:53.001 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:52.581+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:53.001 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:52 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:52.581+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:53.153 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:52 smithi005 systemd[1]: Stopping Ceph osd.6 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:20:53.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:52 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:52.751+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:53.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:52 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:52.751+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:53.409 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:53.151+0000 7fb884bec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:20:53.409 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:53.151+0000 7fb884bec640 -1 osd.6 81 *** Got signal Terminated *** 2024-09-10T22:20:53.409 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:53.151+0000 7fb884bec640 -1 osd.6 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:20:53.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:53 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:53.045+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:53.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:53 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:53.045+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:53.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:53 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:53.045+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:53.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:53.406+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:53.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:53.406+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:53.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:53.406+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:53.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:53.565+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:53.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:53.565+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:53.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:53 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:53.565+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:53.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:53 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:53.724+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:53.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:53 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:53.724+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:53.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:53 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:53.533+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:53.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:53 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:53.533+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:53.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:53 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:53.533+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:53.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:53 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:53.540+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:53.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:53 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:53.540+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:54.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:54.008+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:54.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:54.008+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:54.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:54.008+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:54.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:54 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:54.587+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:54.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:54 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:54.587+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:54.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:54 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:54.587+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:54.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:54 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:54.442+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:54.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:54 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:54.442+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:54.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:54 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:54.442+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:54.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:54 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:54.683+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:54.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:54 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:54.683+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:54.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:54 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:54.496+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:54.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:54 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:54.496+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:54.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:54 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:54.496+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:54.970 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:54.582+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:54.970 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:54.582+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:55.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:54.969+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:55.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:54.969+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:55.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:54 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:54.969+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:55.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:55.612+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:55.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:55.612+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:55.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:55.612+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:55.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:55.403+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:55.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:55.403+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:55.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:55.403+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:55.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:55 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:55.666+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:55.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:55 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:55.666+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:55.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:55 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:55.497+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:55.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:55 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:55.497+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:55.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:55 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:55.497+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:55.991 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:55 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:55.567+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:55.991 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:55 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:55.567+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:56.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:55 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:55.989+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:56.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:55 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:55.989+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:56.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:55 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:55.989+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:56.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:56.400+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:56.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:56.400+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:56.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:56.400+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:56.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:56.594+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:56.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:56.594+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:56.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:56.594+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:56.833 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:56 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:56.594+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.987733+0000 front 2024-09-10T22:20:33.987852+0000 (oldest deadline 2024-09-10T22:20:55.687757+0000) 2024-09-10T22:20:56.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:56 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:56.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:56.844 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:56 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:56.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:56.845 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:56 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:56.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:56.845 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:56 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:56.667+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:56.845 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:56 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:56.667+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:56.969 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:56 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:56.561+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:56.969 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:56 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:56.561+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:57.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:56 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:56.968+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:57.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:56 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:56.968+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:57.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:56 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:56.968+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:57.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:56 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:56.968+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:20:57.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:57.409+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:57.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:57.409+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:57.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:57.409+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:57.834 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:57.578+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.482701+0000 front 2024-09-10T22:20:08.482741+0000 (oldest deadline 2024-09-10T22:20:33.182835+0000) 2024-09-10T22:20:57.834 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:57.578+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.284099+0000 front 2024-09-10T22:20:17.284067+0000 (oldest deadline 2024-09-10T22:20:38.984079+0000) 2024-09-10T22:20:57.834 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:57.578+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.085511+0000 front 2024-09-10T22:20:23.085365+0000 (oldest deadline 2024-09-10T22:20:48.985278+0000) 2024-09-10T22:20:57.834 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:57 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6[61065]: 2024-09-10T22:20:57.578+0000 7fb881201640 -1 osd.6 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.987733+0000 front 2024-09-10T22:20:33.987852+0000 (oldest deadline 2024-09-10T22:20:55.687757+0000) 2024-09-10T22:20:57.931 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:57 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:57.518+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:57.931 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:57 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:57.518+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:57.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:57 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:57.693+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:57.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:57 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:57.693+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:57.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:57 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:57.487+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:57.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:57 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:57.487+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:57.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:57 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:57.487+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:58.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:57 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:57.929+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:58.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:57 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:57.929+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:58.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:57 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:57.929+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:58.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:57 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:57.929+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:20:58.820 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:58 smithi005 podman[93008]: 2024-09-10 22:20:58.523085837 +0000 UTC m=+5.490609361 container died bf167e0454e513f6cb1bbd49c49df81b9ee2753595383816c074f3d4bee9f0e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-10T22:20:58.820 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:58 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:58.417+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:58.821 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:58 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:58.417+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:58.821 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:58 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:58.417+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:58.821 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:58 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:58.417+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:20:58.897 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:58.503+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:58.897 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:58.503+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:58.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:58 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:58.722+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:58.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:58 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:58.722+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:58.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:58 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:58.722+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:20:58.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:58 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:58.511+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:58.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:58 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:58.511+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:58.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:58 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:58.511+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:59.082 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:59 smithi005 podman[93008]: 2024-09-10 22:20:59.010149166 +0000 UTC m=+5.977672731 container cleanup bf167e0454e513f6cb1bbd49c49df81b9ee2753595383816c074f3d4bee9f0e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-10T22:20:59.082 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:59 smithi005 bash[93008]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6 2024-09-10T22:20:59.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:58.896+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:20:59.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:58.896+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:20:59.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:58.896+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:20:59.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:58 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:58.896+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:20:59.749 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:59.493+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:20:59.749 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:59.493+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:20:59.750 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:20:59.493+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:20:59.832 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:59 smithi005 podman[93023]: 2024-09-10 22:20:59.470689924 +0000 UTC m=+0.943414389 container remove bf167e0454e513f6cb1bbd49c49df81b9ee2753595383816c074f3d4bee9f0e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-10T22:20:59.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:59 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:59.397+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:20:59.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:59 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:59.397+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:20:59.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:59 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:59.397+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:20:59.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:20:59 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:20:59.397+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:20:59.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:59.521+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:20:59.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:59.521+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:20:59.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:20:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:20:59.521+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:20:59.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:59.756+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:20:59.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:59.756+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:20:59.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:20:59 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:20:59.756+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:00.166 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:59 smithi005 podman[93115]: 2024-09-10 22:20:59.79697396 +0000 UTC m=+0.016675106 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:21:00.167 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:20:59 smithi005 podman[93115]: 2024-09-10 22:20:59.905056543 +0000 UTC m=+0.124757731 container create 16ba320b25d46ffb112b981cc7f233b378e53ef3e88d6e8d3034dce882dedd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-10T22:21:00.167 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:21:00 smithi005 podman[93115]: 2024-09-10 22:21:00.166169427 +0000 UTC m=+0.385870572 container init 16ba320b25d46ffb112b981cc7f233b378e53ef3e88d6e8d3034dce882dedd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-10T22:21:00.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:59.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:00.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:59.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:00.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:59.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:00.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:20:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:20:59.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:00.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:21:00 smithi005 podman[93115]: 2024-09-10 22:21:00.170009792 +0000 UTC m=+0.389710941 container start 16ba320b25d46ffb112b981cc7f233b378e53ef3e88d6e8d3034dce882dedd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:21:00.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:21:00 smithi005 podman[93115]: 2024-09-10 22:21:00.265982504 +0000 UTC m=+0.485683661 container attach 16ba320b25d46ffb112b981cc7f233b378e53ef3e88d6e8d3034dce882dedd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-10T22:21:00.433 INFO:journalctl@ceph.osd.6.smithi005.stdout:Sep 10 22:21:00 smithi005 podman[93115]: 2024-09-10 22:21:00.376678966 +0000 UTC m=+0.596380123 container died 16ba320b25d46ffb112b981cc7f233b378e53ef3e88d6e8d3034dce882dedd13 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T22:21:00.795 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:00 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:00.479+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:00.796 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:00 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:00.479+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:00.796 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:00 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:00.479+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:00.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:00 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:00.430+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:00.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:00 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:00.430+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:00.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:00 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:00.430+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:00.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:00 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:00.430+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:00.924 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:00.542+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:00.925 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:00.542+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:00.925 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:00.542+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:01.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:00 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:00.794+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:01.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:00 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:00.794+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:01.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:00 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:00.794+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:01.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.6.service' 2024-09-10T22:21:01.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:00.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:01.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:00.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:01.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:00.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:01.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:00 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:00.923+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:01.283 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:01.283 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-10T22:21:01.283 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-10T22:21:01.283 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.7 2024-09-10T22:21:01.473 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:01 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:01.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:01.473 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:01 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:01.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:01.474 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:01 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:01.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:01.474 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:01 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:01.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:01.583 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 systemd[1]: Stopping Ceph osd.7 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:01.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:01 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:01.744+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:01.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:01 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:01.744+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:01.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:01 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:01.744+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:01.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:01 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:01.518+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:01.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:01 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:01.518+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:01.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:01 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:01.518+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:01.955 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:01.582+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:01.955 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:01.582+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:01.955 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:01.582+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:01.955 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:01.597+0000 7fbef2a28640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:01.955 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:01.597+0000 7fbef2a28640 -1 osd.7 81 *** Got signal Terminated *** 2024-09-10T22:21:01.955 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:01.597+0000 7fbef2a28640 -1 osd.7 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:21:02.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:01.954+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:02.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:01.954+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:02.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:01.954+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:02.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:01 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:01.954+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:02.734 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:02 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:02.452+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:02.734 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:02 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:02.452+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:02.734 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:02 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:02.452+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:02.734 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:02 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:02.452+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:02.856 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:02.561+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:02.856 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:02.561+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:02.856 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:02.561+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:02.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:02 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:02.714+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:02.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:02 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:02.714+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:02.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:02 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:02.714+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:02.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:02 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:02.520+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:02.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:02 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:02.520+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:02.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:02 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:02.520+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:03.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:02.941+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:03.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:02.941+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:03.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:02.941+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:03.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:02.941+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:03.759 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:03.500+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:03.759 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:03.500+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:03.760 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:03.500+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:03.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:03 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:03.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:03.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:03 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:03.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:03.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:03 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:03.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:03.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:03 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:03.413+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:03.915 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:03.594+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:03.916 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:03.594+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:03.916 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:03.594+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:04.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:03.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:04.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:03.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:04.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:03.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:04.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:03 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:03.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:04.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:03.914+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:04.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:03.914+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:04.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:03.914+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:04.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:03 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:03.914+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:04.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:04.372+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:04.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:04.372+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:04.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:04.372+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:04.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:04 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:04.372+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:04.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:04.507+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:04.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:04.507+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:04.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:04.507+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:04.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:04.751+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:04.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:04.751+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:04.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:04.751+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:04.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:04 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:04.751+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:04.962 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:04.583+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:04.963 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:04.583+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:04.963 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:04.583+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:04.963 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:04.583+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:40.466670+0000 front 2024-09-10T22:20:40.466714+0000 (oldest deadline 2024-09-10T22:21:04.566761+0000) 2024-09-10T22:21:05.252 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:04.961+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:05.252 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:04.961+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:05.252 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:04.961+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:05.252 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:04 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:04.961+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:05.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:05 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:05.411+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:05.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:05 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:05.411+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:05.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:05 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:05.411+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:05.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:05 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:05.411+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:05.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:05.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:05.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:05.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:05.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:05.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:05.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:05.735+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:05.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:05.735+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:05.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:05.735+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:05.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:05 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:05.735+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:05.995 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:05.535+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:05.995 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:05.535+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:05.995 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:05.535+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:05.995 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:05.535+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:40.466670+0000 front 2024-09-10T22:20:40.466714+0000 (oldest deadline 2024-09-10T22:21:04.566761+0000) 2024-09-10T22:21:06.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:05.993+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:06.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:05.993+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:06.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:05.993+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:06.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:05.993+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:06.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:05 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:05.993+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:06.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:06 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:06.445+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:06.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:06 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:06.445+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:06.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:06 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:06.445+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:06.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:06 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:06.445+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:06.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:06.541+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:06.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:06.541+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:06.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:06.541+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:06.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:06.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:06.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:06.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:06.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:06.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:06.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:06 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:06.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:06.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:06 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:06.552+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.862572+0000 front 2024-09-10T22:20:17.862530+0000 (oldest deadline 2024-09-10T22:20:38.962667+0000) 2024-09-10T22:21:06.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:06 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:06.552+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.864862+0000 front 2024-09-10T22:20:25.864782+0000 (oldest deadline 2024-09-10T22:20:48.164942+0000) 2024-09-10T22:21:06.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:06 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:06.552+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:28.165642+0000 front 2024-09-10T22:20:28.165500+0000 (oldest deadline 2024-09-10T22:20:59.365915+0000) 2024-09-10T22:21:07.000 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:06 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7[53114]: 2024-09-10T22:21:06.552+0000 7fbeeb035640 -1 osd.7 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:40.466670+0000 front 2024-09-10T22:20:40.466714+0000 (oldest deadline 2024-09-10T22:21:04.566761+0000) 2024-09-10T22:21:07.491 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:07 smithi052 podman[68523]: 2024-09-10 22:21:07.071544468 +0000 UTC m=+5.587315786 container died 9c0203f62391b6a2416503d331ead37580fdb95ad92bab906093fb4a06f0231d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T22:21:07.491 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:07.028+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:07.491 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:07.028+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:07.491 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:07.028+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:07.491 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:07.028+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:07.491 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:07 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:07.028+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:07.749 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:07 smithi052 podman[68523]: 2024-09-10 22:21:07.614611178 +0000 UTC m=+6.130382484 container cleanup 9c0203f62391b6a2416503d331ead37580fdb95ad92bab906093fb4a06f0231d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True) 2024-09-10T22:21:07.749 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:07 smithi052 bash[68523]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7 2024-09-10T22:21:07.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:07 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:07.431+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:07.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:07 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:07.431+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:07.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:07 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:07.431+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:07.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:07 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:07.431+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:07.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:07.707+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:07.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:07.707+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:07.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:07.707+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:07.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:07.707+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:07.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:07.571+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:07.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:07.571+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:07.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:07.571+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:07.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:07 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:07.571+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:08.249 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:07 smithi052 podman[68540]: 2024-09-10 22:21:07.832721354 +0000 UTC m=+0.758172538 container remove 9c0203f62391b6a2416503d331ead37580fdb95ad92bab906093fb4a06f0231d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:21:08.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:08 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:08.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:08.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:08 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:08.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:08.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:08 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:08.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:08.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:08 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:08.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:08.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:08 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:08.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:08.695 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:08 smithi052 podman[68626]: 2024-09-10 22:21:08.183433927 +0000 UTC m=+0.015701567 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:21:08.695 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:08 smithi052 podman[68626]: 2024-09-10 22:21:08.333667933 +0000 UTC m=+0.165935592 container create bf5c4c1951d895df6a8848c6f64f291ec432885ec7a8b343f45a0df424a45728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-10T22:21:08.695 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:08 smithi052 podman[68626]: 2024-09-10 22:21:08.694407606 +0000 UTC m=+0.526675241 container init bf5c4c1951d895df6a8848c6f64f291ec432885ec7a8b343f45a0df424a45728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T22:21:08.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:08 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:08.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:08.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:08 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:08.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:08.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:08 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:08.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:08.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:08 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:08.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:08.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:08 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:08.404+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:08.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:08.659+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:08.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:08.659+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:08.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:08.659+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:08.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:08.659+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:08.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:08.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:08.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:08.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:08.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:08.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:08.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:08 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:08.535+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:08.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:08 smithi052 podman[68626]: 2024-09-10 22:21:08.69809132 +0000 UTC m=+0.530358948 container start bf5c4c1951d895df6a8848c6f64f291ec432885ec7a8b343f45a0df424a45728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-10T22:21:08.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:08 smithi052 podman[68626]: 2024-09-10 22:21:08.777827948 +0000 UTC m=+0.610095572 container attach bf5c4c1951d895df6a8848c6f64f291ec432885ec7a8b343f45a0df424a45728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T22:21:08.999 INFO:journalctl@ceph.osd.7.smithi052.stdout:Sep 10 22:21:08 smithi052 podman[68626]: 2024-09-10 22:21:08.886768262 +0000 UTC m=+0.719035883 container died bf5c4c1951d895df6a8848c6f64f291ec432885ec7a8b343f45a0df424a45728 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T22:21:09.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:09.023+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:09.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:09.023+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:09.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:09.023+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:09.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:09.023+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:09.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:09 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:09.023+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:09.557 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.7.service' 2024-09-10T22:21:09.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:09.601 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-10T22:21:09.602 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-10T22:21:09.602 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.8 2024-09-10T22:21:09.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:09 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:09.444+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:09.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:09 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:09.444+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:09.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:09 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:09.444+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:09.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:09 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:09.444+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:09.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:09 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:09.444+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:09.929 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:09.488+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:09.488+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:09.488+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:09.488+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 systemd[1]: Stopping Ceph osd.8 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.669+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.669+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.669+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.669+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.928+0000 7feb1b577640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.928+0000 7feb1b577640 -1 osd.8 81 *** Got signal Terminated *** 2024-09-10T22:21:09.930 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:09 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:09.928+0000 7feb1b577640 -1 osd.8 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:21:10.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:10.036+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:10.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:10.036+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:10.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:10.036+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:10.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:10.036+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:10.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:10.036+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:10.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:10 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:10.418+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:10.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:10 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:10.418+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:10.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:10 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:10.418+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:10.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:10 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:10.418+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:10.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:10 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:10.418+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:10.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:10.710+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:10.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:10.710+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:10.943 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:10.710+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:10.944 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:10.710+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:10.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:10.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:10.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:10.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:10.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:10.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:10.944 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:10 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:10.465+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:11.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:11 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:11.041+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:11.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:11 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:11.041+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:11.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:11 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:11.041+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:11.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:11 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:11.041+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:11.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:11 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:11.041+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:11.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:11.427+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:11.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:11.427+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:11.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:11.427+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:11.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:11.427+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:11.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:11.412+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:11.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:11.412+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:11.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:11.412+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:11.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:11.412+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:11.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:11 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:11.412+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:12.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:11.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:12.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:11.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:12.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:11.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:12.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:11 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:11.758+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:12.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:12.038+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:12.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:12.038+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:12.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:12.038+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:12.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:12.038+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:12.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:12.038+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:12.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:12 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:12.038+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:12.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:12.382+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:12.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:12.382+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:12.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:12.382+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:12.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:12.382+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:12.789 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:12 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:12.459+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:12.789 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:12 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:12.459+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:12.789 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:12 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:12.459+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:12.789 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:12 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:12.459+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:12.789 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:12 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:12.459+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:13.199 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:12.761+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:13.199 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:12.761+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:13.199 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:12.761+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:13.199 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:12 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:12.761+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:13.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:13.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:13.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:13.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:13.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:13.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:13.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:13.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:13.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:13.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:13.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:13 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:13.053+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:13.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:13.374+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:13.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:13.374+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:13.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:13.374+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:13.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:13.374+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:13.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:13.374+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:13.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:13.460+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:13.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:13.460+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:13.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:13.460+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:13.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:13.460+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:13.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:13.460+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:13.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:13 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:13.460+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:14.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:13.752+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:14.194 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:13.752+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:14.194 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:13.752+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:14.194 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:13 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:13.752+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:14.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:14 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:14.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:14.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:14 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:14.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:14.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:14 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:14.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:14.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:14 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:14.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:14.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:14 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:14.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:14.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:14 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:14.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:14.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:14.399+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:14.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:14.399+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:14.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:14.399+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:14.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:14.399+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:14.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:14.399+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:14.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:14 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:14.489+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:14.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:14 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:14.489+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:14.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:14 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:14.489+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:14.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:14 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:14.489+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:14.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:14 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:14.489+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:14.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:14 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:14.489+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:15.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:14.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.701379+0000 front 2024-09-10T22:20:17.701266+0000 (oldest deadline 2024-09-10T22:20:42.401286+0000) 2024-09-10T22:21:15.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:14.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:22.401646+0000 front 2024-09-10T22:20:22.401672+0000 (oldest deadline 2024-09-10T22:20:47.101847+0000) 2024-09-10T22:21:15.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:14.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:33.002878+0000 front 2024-09-10T22:20:33.003085+0000 (oldest deadline 2024-09-10T22:20:57.702844+0000) 2024-09-10T22:21:15.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:14.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:37.703337+0000 front 2024-09-10T22:20:37.703410+0000 (oldest deadline 2024-09-10T22:21:03.003351+0000) 2024-09-10T22:21:15.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:14 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8[53815]: 2024-09-10T22:21:14.754+0000 7feb13b84640 -1 osd.8 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:48.304093+0000 front 2024-09-10T22:20:48.304124+0000 (oldest deadline 2024-09-10T22:21:14.204250+0000) 2024-09-10T22:21:15.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:15 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:15.093+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:15.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:15 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:15.093+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:15.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:15 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:15.093+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:15.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:15 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:15.093+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:15.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:15 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:15.093+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:15.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:15 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:15.093+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:15.693 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:15 smithi189 podman[69187]: 2024-09-10 22:21:15.473639442 +0000 UTC m=+5.672350145 container died 9776228a27307d07d8108d7258ce78cb65d397c7d76ef1dbc77aa0c28381d5c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T22:21:15.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:15.392+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:15.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:15.392+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:15.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:15.392+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:15.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:15.392+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:15.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:15.392+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:15.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:15.525+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:15.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:15.525+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:15.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:15.525+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:15.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:15.525+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:15.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:15.525+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:15.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:15 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:15.525+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:16.138 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:15 smithi189 podman[69187]: 2024-09-10 22:21:15.81963401 +0000 UTC m=+6.018344690 container cleanup 9776228a27307d07d8108d7258ce78cb65d397c7d76ef1dbc77aa0c28381d5c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-10T22:21:16.139 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:15 smithi189 bash[69187]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8 2024-09-10T22:21:16.443 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69203]: 2024-09-10 22:21:16.138043278 +0000 UTC m=+0.662592587 container remove 9776228a27307d07d8108d7258ce78cb65d397c7d76ef1dbc77aa0c28381d5c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-10T22:21:16.443 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:16 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:16.370+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:16.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:16 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:16.370+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:16.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:16 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:16.370+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:16.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:16 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:16.370+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:16.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:16 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:16.370+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:16.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:16 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:16.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:16.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:16 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:16.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:16.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:16 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:16.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:16.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:16 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:16.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:16.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:16 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:16.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:16.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:16 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:16.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:16.808 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69291]: 2024-09-10 22:21:16.488987234 +0000 UTC m=+0.112040154 container create 83bce3f742998fccbea9c2f169cf499af4e9d90f9224e1d2cf7afeb8049b9f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T22:21:16.808 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69291]: 2024-09-10 22:21:16.392665552 +0000 UTC m=+0.015718483 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:21:16.808 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69291]: 2024-09-10 22:21:16.724511481 +0000 UTC m=+0.347564401 container init 83bce3f742998fccbea9c2f169cf499af4e9d90f9224e1d2cf7afeb8049b9f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-10T22:21:16.809 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69291]: 2024-09-10 22:21:16.727800943 +0000 UTC m=+0.350853866 container start 83bce3f742998fccbea9c2f169cf499af4e9d90f9224e1d2cf7afeb8049b9f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-10T22:21:16.809 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69291]: 2024-09-10 22:21:16.807862306 +0000 UTC m=+0.430915227 container attach 83bce3f742998fccbea9c2f169cf499af4e9d90f9224e1d2cf7afeb8049b9f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-10T22:21:16.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:16 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:16.492+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:16.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:16 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:16.492+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:16.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:16 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:16.492+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:16.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:16 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:16.492+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:16.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:16 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:16.492+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:16.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:16 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:16.492+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:17.193 INFO:journalctl@ceph.osd.8.smithi189.stdout:Sep 10 22:21:16 smithi189 podman[69291]: 2024-09-10 22:21:16.932287575 +0000 UTC m=+0.555340495 container died 83bce3f742998fccbea9c2f169cf499af4e9d90f9224e1d2cf7afeb8049b9f38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:21:17.495 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:17.375+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:17.496 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:17.375+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:17.496 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:17.375+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:17.496 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:17.375+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:17.496 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:17 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:17.375+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:17.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:17 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:17.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:17.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:17 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:17.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:17.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:17 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:17.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:17.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:17 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:17.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:17.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:17 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:17.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:17.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:17 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:17.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:17.515 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.8.service' 2024-09-10T22:21:17.554 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:17.554 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-10T22:21:17.554 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-10T22:21:17.555 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.9 2024-09-10T22:21:17.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.510+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:17.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.510+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:17.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.510+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:17.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.510+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:17.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.510+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:17.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.510+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:17.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 systemd[1]: Stopping Ceph osd.9 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:18.332 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.873+0000 7f465218c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:18.333 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.873+0000 7f465218c640 -1 osd.9 81 *** Got signal Terminated *** 2024-09-10T22:21:18.333 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:17 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:17.873+0000 7f465218c640 -1 osd.9 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:21:18.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:18 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:18.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:18.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:18 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:18.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:18.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:18 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:18.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:18.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:18 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:18.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:18.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:18 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:18.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:18.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:18 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:18.085+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:18.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:18.373+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:18.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:18.373+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:18.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:18.373+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:18.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:18.373+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:18.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:18.373+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:18.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:18 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:18.490+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:18.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:18 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:18.490+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:18.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:18 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:18.490+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:18.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:18 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:18.490+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:18.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:18 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:18.490+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:18.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:18 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:18.490+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:19.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:19 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:19.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:19.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:19 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:19.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:19.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:19 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:19.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:19.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:19 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:19.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:19.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:19 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:19.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:19.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:19 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:19.064+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:19.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:19 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:19.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:19.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:19 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:19.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:19.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:19 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:19.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:19.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:19 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:19.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:19.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:19 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:19.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:19.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:19 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:19.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:19.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:19 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:19.482+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:19.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:19 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:19.482+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:19.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:19 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:19.482+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:19.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:19 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:19.482+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:19.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:19 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:19.482+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:19.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:19 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:19.482+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:20.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:20 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:20.060+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:20.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:20 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:20.060+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:20.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:20 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:20.060+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:20.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:20 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:20.060+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:20.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:20 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:20.060+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:20.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:20 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:20.060+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:20.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:20.339+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:20.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:20.339+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:20.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:20.339+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:20.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:20.339+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:20.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:20.339+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:20.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:20 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:20.339+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:20.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:20 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:20.521+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:20.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:20 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:20.521+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:20.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:20 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:20.521+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:20.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:20 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:20.521+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:20.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:20 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:20.521+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:20.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:20 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:20.521+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:21.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:21.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:21.249 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:21.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:21.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:21.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:21.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:21 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:21.066+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:21.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:21.322+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:21.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:21.322+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:21.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:21.322+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:21.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:21.322+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:21.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:21.322+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:21.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:21 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:21.322+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:21.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:21.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:21.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:21.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:21.832 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:21.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:21.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:21 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:21.528+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:56.697674+0000 front 2024-09-10T22:20:56.697695+0000 (oldest deadline 2024-09-10T22:21:21.397720+0000) 2024-09-10T22:21:22.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:22.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:22.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:22.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:22.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:22.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:22.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:22 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:22.105+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:22.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:22.310+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:22.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:22.310+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:22.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:22.310+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:22.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:22.310+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:22.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:22.310+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:22.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:22.310+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:09.590352+0000 front 2024-09-10T22:20:09.590295+0000 (oldest deadline 2024-09-10T22:20:32.490522+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.492392+0000 front 2024-09-10T22:20:16.492455+0000 (oldest deadline 2024-09-10T22:20:39.992527+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.293644+0000 front 2024-09-10T22:20:25.293489+0000 (oldest deadline 2024-09-10T22:20:50.593437+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:30.593896+0000 front 2024-09-10T22:20:30.593974+0000 (oldest deadline 2024-09-10T22:20:58.194295+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:39.295285+0000 front 2024-09-10T22:20:39.295434+0000 (oldest deadline 2024-09-10T22:21:08.095523+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.796799+0000 front 2024-09-10T22:20:49.796756+0000 (oldest deadline 2024-09-10T22:21:12.696542+0000) 2024-09-10T22:21:22.833 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:22 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9[67564]: 2024-09-10T22:21:22.534+0000 7f464e7a1640 -1 osd.9 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:56.697674+0000 front 2024-09-10T22:20:56.697695+0000 (oldest deadline 2024-09-10T22:21:21.397720+0000) 2024-09-10T22:21:23.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:23.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:23.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:23.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:23.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:23.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:23.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:23 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:23.059+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:23.643 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:23 smithi005 podman[93228]: 2024-09-10 22:21:23.357612927 +0000 UTC m=+5.600064939 container died c65f27fadc2e2d0af9975b104011afcc282d55bf2233f7ab8fc2491b1927abe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:21:23.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:23 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:23.291+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:23.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:23 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:23.291+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:23.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:23 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:23.291+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:23.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:23 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:23.291+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:23.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:23 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:23.291+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:23.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:23 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:23.291+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:24.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:23 smithi005 podman[93228]: 2024-09-10 22:21:23.923446346 +0000 UTC m=+6.165898348 container cleanup c65f27fadc2e2d0af9975b104011afcc282d55bf2233f7ab8fc2491b1927abe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:21:24.243 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:23 smithi005 bash[93228]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9 2024-09-10T22:21:24.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:24.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:24.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:24.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:24.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:24.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:24.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:24 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:24.071+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:24.582 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:24 smithi005 podman[93244]: 2024-09-10 22:21:24.242042406 +0000 UTC m=+0.875995057 container remove c65f27fadc2e2d0af9975b104011afcc282d55bf2233f7ab8fc2491b1927abe5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T22:21:24.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:24 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:24.297+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:24.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:24 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:24.297+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:24.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:24 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:24.297+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:24.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:24 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:24.297+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:24.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:24 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:24.297+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:24.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:24 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:24.297+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:24.912 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:24 smithi005 podman[93335]: 2024-09-10 22:21:24.50166018 +0000 UTC m=+0.016166593 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:21:24.913 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:24 smithi005 podman[93335]: 2024-09-10 22:21:24.601270448 +0000 UTC m=+0.115776893 container create 31c4327cc5036fbc28b7534f18f3b0758cbf99ceaaec740a79488fb7ddbb0b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T22:21:24.913 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:24 smithi005 podman[93335]: 2024-09-10 22:21:24.812019472 +0000 UTC m=+0.326525880 container init 31c4327cc5036fbc28b7534f18f3b0758cbf99ceaaec740a79488fb7ddbb0b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:21:24.913 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:24 smithi005 podman[93335]: 2024-09-10 22:21:24.815479569 +0000 UTC m=+0.329985980 container start 31c4327cc5036fbc28b7534f18f3b0758cbf99ceaaec740a79488fb7ddbb0b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:21:24.913 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:24 smithi005 podman[93335]: 2024-09-10 22:21:24.911968928 +0000 UTC m=+0.426475346 container attach 31c4327cc5036fbc28b7534f18f3b0758cbf99ceaaec740a79488fb7ddbb0b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-10T22:21:25.332 INFO:journalctl@ceph.osd.9.smithi005.stdout:Sep 10 22:21:25 smithi005 podman[93335]: 2024-09-10 22:21:25.013782264 +0000 UTC m=+0.528288670 container died 31c4327cc5036fbc28b7534f18f3b0758cbf99ceaaec740a79488fb7ddbb0b4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-10T22:21:25.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:25.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:25.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:25.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:25.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:25.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:25.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:25.086+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:25.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:25 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:25.321+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:25.696 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:25 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:25.321+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:25.696 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:25 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:25.321+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:25.697 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:25 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:25.321+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:25.697 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:25 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:25.321+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:25.697 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:25 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:25.321+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:25.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.9.service' 2024-09-10T22:21:25.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:25.802 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-10T22:21:25.803 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-10T22:21:25.803 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.10 2024-09-10T22:21:26.135 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:25 smithi052 systemd[1]: Stopping Ceph osd.10 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.068+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.134+0000 7f69061f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.134+0000 7f69061f7640 -1 osd.10 81 *** Got signal Terminated *** 2024-09-10T22:21:26.136 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:26 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:26.134+0000 7f69061f7640 -1 osd.10 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:21:26.609 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:26.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:26.610 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:26.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:26.610 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:26.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:26.610 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:26.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:26.610 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:26.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:26.610 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:26.349+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:27.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:27.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:27.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:27.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:27.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:27.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:27.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:27 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:27.088+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:27.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:27 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:27.352+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:27.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:27 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:27.352+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:27.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:27 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:27.352+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:27.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:27 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:27.352+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:27.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:27 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:27.352+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:27.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:27 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:27.352+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:28.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:28.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:28.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:28.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:28.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:28.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:28.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:28 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:28.079+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:28.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:28 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:28.318+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:28.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:28 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:28.318+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:28.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:28 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:28.318+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:28.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:28 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:28.318+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:28.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:28 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:28.318+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:28.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:28 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:28.318+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:29.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:29 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:29.065+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:29.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:29 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:29.341+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:29.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:29 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:29.341+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:29.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:29 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:29.341+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:29.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:29 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:29.341+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:29.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:29 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:29.341+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:29.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:29 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:29.341+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:30.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:30.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:30.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:30.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:30.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:30.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:30.500 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:30 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:30.097+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:30.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:30 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:30.330+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:30.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:30 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:30.330+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:30.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:30 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:30.330+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:30.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:30 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:30.330+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:30.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:30 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:30.330+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:30.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:30 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:30.330+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:31.462 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:06.593602+0000 front 2024-09-10T22:20:06.593690+0000 (oldest deadline 2024-09-10T22:20:31.893482+0000) 2024-09-10T22:21:31.462 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:16.594273+0000 front 2024-09-10T22:20:16.594238+0000 (oldest deadline 2024-09-10T22:20:40.694447+0000) 2024-09-10T22:21:31.462 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:23.396825+0000 front 2024-09-10T22:20:23.396872+0000 (oldest deadline 2024-09-10T22:20:47.496741+0000) 2024-09-10T22:21:31.463 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6814 osd.3 since back 2024-09-10T22:20:31.498121+0000 front 2024-09-10T22:20:31.498230+0000 (oldest deadline 2024-09-10T22:20:56.198215+0000) 2024-09-10T22:21:31.463 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.499056+0000 front 2024-09-10T22:20:41.499083+0000 (oldest deadline 2024-09-10T22:21:05.599232+0000) 2024-09-10T22:21:31.463 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:49.601184+0000 front 2024-09-10T22:20:49.601058+0000 (oldest deadline 2024-09-10T22:21:11.900934+0000) 2024-09-10T22:21:31.463 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10[59959]: 2024-09-10T22:21:31.126+0000 7f68fe804640 -1 osd.10 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:55.401950+0000 front 2024-09-10T22:20:55.402040+0000 (oldest deadline 2024-09-10T22:21:20.101746+0000) 2024-09-10T22:21:31.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:31.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:31.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:31.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:31.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:31.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:31.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:31 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:31.288+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:31.749 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 podman[68753]: 2024-09-10 22:21:31.461628021 +0000 UTC m=+5.456411069 container died 24fb425c50e084895463e6017c7aa7228df4731f439fb4d77ed5e8e9495e3b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:21:32.211 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 podman[68753]: 2024-09-10 22:21:31.934671171 +0000 UTC m=+5.929454262 container cleanup 24fb425c50e084895463e6017c7aa7228df4731f439fb4d77ed5e8e9495e3b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-10T22:21:32.211 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:31 smithi052 bash[68753]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10 2024-09-10T22:21:32.499 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:32 smithi052 podman[68769]: 2024-09-10 22:21:32.210844081 +0000 UTC m=+0.743321110 container remove 24fb425c50e084895463e6017c7aa7228df4731f439fb4d77ed5e8e9495e3b6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-10T22:21:32.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:32.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:32.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:32.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:32.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:32.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:32.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:32 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:32.278+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:32.907 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:32 smithi052 podman[68862]: 2024-09-10 22:21:32.427780758 +0000 UTC m=+0.015258429 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:21:32.907 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:32 smithi052 podman[68862]: 2024-09-10 22:21:32.528340926 +0000 UTC m=+0.115818659 container create a3b14074eeed78f7cf4e82b922d2eab9d59d5195e72932530db4aa531ceb766e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:21:32.907 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:32 smithi052 podman[68862]: 2024-09-10 22:21:32.906185167 +0000 UTC m=+0.493662846 container init a3b14074eeed78f7cf4e82b922d2eab9d59d5195e72932530db4aa531ceb766e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-10T22:21:33.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:32 smithi052 podman[68862]: 2024-09-10 22:21:32.909747433 +0000 UTC m=+0.497225114 container start a3b14074eeed78f7cf4e82b922d2eab9d59d5195e72932530db4aa531ceb766e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T22:21:33.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:32 smithi052 podman[68862]: 2024-09-10 22:21:32.980662381 +0000 UTC m=+0.568140059 container attach a3b14074eeed78f7cf4e82b922d2eab9d59d5195e72932530db4aa531ceb766e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-10T22:21:33.250 INFO:journalctl@ceph.osd.10.smithi052.stdout:Sep 10 22:21:33 smithi052 podman[68862]: 2024-09-10 22:21:33.112766745 +0000 UTC m=+0.700244419 container died a3b14074eeed78f7cf4e82b922d2eab9d59d5195e72932530db4aa531ceb766e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T22:21:33.662 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.10.service' 2024-09-10T22:21:33.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:33.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:33.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:33.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:33.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:33.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:33.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.260+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:33.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:33.701 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-10T22:21:33.701 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-10T22:21:33.701 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.11 2024-09-10T22:21:33.999 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 systemd[1]: Stopping Ceph osd.11 for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:34.443 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.996+0000 7f321eb4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.996+0000 7f321eb4d640 -1 osd.11 81 *** Got signal Terminated *** 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:33 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:33.996+0000 7f321eb4d640 -1 osd.11 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:34.444 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:34 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:34.221+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:35.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:35.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:35.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:35.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:35.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:35.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:35.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:35 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:35.256+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:36.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:36.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:36.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:36.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:36.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:36.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:36.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:36 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:36.245+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:37.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:37.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:37.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:37.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:37.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:37.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:37.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:37.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:37 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:37.227+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-10T22:21:12.929517+0000 front 2024-09-10T22:21:12.929540+0000 (oldest deadline 2024-09-10T22:21:36.429539+0000) 2024-09-10T22:21:38.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-09-10T22:20:08.419512+0000 front 2024-09-10T22:20:08.419385+0000 (oldest deadline 2024-09-10T22:20:30.719563+0000) 2024-09-10T22:21:38.693 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6804 osd.1 since back 2024-09-10T22:20:17.021563+0000 front 2024-09-10T22:20:17.021606+0000 (oldest deadline 2024-09-10T22:20:38.721682+0000) 2024-09-10T22:21:38.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6804 osd.2 since back 2024-09-10T22:20:25.623545+0000 front 2024-09-10T22:20:25.623768+0000 (oldest deadline 2024-09-10T22:20:49.723718+0000) 2024-09-10T22:21:38.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6812 osd.4 since back 2024-09-10T22:20:41.326013+0000 front 2024-09-10T22:20:41.326082+0000 (oldest deadline 2024-09-10T22:21:07.226209+0000) 2024-09-10T22:21:38.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6812 osd.5 since back 2024-09-10T22:20:47.226596+0000 front 2024-09-10T22:20:47.226617+0000 (oldest deadline 2024-09-10T22:21:13.126688+0000) 2024-09-10T22:21:38.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.5:6822 osd.6 since back 2024-09-10T22:20:53.127134+0000 front 2024-09-10T22:20:53.127150+0000 (oldest deadline 2024-09-10T22:21:19.027074+0000) 2024-09-10T22:21:38.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.52:6820 osd.7 since back 2024-09-10T22:21:01.928083+0000 front 2024-09-10T22:21:01.928188+0000 (oldest deadline 2024-09-10T22:21:30.728488+0000) 2024-09-10T22:21:38.694 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:38 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11[60521]: 2024-09-10T22:21:38.262+0000 7f321715a640 -1 osd.11 81 heartbeat_check: no reply from 172.21.15.189:6820 osd.8 since back 2024-09-10T22:21:12.929517+0000 front 2024-09-10T22:21:12.929540+0000 (oldest deadline 2024-09-10T22:21:36.429539+0000) 2024-09-10T22:21:39.690 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:39 smithi189 podman[69405]: 2024-09-10 22:21:39.437099108 +0000 UTC m=+5.535850389 container died 76f6f61d68f185f320754d75c6d890bab94d4b04342ceda2d2ed2a0b23b971e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-10T22:21:39.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:39 smithi189 podman[69405]: 2024-09-10 22:21:39.763933137 +0000 UTC m=+5.862684417 container cleanup 76f6f61d68f185f320754d75c6d890bab94d4b04342ceda2d2ed2a0b23b971e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-10T22:21:39.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:39 smithi189 bash[69405]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11 2024-09-10T22:21:40.374 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:39 smithi189 podman[69421]: 2024-09-10 22:21:39.956613963 +0000 UTC m=+0.516184096 container remove 76f6f61d68f185f320754d75c6d890bab94d4b04342ceda2d2ed2a0b23b971e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-10T22:21:40.677 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:40 smithi189 podman[69513]: 2024-09-10 22:21:40.374068573 +0000 UTC m=+0.107814851 container create c1df5ae55e00764a541750b9cc7be27d294e7fe9af36f74946615a3d2ae07eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T22:21:40.677 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:40 smithi189 podman[69513]: 2024-09-10 22:21:40.282143912 +0000 UTC m=+0.015890192 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-10T22:21:40.677 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:40 smithi189 podman[69513]: 2024-09-10 22:21:40.601636852 +0000 UTC m=+0.335383131 container init c1df5ae55e00764a541750b9cc7be27d294e7fe9af36f74946615a3d2ae07eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-10T22:21:40.678 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:40 smithi189 podman[69513]: 2024-09-10 22:21:40.60496971 +0000 UTC m=+0.338715990 container start c1df5ae55e00764a541750b9cc7be27d294e7fe9af36f74946615a3d2ae07eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-10T22:21:40.678 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:40 smithi189 podman[69513]: 2024-09-10 22:21:40.67650708 +0000 UTC m=+0.410253378 container attach c1df5ae55e00764a541750b9cc7be27d294e7fe9af36f74946615a3d2ae07eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-10T22:21:40.943 INFO:journalctl@ceph.osd.11.smithi189.stdout:Sep 10 22:21:40 smithi189 podman[69513]: 2024-09-10 22:21:40.794556357 +0000 UTC m=+0.528302647 container died c1df5ae55e00764a541750b9cc7be27d294e7fe9af36f74946615a3d2ae07eed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-10T22:21:41.402 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@osd.11.service' 2024-09-10T22:21:41.441 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:41.442 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-10T22:21:41.442 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-10T22:21:41.442 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.a 2024-09-10T22:21:41.761 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:41 smithi005 systemd[1]: Stopping Ceph mds.a for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:42.082 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a[74427]: 2024-09-10T22:21:41.759+0000 7ffa68086640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:42.082 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:41 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a[74427]: 2024-09-10T22:21:41.759+0000 7ffa68086640 -1 mds.a *** got signal Terminated *** 2024-09-10T22:21:45.832 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:45 smithi005 podman[93436]: 2024-09-10 22:21:45.428145907 +0000 UTC m=+3.786072398 container died b62c411c72053ae2682f973cafa1c81df86e07c7d5ed1178b9324536e07f5bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-10T22:21:46.266 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:45 smithi005 podman[93436]: 2024-09-10 22:21:45.842889236 +0000 UTC m=+4.200815727 container cleanup b62c411c72053ae2682f973cafa1c81df86e07c7d5ed1178b9324536e07f5bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-10T22:21:46.266 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:45 smithi005 bash[93436]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a 2024-09-10T22:21:46.266 INFO:journalctl@ceph.mds.a.smithi005.stdout:Sep 10 22:21:46 smithi005 podman[93463]: 2024-09-10 22:21:46.052680205 +0000 UTC m=+0.625964910 container remove b62c411c72053ae2682f973cafa1c81df86e07c7d5ed1178b9324536e07f5bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T22:21:46.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.a.service' 2024-09-10T22:21:46.319 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:46.319 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-10T22:21:46.319 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-10T22:21:46.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.d 2024-09-10T22:21:46.582 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:21:46 smithi005 systemd[1]: Stopping Ceph mds.d for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:47.082 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:21:46 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-d[73241]: 2024-09-10T22:21:46.772+0000 7fed795b0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:47.082 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:21:46 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-d[73241]: 2024-09-10T22:21:46.772+0000 7fed795b0640 -1 mds.d *** got signal Terminated *** 2024-09-10T22:21:50.059 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:21:49 smithi005 podman[93570]: 2024-09-10 22:21:49.738475549 +0000 UTC m=+3.190421545 container died 5582575942e54ba43b159d26f50bca09d2dd72785d6aa88bfc58003d919738cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-d, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-10T22:21:50.332 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:21:50 smithi005 podman[93570]: 2024-09-10 22:21:50.21618902 +0000 UTC m=+3.668135017 container cleanup 5582575942e54ba43b159d26f50bca09d2dd72785d6aa88bfc58003d919738cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-d, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-10T22:21:50.332 INFO:journalctl@ceph.mds.d.smithi005.stdout:Sep 10 22:21:50 smithi005 bash[93570]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-d 2024-09-10T22:21:50.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.d.service' 2024-09-10T22:21:50.698 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:50.698 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-10T22:21:50.698 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-10T22:21:50.698 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.g 2024-09-10T22:21:51.030 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:50 smithi005 systemd[1]: Stopping Ceph mds.g for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:51.332 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g[74051]: 2024-09-10T22:21:51.028+0000 7f395d6cb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:51.332 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:51 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g[74051]: 2024-09-10T22:21:51.028+0000 7f395d6cb640 -1 mds.g *** got signal Terminated *** 2024-09-10T22:21:54.137 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:53 smithi005 podman[93693]: 2024-09-10 22:21:53.864555062 +0000 UTC m=+2.933276522 container died add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:21:54.498 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:54 smithi005 podman[93693]: 2024-09-10 22:21:54.312164651 +0000 UTC m=+3.380886100 container cleanup add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:21:54.498 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:54 smithi005 bash[93693]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g 2024-09-10T22:21:54.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.g.service' 2024-09-10T22:21:54.769 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:54 smithi005 podman[93707]: 2024-09-10 22:21:54.497030962 +0000 UTC m=+0.620788873 container remove add2f3e8e8fcc37de1f78dcdecc087de29d2ae9f96fe9a7a3c91f9dba16d69f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-10T22:21:54.769 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:54 smithi005 systemd[1]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-10T22:21:54.770 INFO:journalctl@ceph.mds.g.smithi005.stdout:Sep 10 22:21:54 smithi005 systemd[1]: Stopped Ceph mds.g for ca2ddb2e-6fc0-11ef-bcea-c7b262605968. 2024-09-10T22:21:54.781 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:54.781 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-10T22:21:54.781 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-10T22:21:54.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.j 2024-09-10T22:21:55.083 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:54 smithi005 systemd[1]: Stopping Ceph mds.j for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:55.582 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j[72856]: 2024-09-10T22:21:55.123+0000 7f3298f6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:55.582 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:55 smithi005 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j[72856]: 2024-09-10T22:21:55.123+0000 7f3298f6b640 -1 mds.j *** got signal Terminated *** 2024-09-10T22:21:58.526 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:58 smithi005 podman[93811]: 2024-09-10 22:21:58.122565156 +0000 UTC m=+3.096986388 container died 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-10T22:21:58.526 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:58 smithi005 podman[93811]: 2024-09-10 22:21:58.525047803 +0000 UTC m=+3.499469034 container cleanup 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True) 2024-09-10T22:21:58.832 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:58 smithi005 bash[93811]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j 2024-09-10T22:21:58.832 INFO:journalctl@ceph.mds.j.smithi005.stdout:Sep 10 22:21:58 smithi005 podman[93823]: 2024-09-10 22:21:58.73476275 +0000 UTC m=+0.606184743 container remove 724bdcefc74a33ec1b61a4d3995dd4cfb9a294fc2f480ee0056b534fd56da23c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-10T22:21:58.875 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.j.service' 2024-09-10T22:21:58.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:21:58.908 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-10T22:21:58.908 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-10T22:21:58.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.b 2024-09-10T22:21:59.211 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:21:58 smithi052 systemd[1]: Stopping Ceph mds.b for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:21:59.499 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:21:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: 2024-09-10T22:21:59.210+0000 7fdc01690640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:21:59.499 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:21:59 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b[65144]: 2024-09-10T22:21:59.210+0000 7fdc01690640 -1 mds.b *** got signal Terminated *** 2024-09-10T22:22:01.749 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:22:01 smithi052 podman[68963]: 2024-09-10 22:22:01.531185444 +0000 UTC m=+2.418773847 container died 1ad476cfd7f0c4631f424cd25214a9b9d6e23ed6dbfb37edd940306c26daecdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:22:02.145 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:22:01 smithi052 podman[68963]: 2024-09-10 22:22:01.926825616 +0000 UTC m=+2.814414018 container cleanup 1ad476cfd7f0c4631f424cd25214a9b9d6e23ed6dbfb37edd940306c26daecdc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-10T22:22:02.145 INFO:journalctl@ceph.mds.b.smithi052.stdout:Sep 10 22:22:01 smithi052 bash[68963]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-b 2024-09-10T22:22:02.281 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.b.service' 2024-09-10T22:22:02.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:02.318 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-10T22:22:02.318 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-10T22:22:02.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.e 2024-09-10T22:22:02.499 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:02 smithi052 systemd[1]: Stopping Ceph mds.e for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:03.000 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e[64539]: 2024-09-10T22:22:02.630+0000 7f74058bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:03.000 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:02 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e[64539]: 2024-09-10T22:22:02.630+0000 7f74058bc640 -1 mds.e *** got signal Terminated *** 2024-09-10T22:22:05.815 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:05 smithi052 podman[69096]: 2024-09-10 22:22:05.537509963 +0000 UTC m=+3.004378887 container stop 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:22:05.816 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:05 smithi052 podman[69096]: 2024-09-10 22:22:05.539045594 +0000 UTC m=+3.005914510 container died 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-10T22:22:06.165 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:05 smithi052 podman[69096]: 2024-09-10 22:22:05.889144085 +0000 UTC m=+3.356012998 container cleanup 9b5a939d2dae9206483e155c259367062d1eb3d434f5e3e0613679137692c50b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-10T22:22:06.166 INFO:journalctl@ceph.mds.e.smithi052.stdout:Sep 10 22:22:05 smithi052 bash[69096]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-e 2024-09-10T22:22:06.332 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.e.service' 2024-09-10T22:22:06.364 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:06.365 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-10T22:22:06.365 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-10T22:22:06.365 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.h 2024-09-10T22:22:06.694 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:22:06 smithi052 systemd[1]: Stopping Ceph mds.h for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:06.999 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:22:06 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h[64841]: 2024-09-10T22:22:06.692+0000 7f0a25cc3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:06.999 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:22:06 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h[64841]: 2024-09-10T22:22:06.692+0000 7f0a25cc3640 -1 mds.h *** got signal Terminated *** 2024-09-10T22:22:09.819 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:22:09 smithi052 podman[69217]: 2024-09-10 22:22:09.542263317 +0000 UTC m=+2.961692755 container died 20f93db48f9961b5af1602b5cd6ccc97d43ece441c6ae5afeb32f48856abb420 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-10T22:22:10.178 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:22:09 smithi052 podman[69217]: 2024-09-10 22:22:09.901226557 +0000 UTC m=+3.320655993 container cleanup 20f93db48f9961b5af1602b5cd6ccc97d43ece441c6ae5afeb32f48856abb420 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-10T22:22:10.178 INFO:journalctl@ceph.mds.h.smithi052.stdout:Sep 10 22:22:09 smithi052 bash[69217]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-h 2024-09-10T22:22:10.308 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.h.service' 2024-09-10T22:22:10.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:10.340 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-10T22:22:10.340 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-10T22:22:10.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.k 2024-09-10T22:22:10.499 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:22:10 smithi052 systemd[1]: Stopping Ceph mds.k for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:11.249 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:22:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k[64227]: 2024-09-10T22:22:10.770+0000 7fe4720de640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:11.250 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:22:10 smithi052 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k[64227]: 2024-09-10T22:22:10.770+0000 7fe4720de640 -1 mds.k *** got signal Terminated *** 2024-09-10T22:22:15.081 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:22:14 smithi052 podman[69337]: 2024-09-10 22:22:14.777550626 +0000 UTC m=+4.215619280 container died ee82bd925b2fd81ac8fd985d93730b8d71dd1e7ff2e49b78143691efbe5c1106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-10T22:22:15.406 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:22:15 smithi052 podman[69337]: 2024-09-10 22:22:15.179934828 +0000 UTC m=+4.618003468 container cleanup ee82bd925b2fd81ac8fd985d93730b8d71dd1e7ff2e49b78143691efbe5c1106 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-10T22:22:15.407 INFO:journalctl@ceph.mds.k.smithi052.stdout:Sep 10 22:22:15 smithi052 bash[69337]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-k 2024-09-10T22:22:15.523 DEBUG:teuthology.orchestra.run.smithi052:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.k.service' 2024-09-10T22:22:15.555 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:15.556 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-10T22:22:15.556 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-10T22:22:15.556 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.c 2024-09-10T22:22:15.847 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:22:15 smithi189 systemd[1]: Stopping Ceph mds.c for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:16.109 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:22:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c[65446]: 2024-09-10T22:22:15.845+0000 7f52e6459640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:16.109 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:22:15 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c[65446]: 2024-09-10T22:22:15.845+0000 7f52e6459640 -1 mds.c *** got signal Terminated *** 2024-09-10T22:22:17.943 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:22:17 smithi189 podman[69616]: 2024-09-10 22:22:17.53429388 +0000 UTC m=+1.789257409 container died 6d4195475644a5efc2d09caa5f761ca7254ea5bbdbee72c09df21ad2c1065a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-10T22:22:18.363 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:22:18 smithi189 podman[69616]: 2024-09-10 22:22:18.086588896 +0000 UTC m=+2.341552453 container cleanup 6d4195475644a5efc2d09caa5f761ca7254ea5bbdbee72c09df21ad2c1065a9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-10T22:22:18.364 INFO:journalctl@ceph.mds.c.smithi189.stdout:Sep 10 22:22:18 smithi189 bash[69616]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-c 2024-09-10T22:22:18.532 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.c.service' 2024-09-10T22:22:18.569 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:18.569 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-10T22:22:18.569 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-10T22:22:18.570 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.f 2024-09-10T22:22:18.908 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:18 smithi189 systemd[1]: Stopping Ceph mds.f for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:19.193 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f[65144]: 2024-09-10T22:22:18.906+0000 7f33def4d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:19.193 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:18 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f[65144]: 2024-09-10T22:22:18.906+0000 7f33def4d640 -1 mds.f *** got signal Terminated *** 2024-09-10T22:22:21.849 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:21 smithi189 podman[69750]: 2024-09-10 22:22:21.528447075 +0000 UTC m=+2.744440235 container died 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=) 2024-09-10T22:22:21.849 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:21 smithi189 podman[69750]: 2024-09-10 22:22:21.848342457 +0000 UTC m=+3.064335617 container cleanup 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-10T22:22:22.193 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:21 smithi189 bash[69750]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f 2024-09-10T22:22:22.193 INFO:journalctl@ceph.mds.f.smithi189.stdout:Sep 10 22:22:22 smithi189 podman[69762]: 2024-09-10 22:22:22.055453611 +0000 UTC m=+0.519785967 container remove 228d9640dd4f93634269f837c49708a2f5f721424abca92aebca3fbb817a78f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-09-10T22:22:22.277 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.f.service' 2024-09-10T22:22:22.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:22.311 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-10T22:22:22.311 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-10T22:22:22.311 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.i 2024-09-10T22:22:22.628 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:22 smithi189 systemd[1]: Stopping Ceph mds.i for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:22.943 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i[65748]: 2024-09-10T22:22:22.626+0000 7fd650d22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:22.943 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:22 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i[65748]: 2024-09-10T22:22:22.626+0000 7fd650d22640 -1 mds.i *** got signal Terminated *** 2024-09-10T22:22:25.861 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:25 smithi189 podman[69873]: 2024-09-10 22:22:25.538144249 +0000 UTC m=+3.005920575 container died b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-10T22:22:25.861 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:25 smithi189 podman[69873]: 2024-09-10 22:22:25.860289226 +0000 UTC m=+3.328065550 container cleanup b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-10T22:22:26.193 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:25 smithi189 bash[69873]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i 2024-09-10T22:22:26.193 INFO:journalctl@ceph.mds.i.smithi189.stdout:Sep 10 22:22:26 smithi189 podman[69885]: 2024-09-10 22:22:26.045199509 +0000 UTC m=+0.508940818 container remove b9bd5d88a3626ea4878e9ec30c6ffe2ef5baa4cff1ee46503079c6588fce15c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-10T22:22:26.281 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.i.service' 2024-09-10T22:22:26.314 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:26.314 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-10T22:22:26.314 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-10T22:22:26.314 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.l 2024-09-10T22:22:26.575 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:22:26 smithi189 systemd[1]: Stopping Ceph mds.l for ca2ddb2e-6fc0-11ef-bcea-c7b262605968... 2024-09-10T22:22:26.943 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:22:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l[64840]: 2024-09-10T22:22:26.664+0000 7f594543c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-10T22:22:26.943 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:22:26 smithi189 ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l[64840]: 2024-09-10T22:22:26.664+0000 7f594543c640 -1 mds.l *** got signal Terminated *** 2024-09-10T22:22:28.416 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:22:28 smithi189 podman[69995]: 2024-09-10 22:22:28.148643543 +0000 UTC m=+1.614861818 container died 549d5691079dc20f81ab36d1007b98a5187e8cf4a2edbcf881bcc671d8eb65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-10T22:22:28.693 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:22:28 smithi189 podman[69995]: 2024-09-10 22:22:28.497838875 +0000 UTC m=+1.964057148 container cleanup 549d5691079dc20f81ab36d1007b98a5187e8cf4a2edbcf881bcc671d8eb65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-10T22:22:28.693 INFO:journalctl@ceph.mds.l.smithi189.stdout:Sep 10 22:22:28 smithi189 bash[69995]: ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968-mds-l 2024-09-10T22:22:28.929 DEBUG:teuthology.orchestra.run.smithi189:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca2ddb2e-6fc0-11ef-bcea-c7b262605968@mds.l.service' 2024-09-10T22:22:28.961 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-10T22:22:28.961 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-10T22:22:28.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:22:29.179 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:22:31.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:22:31.948 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:22:34.407 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-10T22:22:34.609 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:22:37.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:22:37.067 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:22:37.099 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-10T22:22:37.125 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-10T22:22:37.127 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi005/crash 2024-09-10T22:22:37.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:22:37.166 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:22:37.166 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:22:37.168 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi052/crash 2024-09-10T22:22:37.169 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:22:37.210 INFO:teuthology.orchestra.run.smithi052.stderr:tar: /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:22:37.211 INFO:teuthology.orchestra.run.smithi052.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:22:37.213 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi189/crash 2024-09-10T22:22:37.213 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash -- . 2024-09-10T22:22:37.252 INFO:teuthology.orchestra.run.smithi189.stderr:tar: /var/lib/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-10T22:22:37.252 INFO:teuthology.orchestra.run.smithi189.stderr:tar: Error is not recoverable: exiting now 2024-09-10T22:22:37.253 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-10T22:22:37.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-10T22:22:37.291 INFO:tasks.cephadm:Compressing logs... 2024-09-10T22:22:37.292 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:22:37.334 DEBUG:teuthology.orchestra.run.smithi052:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:22:37.337 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T22:22:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-10T22:22:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:: No such file or directory 2024-09-10T22:22:37.359 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-10T22:22:37.360 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:22:37.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.0.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:22:37.360 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-10T22:22:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:22:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-10T22:22:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-10T22:22:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.a.log: 82.8% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:22:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-10T22:22:37.363 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-10T22:22:37.368 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.b.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:22:37.370 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:22:37.370 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.4.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log: 90.2% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:: No such file or directory 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.c.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr: 82.7% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.11.log: -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.5.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log: 90.2% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:22:37.371 INFO:teuthology.orchestra.run.smithi189.stderr: 86.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:22:37.372 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-10T22:22:37.372 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-10T22:22:37.372 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-10T22:22:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.6.log: /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.g.log: 90.1% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-10T22:22:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-10T22:22:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log: 94.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-10T22:22:37.373 INFO:teuthology.orchestra.run.smithi005.stderr: 86.6% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:22:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-10T22:22:37.373 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-10T22:22:37.374 INFO:teuthology.orchestra.run.smithi005.stderr: 94.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-10T22:22:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-10T22:22:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-10T22:22:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:22:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.3.log: 95.1% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-10T22:22:37.374 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.8.log: 95.1% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr: 95.0% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log: 86.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-10T22:22:37.375 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-10T22:22:37.376 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:22:37.376 INFO:teuthology.orchestra.run.smithi189.stderr: 91.0% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:22:37.377 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-10T22:22:37.377 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.h.log: 91.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-10T22:22:37.377 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:22:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-10T22:22:37.380 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.b.log: 90.8% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-10T22:22:37.380 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-10T22:22:37.382 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.c.log: 91.7% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-10T22:22:37.383 INFO:teuthology.orchestra.run.smithi052.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:22:37.396 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-10T22:22:37.402 INFO:teuthology.orchestra.run.smithi052.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:22:37.403 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.6% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-10T22:22:37.404 INFO:teuthology.orchestra.run.smithi189.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-10T22:22:37.421 INFO:teuthology.orchestra.run.smithi052.stderr: 92.3% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-10T22:22:37.425 INFO:teuthology.orchestra.run.smithi052.stderr: 94.0% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-10T22:22:37.440 INFO:teuthology.orchestra.run.smithi189.stderr: 94.0% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-10T22:22:37.452 INFO:teuthology.orchestra.run.smithi189.stderr: 93.3% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-10T22:22:37.536 INFO:teuthology.orchestra.run.smithi005.stderr: 89.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-10T22:22:37.555 INFO:teuthology.orchestra.run.smithi189.stderr: 91.8% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-10T22:22:37.569 INFO:teuthology.orchestra.run.smithi052.stderr: 91.8% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-10T22:22:37.685 INFO:teuthology.orchestra.run.smithi052.stderr: 92.6% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-10T22:22:37.832 INFO:teuthology.orchestra.run.smithi005.stderr: 92.7% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-10T22:22:37.863 INFO:teuthology.orchestra.run.smithi005.stderr: 92.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-10T22:22:37.866 INFO:teuthology.orchestra.run.smithi052.stderr: 93.1% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-10T22:22:37.923 INFO:teuthology.orchestra.run.smithi189.stderr: 92.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-10T22:22:37.930 INFO:teuthology.orchestra.run.smithi005.stderr: 90.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-10T22:22:37.933 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-10T22:22:37.957 INFO:teuthology.orchestra.run.smithi005.stderr: 92.9% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-10T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-10T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m0.610s 2024-09-10T22:22:37.958 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m2.832s 2024-09-10T22:22:37.959 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.106s 2024-09-10T22:22:37.979 INFO:teuthology.orchestra.run.smithi052.stderr: 92.6% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-10T22:22:38.150 INFO:teuthology.orchestra.run.smithi189.stderr: 93.8% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-10T22:22:38.186 INFO:teuthology.orchestra.run.smithi189.stderr: 93.6% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-10T22:22:38.363 INFO:teuthology.orchestra.run.smithi052.stderr: 93.5% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-10T22:22:38.375 INFO:teuthology.orchestra.run.smithi189.stderr: 93.6% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-10T22:22:38.377 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T22:22:38.377 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m1.025s 2024-09-10T22:22:38.378 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m3.428s 2024-09-10T22:22:38.378 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.154s 2024-09-10T22:22:38.432 INFO:teuthology.orchestra.run.smithi052.stderr: 93.3% -- replaced with /var/log/ceph/ca2ddb2e-6fc0-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-10T22:22:38.434 INFO:teuthology.orchestra.run.smithi052.stderr: 2024-09-10T22:22:38.434 INFO:teuthology.orchestra.run.smithi052.stderr:real 0m1.082s 2024-09-10T22:22:38.434 INFO:teuthology.orchestra.run.smithi052.stderr:user 0m3.698s 2024-09-10T22:22:38.434 INFO:teuthology.orchestra.run.smithi052.stderr:sys 0m0.141s 2024-09-10T22:22:38.434 INFO:tasks.cephadm:Archiving logs... 2024-09-10T22:22:38.435 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi005/log 2024-09-10T22:22:38.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:22:38.867 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi052/log 2024-09-10T22:22:38.868 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:22:39.404 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi189/log 2024-09-10T22:22:39.405 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T22:22:39.929 INFO:tasks.cephadm:Removing cluster... 2024-09-10T22:22:39.929 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --force 2024-09-10T22:22:40.137 INFO:teuthology.orchestra.run.smithi005.stdout:Deleting cluster with fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:22:40.404 DEBUG:teuthology.orchestra.run.smithi052:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --force 2024-09-10T22:22:40.614 INFO:teuthology.orchestra.run.smithi052.stdout:Deleting cluster with fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:22:40.871 DEBUG:teuthology.orchestra.run.smithi189:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca2ddb2e-6fc0-11ef-bcea-c7b262605968 --force 2024-09-10T22:22:41.074 INFO:teuthology.orchestra.run.smithi189.stdout:Deleting cluster with fsid: ca2ddb2e-6fc0-11ef-bcea-c7b262605968 2024-09-10T22:22:41.340 INFO:tasks.cephadm:Removing cephadm ... 2024-09-10T22:22:41.340 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:22:41.361 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:22:41.379 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-10T22:22:41.397 INFO:tasks.cephadm:Teardown complete 2024-09-10T22:22:41.397 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T22:22:42.098 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T22:22:42.098 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:22:42.101 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:22:42.104 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T22:22:42.232 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T22:22:42.488 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T22:22:42.489 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:22:42.492 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:22:42.494 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T22:22:42.507 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:22:42.509 INFO:teuthology.orchestra.run.smithi052.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:22:42.512 INFO:teuthology.orchestra.run.smithi189.stderr:bash: line 1: ntpq: command not found 2024-09-10T22:22:42.513 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:22:42.513 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-10T22:22:42.513 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -235us[ -234us] +/- 39ms 2024-09-10T22:22:42.513 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 112 +1020us[+1021us] +/- 55ms 2024-09-10T22:22:42.513 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -848us[ -848us] +/- 67ms 2024-09-10T22:22:42.513 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:22:42.514 INFO:teuthology.orchestra.run.smithi052.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:22:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:=============================================================================== 2024-09-10T22:22:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -204us[ -195us] +/- 39ms 2024-09-10T22:22:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 +1030us[+1039us] +/- 56ms 2024-09-10T22:22:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 -822us[ -813us] +/- 67ms 2024-09-10T22:22:42.515 INFO:teuthology.orchestra.run.smithi052.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:22:42.517 INFO:teuthology.orchestra.run.smithi189.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T22:22:42.517 INFO:teuthology.orchestra.run.smithi189.stdout:=============================================================================== 2024-09-10T22:22:42.517 INFO:teuthology.orchestra.run.smithi189.stdout:^* hv01.front.sepia.ceph.com 3 6 377 44 -220us[ -207us] +/- 39ms 2024-09-10T22:22:42.518 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +1037us[+1050us] +/- 56ms 2024-09-10T22:22:42.518 INFO:teuthology.orchestra.run.smithi189.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -834us[ -821us] +/- 67ms 2024-09-10T22:22:42.518 INFO:teuthology.orchestra.run.smithi189.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T22:22:42.519 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T22:22:42.645 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T22:22:42.645 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T22:22:42.678 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:22:42.763 DEBUG:teuthology.orchestra.run.smithi052:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:22:42.838 DEBUG:teuthology.orchestra.run.smithi189:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T22:22:42.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:22:42.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:22:42.944 DEBUG:teuthology.orchestra.run.smithi052:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:22:42.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:22:42.974 DEBUG:teuthology.orchestra.run.smithi189:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-10T22:22:43.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:22:43.004 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T22:22:43.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T22:22:43.023 INFO:teuthology.task.internal:Duration was 1396.394243 seconds 2024-09-10T22:22:43.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T22:22:43.031 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T22:22:43.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:22:43.034 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:22:43.036 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T22:22:43.074 INFO:teuthology.orchestra.run.smithi052.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:22:43.076 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:22:43.086 INFO:teuthology.orchestra.run.smithi189.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T22:22:43.532 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T22:22:43.532 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-09-10T22:22:43.532 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:22:43.556 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-09-10T22:22:43.556 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:22:43.601 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T22:22:43.601 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T22:22:43.625 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T22:22:43.625 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:22:43.627 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:22:43.643 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T22:22:43.693 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T22:22:43.693 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:22:43.700 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:22:43.710 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T22:22:44.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T22:22:44.313 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T22:22:44.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:22:44.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:22:44.367 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T22:22:44.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T22:22:44.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:22:44.407 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:22:44.410 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:22:44.429 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-09-10T22:22:44.431 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-09-10T22:22:44.458 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-10T22:22:44.481 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:22:44.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:22:44.498 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:22:44.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:22:44.513 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T22:22:44.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T22:22:44.537 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T22:22:44.547 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T22:22:44.548 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi005 2024-09-10T22:22:44.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:22:44.596 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi052 2024-09-10T22:22:44.596 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:22:44.631 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899713/remote/smithi189 2024-09-10T22:22:44.632 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T22:22:44.669 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T22:22:44.669 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:22:44.672 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:22:44.674 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T22:22:44.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T22:22:44.732 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T22:22:44.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T22:22:44.743 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T22:22:44.743 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:22:44.745 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:22:44.747 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T22:22:44.758 INFO:teuthology.orchestra.run.smithi005.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:22 /home/ubuntu/cephtest 2024-09-10T22:22:44.760 INFO:teuthology.orchestra.run.smithi052.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:22 /home/ubuntu/cephtest 2024-09-10T22:22:44.774 INFO:teuthology.orchestra.run.smithi189.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 22:22 /home/ubuntu/cephtest 2024-09-10T22:22:44.775 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T22:22:44.786 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T22:22:44.812 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/no 6-workunit/suites/fsync-tester}} duration: 1396.3942430019379 flavor: default owner: scheduled_hyelloji@teuthology success: true 2024-09-10T22:22:44.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T22:22:44.921 INFO:teuthology.run:pass